import requests
import json

# Main function that will do everything
def main():
    
    # The URL of our endpoint
    url = "http://localhost:11434/api/chat"

    # We'll use this to store the current prompt from the user.
    prompt = ""

    # We'll use an array to store all of the messages between the user and
    # the LLM in the current session.
    history = []

    # Here we will read the user's input until they enter 'bye'
    while(prompt != "bye"):
        # Read user input
        prompt = input("User => ")

        # Check if the exit command was received
        if prompt == "bye":
            break

        # Append the current message to the history.
        history.append({"role": "user", "content": prompt})

        # The data that will be sent to the OLlama endpoint
        data = {
            "model": "mixtral",
            "messages": history,
            "stream": True
        }

        # Create a new session to stream the model's response
        sess = requests.Session()

        # Print a pretty message for UX purposes
        print("Assistant =>",end="")

        # Stream the model's response and print it, bit by bit.
        with sess.post(url, json=data, stream=True) as resp:
            for line in resp.iter_lines():
                if line:
                    full_response = line.decode("utf-8")
                    bit = json.loads(full_response)
                    print(bit["message"]["content"], end="", flush=True)
        print()

# Call the main function
if __name__ == "__main__":
    main()
				
			

				
					User => What ingredients do I need to make pancakes?
Assistant => To make basic pancakes, you will need the following ingredients:

* 1 cup all-purpose flour
* 2 tablespoons white sugar
* 1 teaspoon baking powder
* 1/2 teaspoon baking soda
* 1/4 teaspoon salt
* 3/4 cup buttermilk
* 1/3 cup milk
* 1 egg
* 2 tablespoons unsalted butter, melted

You can also add other ingredients such as vanilla extract, cinnamon, or blueberries to the batter if you like. To cook the pancakes, you will need a griddle or frying pan and some additional butter or oil for greasing the surface.

Here is a simple recipe for making pancakes:

1. In a medium-sized bowl, whisk together the flour, sugar, baking powder, baking soda, and salt.
2. In a separate bowl, whisk together the buttermilk, milk, egg, and melted butter.
3. Add the wet ingredients to the dry ingredients and stir until just combined. The batter should be slightly lumpy; do not overmix.
4. Preheat a griddle or frying pan over medium heat and grease it with butter or oil.
5. For each pancake, pour about 1/4 cup of batter onto the griddle or pan. Cook until bubbles form on the surface of the pancake and the edges start to look set, about 2-3 minutes.
6. Flip the pancake and cook until golden brown, about 2 more minutes.
7. Repeat with the remaining batter, adding more butter or oil to the griddle or pan as needed. Serve the pancakes hot, with your choice of toppings such as maple syrup, fresh fruit, or whipped cream.

I hope this helps! Let me know if you have any questions.