Chat

Make chat calls using your LLM.

Parameters

The llm.chat method can have the following parameters.

Parameter	Type	Description
`input`	str	The input message to send to the chat model.
`is_stream`	bool	The temperature parameter for the model.
`**kwargs`	dict	Additional parameters to pass to the chat model.

Refer to your provider-specific documentation for additional kwargs you can use.

Output	Type	Description
`ChatCompletion`	object	A chat completion object in the OpenAI format + metrics computed by LLMstudio.

Here’s how to use .chat() to make calls to your LLM.

Start by importing LLM.

from llmstudio import LLM

Set up an LLM from your desired provider.

llm = LLM('openai/gpt-4o')

Create your message. Your message can be a simple string or a message in the OpenAI format.

message = "Hello, how are you today?"

message = [
{"role": "system", "content": "You are a helpfull assistant."},
{"role": "user", "content": "Hello, how are you today?"}
]

Get your response.

response = llm.chat(message)

Vizualize your response.

print(response)

Get your response.

response = llm.chat(message, is_stream = True)

Vizualize your response.

for chunk in response:
   print(chunk)

You are done chating with your LLMstudio LLM!