Anthropic

Interact with your Anthropic models using LLMstudios LLM.

Supported models

An Anthropic LLM interface can have the following parameters:

Parameter	Type	Description
`api_key`	str	The API key for authentication.
`temperature`	float	The temperature parameter for the model.
`top_p`	float	The top-p parameter for the model.
`max_tokens`	int	The maximum number of tokens for the model’s output.
`top_k`	int	The top-k parameter for the model.

Here is how you setup an interface to interact with your Anthropic models.

Create a .env file with you ANTHROPIC_API_KEY

Make sure you call your environment variable ANTHROPIC_API_KEY

ANTHROPIC_API_KEY="YOUR-KEY"

In your python code, import LLM from llmstudio.

from llmstudio import LLM

Create your llm instance.

llm = LLM('anthropic/{model}')

Optional: You can add your parameters as follows:

llm = LLM('anthropic/model', 
temperature= ...,
max_tokens= ...,
top_p= ...,
frequency_penalty= ...,
presence_penalty= ...)

You are done setting up your Anthropic LLM!