LLM
Anthropic
Interact with your Anthropic models using LLMstudios LLM.
Supported models
claude-3-opus-20240229
claude-3-sonnet-2024022
claude-3-haiku-20240307
claude-2.1
claude-2
claude-instant-1.2
Parameters
An Anthropic LLM interface can have the following parameters:
Parameter | Type | Description |
---|---|---|
api_key | str | The API key for authentication. |
temperature | float | The temperature parameter for the model. |
top_p | float | The top-p parameter for the model. |
max_tokens | int | The maximum number of tokens for the model’s output. |
top_k | int | The top-k parameter for the model. |
Usage
Here is how you setup an interface to interact with your Anthropic models.
1
Create a .env
file with you ANTHROPIC_API_KEY
Make sure you call your environment variable ANTHROPIC_API_KEY
2
In your python code, import LLM from llmstudio.
3
Create your llm instance.
4
Optional: You can add your parameters as follows:
You are done setting up your Anthropic LLM!