Interact with your VertexAI models using LLM.
gemini-1.5-flash
gemini-1.5-pro
gemini-1.0-pro
A VertexAI LLM interface can have the following parameters:
Parameter | Type | Description |
---|---|---|
api_key | str | The API key for authentication. |
temperature | float | The temperature parameter for the model. |
top_p | float | The top-p parameter for the model. |
max_tokens | int | The maximum number of tokens for the model’s output. |
frequency_penalty | float | The frequency penalty parameter for the model. |
presence_penalty | float | The presence penalty parameter for the model. |
Here is how you setup an interface to interact with your VertexAI models.
Create a .env
file with you GOOGLE_API_KEY
In your python code, import LLM from llmstudio.
Create your llm instance.
Optional: You can add your parameters as follows: