Navigate to Kubernetes Engine
Select Deploy
Name Your Deployment
Select Your Cluster
Proceed to Container Details
Set Image Path
Set Environment Variables
Environment Variable | Value |
---|---|
LLMSTUDIO_ENGINE_HOST | 0.0.0.0 |
LLMSTUDIO_ENGINE_PORT | 8001 |
LLMSTUDIO_TRACKING_HOST | 0.0.0.0 |
LLMSTUDIO_TRACKING_PORT | 8002 |
GOOGLE_API_KEY
environment variable to enable calls to Google’s Gemini models.
Proceed to Expose (Optional)
Expose Ports
Deploy
Set Up Project
calls.ipynb
.env
Set Up Files
.env
file with the following: