Parameter | Type | Description |
---|---|---|
temperature | float | The temperature parameter for the model. |
top_p | float | The top-p parameter for the model. |
num_predict | int | The number of tokens to predict. |
top_k | int | The top-k parameter for the model. |
config.yaml
in the same directory your code is in.config.yaml
file.