made minor updates to wave ai documentation for clarity

This commit is contained in:
Knox Lively
2024-05-09 19:37:14 -06:00
parent d91f65448e
commit 144efdae12
+4 -4
View File
@@ -32,14 +32,14 @@ This method is ideal for one-off queries or when you need a straightforward answ
## Customization
Wave AI comes with default settings that work out of the box. By default, Wave will proxy your requests through our cloud servers to OpenAI. However, you can customize your experience by modifying the following settings in the UI or by using the [/client:set](/reference/slashcommands#client-set) command:
By default, Wave will proxy your requests through our cloud servers to OpenAI. However, you can customize your experience by modifying the following settings in the UI or by using the [/client:set](/reference/slashcommands#client-set) command:
- `aiapitoken:` Set your own OpenAI API key if you prefer not to use Wave's default configuration. Note that your API token will never be sent to Wave's cloud servers. When you provide your own API key, all future requests will be sent directly to OpenAI or any other endpoint you specify using `aibaseurl`.
- `aibaseurl:` If you want to use other 3rd party APIs compatible with the OpenAI API, you can change the base URL. You will also want to set your `aiapitoken` in conjunction with the base url to use a different service.
- `aibaseurl:` If you want to use other 3rd party LLM providers compatible with the OpenAI API, you can change the base URL. You will also want to set your `aiapitoken` in conjunction with the base url to use a different service if that service requires one.
- `aimaxchoices:` This option determines the number of different response variations the AI model will generate for each query. Increasing this value will provide more diverse responses, while decreasing it will make the model's output more focused and consistent.
- `aimaxtokens:` This setting allows you to control the maximum number of tokens (words or word pieces) that the AI model will generate in a single response.
- `aimodel:` Wave AI uses the ChatGPT *gpt-3.5-turbo* model by default, but you can choose a different model that suits your needs. You will need to also set `aiapitoken` if you choose to use another ChatGPT model. Also, when configuring other third-party services you will want to change this setting to the appropriate model.
- `aitimeout:` Specify the maximum time (in milliseconds) to wait for a response from the AI service before timing out. The default value is 10000 (10 seconds). This setting is particularly useful when configuring and troubleshooting LLM providers, as response times can vary significantly depending on the hardware constraints of the system running the model.
- `aimodel:` By default, Wave uses ChatGPTs *gpt-3.5-turbo* model, however you can choose a [different model](https://platform.openai.com/docs/models/overview) if you wish. You will need to also set `aiapitoken` if you choose to use another ChatGPT model. Also, when configuring other third-party services you will want to change this setting to the appropriate model.
- `aitimeout:` Specify the maximum time (in milliseconds) to wait for a response from the AI service before timing out. The default value is 10 seconds. This setting is particularly useful when configuring and troubleshooting LLM providers, as response times can vary significantly depending on the hardware constraints of the system running the model.
**Note:** In order to prevent abuse, [telemetry](/reference/telemetry) must be enabled to use the cloud servers. There is currently a rate limit of 200 requests per day.