Models
Chat Models
Configuration of chat models for text generation and conversations
Chat models are the core component for AI-powered conversations in VARIOS AI. They support text generation, document processing and optionally code execution.
Documentation Index
Fetch the complete documentation index at: /llms.txt
Use this file to discover all available pages before exploring further.
Configuration of chat models for text generation and conversations
| Field | Required | Description |
|---|---|---|
| Image | No | Profile image for the model (displayed in the model selection) |
| Title | Yes | Display name of the model (e.g. “Azure GPT 5.2”) |
| Field | Required | Description |
|---|---|---|
| API | Yes | API type – see Available API Types below. |
| Credentials | Yes | Stored credentials for the selected provider (dropdown selection). |
| Model Name | Yes | Technical model name sent to the API (e.g. gpt-5.2, claude-sonnet-4-5). |
| API Type | Description |
|---|---|
OpenAI Chat API (/chat/completions) | Standard OpenAI Chat Completions API for text generation |
OpenAI Assistant API (/assistants) | OpenAI Assistant API for structured assistants |
OpenAI Responses API (/responses) | OpenAI Responses API for specific response formats |
IONOS API (/chat/completions) | IONOS-compatible Chat Completions API |
| OpenAI Chat API without HTTP Proxy | Direct connection without proxy support |
| Field | Required | Description |
|---|---|---|
| Cost in $ per million input tokens | No | Cost per one million input tokens above the context threshold. |
| Cost in $ per million output tokens | No | Cost per one million output tokens above the context threshold. |
| Cost in $ per million cache tokens | No | Cost per one million cache tokens above the context threshold. |
| Context Window | No | Maximum number of tokens that can be processed in the context of a request (e.g. 1050000). |
| Output Token Limit | No | Maximum number of tokens that a model may generate in a response (e.g. 128000). |
| Field | Required | Description |
|---|---|---|
| Temperature | No | Controls creativity (0–2). Checkbox Use temperature must be enabled. Low = deterministic, high = creative. |
| Top P | No | Nucleus sampling parameter (0–1). Checkbox Use Top P must be enabled. Alternative to temperature control. |
| Additional Parameters | No | Additional API parameters as a JSON object. Enter valid JSON (e.g. {}). These parameters are appended directly to the API request. |
| Thinking Effort | No | Cognitive effort of the model. Checkbox Use thinking effort must be enabled. Value: Low, Medium or High. |
| Field | Required | Description |
|---|---|---|
| Supports Streaming | No | Checkbox Use a streaming model – Enables streaming responses (answer is displayed progressively). |
| Stream Options | No | Checkbox Use stream options – Enables extended streaming options (e.g. token usage in stream). |
| Field | Required | Description |
|---|---|---|
| User Identification | No | Checkbox Use user identification – Adds a unique user identifier to the API request. |
| Allowed MIME Types | No | File types that are sent directly to the model (e.g. images for vision models). All other file types are automatically handled via document processing. |
image/png, image/jpeg for vision models.| Field | Description |
|---|---|
| Check service state | Enables regular checks of the model’s availability. Test tokens are sent during these checks. Costs are incurred for each check. |
| Check interval (minutes) | Sets the check interval for this model. If the field is left empty, the interval from the settings is used. |
| Notify administrator when unreachable | Enables admin notifications when the model is unreachable. Configure recipients and email delivery under Settings > Notifications. |
| Option | Description |
|---|---|
| enabled | GDPR protection is always active and cannot be disabled by users. |
| optional | GDPR protection is active by default but can be disabled by users. |
| disabled | GDPR protection is disabled. |
| Option | Description |
|---|---|
| enabled | Upload of confidential documents is blocked. |
| disabled | Upload of confidential documents is allowed. |
| Option | Description |
|---|---|
| enabled | ICAP server is used for all content. |
| disabled | ICAP server is not used. |