Help Center / AI Assistant / Configuration

Configuration

The AI Assistant lets you analyze risk data through natural language. It is off until you supply a provider and, for a cloud provider, an API key. MTC Skopos never proxies these calls: your client talks directly to the provider you configure, with your key.

Provider setup

Provider typeTypical modelsNotes
AnthropicClaude Opus 5.5, Sonnet 5.5, Haiku 5.5, Fable 5.1The default
OpenAI CompatibleGPT-class models, and any OpenAI-compatible endpointSet a base URL for anything other than the public OpenAI API
Azure OpenAIAzure-hosted deploymentsNeeds a base URL, API version, and auth header
LocalA model on your machine or network: LM Studio, Ollama, llama.cpp, vLLMNo API key needed. See Local provider
  1. Go to Settings > AI Assistant
  2. Select your Provider Type
  3. Enter your API Key. It is optional for the Local provider
  4. Choose a Model. The shipped default is claude-sonnet-5-5
  5. Set a Base URL if you use a self-hosted, proxy, or Azure endpoint

Azure OpenAI

Azure deployments need three extra fields:

FieldDefault
Base URLnone, required
API Version2024-10-21
Auth Headerapi-key

Local provider

Use the Local provider for a model that runs on your own machine or network. The API key is optional, and the base URL defaults to http://localhost:1234.

ServerBase URL
LM Studiohttp://localhost:1234
Ollamahttp://localhost:11434
llama.cpphttp://localhost:8080

The Local provider adds three settings:

SettingWhat it does
Context windowThe context length the model is loaded with on your server. LM Studio and vLLM report it, so it is filled automatically. For Ollama or llama.cpp, enter the value configured on the server
Reasoning switchHow your server turns reasoning on, off, or sets its depth: reasoning_effort (gpt-oss, Ollama), chat_template_kwargs (Qwen3 on vLLM, llama.cpp, SGLang) or enable_thinking (Qwen API). Keep Not sent to use the server default
Reasoning budget fieldCaps the reasoning tokens according to the effort, and always leaves room for the answer. On a local server, reasoning and answer share the output token limit, so uncapped reasoning can leave no answer. Set it only if your server supports the field

Model settings

SettingDefaultWhat it does
EffortModel defaultHow much the model reasons before it answers. Higher effort gives a more thorough analysis, but is slower and uses more tokens. Low or Medium is usually sufficient for summaries. The levels are Low, Medium, High, Extra high and Max. If the model does not support the level you select, the next lower level is used. With the Local provider, Off disables reasoning when the server has a reasoning switch
TemperatureModel defaultResponse variability. Select Custom to set a value from 0.0 (near-deterministic) to 1.0 (creative). Some models do not accept a temperature, for example the current Claude models. For these models, the value is not sent
Max Output Tokens32,000, or the model maximum if lowerCeiling on the length of a single response
Response LanguageEnglishLanguage the model answers in
Context WindowSet from the model, 1,000,000 for the current Claude modelsTotal conversation budget before compaction starts. When the provider reports the model limits, these values are used

Two further settings govern long conversations: a reserve of 30,000 tokens is held back for the response, and 40,000 tokens of recent turns are kept verbatim when older turns are compacted. You rarely need to change either.

Tool limits

These caps decide how much data any single tool call may return. They exist because analysis results are frequently far larger than a context window.

SettingDefaultCeiling
Batch size1025
Search results10100
Entities per risk20100
Overview top N10100
Aggregation groups20100
Detail items50100
Flat recommendations30100
Max characters per tool result24,000none

The ceiling is a hard cap in the application. Asking the model for "all users" does not lift it. A tool that has more rows tells the model, and the model can request the next page. A tool result longer than the character limit is cut, and the model is told to narrow its query or page through the results. Use a lower character limit with a local model that has a small context window. Where completeness matters, scope the analysis narrowly first and ask the assistant about the smaller result. See Scoping Your Analysis.

Lower values produce faster, cheaper answers. Raise them when you need breadth and accept the token cost.

Updated on: 2026-11-04

« Back to AI Assistant