feat: think input switches the thinking phase of reasoning models, 0.3.1
Some checks failed
CI / Linux x86_64 (Forgejo) (push) Failing after 2s
Some checks failed
CI / Linux x86_64 (Forgejo) (push) Failing after 2s
Ollama gets think, vLLM chat_template_kwargs.enable_thinking. Refused where the backend has no such switch. Signed-off-by: flemming-it <sf@flemming.it>
This commit is contained in:
parent
d5b000e18e
commit
6455a7457e
7 changed files with 170 additions and 4 deletions
|
|
@ -21,6 +21,7 @@ Anthropic Messages API.
|
|||
| `model` | text | Model identifier (e.g. `qwen2.5:14b`, `claude-fable-5`). |
|
||||
| `api_key` | text | Optional API key. Never appears in outputs, logs, or events. |
|
||||
| `keep_alive` | text | Ollama only: how long the server keeps the model resident after this request (`4h`, `30m`, `-1` = indefinitely). Empty = server default, which unloads after five minutes. Refused with any other `api`. |
|
||||
| `think` | text | `true` or `false`: whether a reasoning model runs its thinking phase. Empty = server default (Ollama lets qwen3-type models think). Ollama gets `think`, vLLM `chat_template_kwargs.enable_thinking`; refused on the OpenAI wire; Anthropic takes `false` only. Measured on Ollama 0.40.9: `qwen3.8:27b` and `gemma4:26b` honour `false`; `qwen3:30b-a3b` thinks anyway and its thinking then arrives inside the reply, ending with `</think>`. |
|
||||
| `system_prompt` | text | Optional system message. Empty = use the model's default. |
|
||||
| `api` | text | Optional wire format: `ollama` (default), `openai`, `anthropic`. |
|
||||
|
||||
|
|
|
|||
Loading…
Add table
Add a link
Reference in a new issue