llm-chat/src
flemming-it 72f3037ebe
Some checks failed
CI / Linux x86_64 (Forgejo) (push) Failing after 1s
feat: max_tokens and repeat_penalty inputs, truncated and stop_reason outputs, 0.4.0
A model caught in a repetition loop wrote until the flow's 300 s
timeout. max_tokens bounds the answer on every wire (Ollama
num_predict, OpenAI max_tokens, Anthropic max_tokens), and
truncated tells the caller whether the answer stopped at that
limit. repeat_penalty goes to Ollama and vLLM and is refused where
the backend has no such setting.

Signed-off-by: flemming-it <sf@flemming.it>
2026-11-12 15:49:50 +01:00
..
lib.rs feat: max_tokens and repeat_penalty inputs, truncated and stop_reason outputs, 0.4.0 2026-11-12 15:49:50 +01:00
llm.rs feat: max_tokens and repeat_penalty inputs, truncated and stop_reason outputs, 0.4.0 2026-11-12 15:49:50 +01:00