feat: report what a call cost in tokens

Three dialects spell the same two numbers differently: Ollama counts
in `prompt_eval_count` and `eval_count`, the OpenAI shape in
`usage.prompt_tokens` and `usage.completion_tokens`, Anthropic in
`usage.input_tokens` and `usage.output_tokens`. All three now reach
the caller as `tokens_prompt` and `tokens_completion`, which the hub
lifts into the audit log by itself.

An answer that carries no count leaves both fields empty rather than
reporting a zero: a zero is a measurement, and this is the absence of
one. Half a count is reported as far as it goes.

The cost of a model call was the one part of the audit question
"which model produced this, and what did it cost" that nothing
answered (model pool M3).

Signed-off-by: flemming-it <sf@flemming.it>
This commit is contained in:
flemming-it 2026-10-26 03:54:39 +01:00
parent a6fe962916
commit d5b000e18e
8 changed files with 155 additions and 7 deletions

View file

@ -5,7 +5,7 @@
[package]
name = "llm_chat"
version = "0.2.1"
version = "0.3.0"
edition = "2024"
license = "Apache-2.0"
publish = false