feat: report what a call cost in tokens
Three dialects spell the same two numbers differently: Ollama counts in `prompt_eval_count` and `eval_count`, the OpenAI shape in `usage.prompt_tokens` and `usage.completion_tokens`, Anthropic in `usage.input_tokens` and `usage.output_tokens`. All three now reach the caller as `tokens_prompt` and `tokens_completion`, which the hub lifts into the audit log by itself. An answer that carries no count leaves both fields empty rather than reporting a zero: a zero is a measurement, and this is the absence of one. Half a count is reported as far as it goes. The cost of a model call was the one part of the audit question "which model produced this, and what did it cost" that nothing answered (model pool M3). Signed-off-by: flemming-it <sf@flemming.it>
This commit is contained in:
parent
a6fe962916
commit
d5b000e18e
8 changed files with 155 additions and 7 deletions
|
|
@ -10,7 +10,7 @@ die Anthropic Messages API.
|
|||
|
||||
## Capability
|
||||
|
||||
- `llm.chat@0.2.0`
|
||||
- `llm.chat@0.3.0`
|
||||
|
||||
## Eingaben
|
||||
|
||||
|
|
@ -40,6 +40,8 @@ die Anthropic Messages API.
|
|||
| `model_endpoint` | text | URL, gegen die die Antwort erzeugt wurde. |
|
||||
| `model_name` | text | Modell-ID wie an die LLM-API gesendet. |
|
||||
| `model_digest` | text | SHA-256-Digest des bedienenden Ollama-Modells. Leer bei `openai`/`anthropic` — diese APIs bieten keinen Digest; das Feld bleibt leer statt erfunden. |
|
||||
| `tokens_prompt` | text | Was die Anfrage gekostet hat, nach der Zählung des Backends. Leer, wenn die Antwort keine Zählung enthielt. |
|
||||
| `tokens_completion` | text | Was die Antwort gekostet hat, gleiche Regel. Ollama zählt in `eval_count`, das OpenAI-Format in `usage.completion_tokens`, Anthropic in `usage.output_tokens`. |
|
||||
|
||||
Zusammen beantworten die drei `model_*`-Ausgaben die Audit-
|
||||
Frage: „Welches genaue Modell hat diese Antwort erzeugt?" —
|
||||
|
|
|
|||
Loading…
Add table
Add a link
Reference in a new issue