Skip to main content
The Python SDK and docs are currently in beta. Report issues on GitHub.
Token usage statistics

Fields

FieldTypeRequiredDescriptionExample
completion_tokensint:heavy_check_mark:Number of tokens in the completion
completion_tokens_detailsOptionalNullable[components.CompletionTokensDetails]:heavy_minus_sign:Detailed completion token usage
costOptionalNullable[float]:heavy_minus_sign:Cost of the completion
cost_detailsOptionalNullable[components.CostDetails]:heavy_minus_sign:Breakdown of upstream inference costs{"upstream_inference_completions_cost": 0.0004,"upstream_inference_cost": null,"upstream_inference_prompt_cost": 0.0008}
is_byokOptional[bool]:heavy_minus_sign:Whether a request was made using a Bring Your Own Key configuration
prompt_tokensint:heavy_check_mark:Number of tokens in the prompt
prompt_tokens_detailsOptionalNullable[components.PromptTokensDetails]:heavy_minus_sign:Detailed prompt token usage
total_tokensint:heavy_check_mark:Total number of tokens