langchain
fbfed65f - core, partners: add token usage attribute to AIMessage (#21944)

Commit
1 year ago
core, partners: add token usage attribute to AIMessage (#21944) ```python class UsageMetadata(TypedDict): """Usage metadata for a message, such as token counts. Attributes: input_tokens: (int) count of input (or prompt) tokens output_tokens: (int) count of output (or completion) tokens total_tokens: (int) total token count """ input_tokens: int output_tokens: int total_tokens: int ``` ```python class AIMessage(BaseMessage): ... usage_metadata: Optional[UsageMetadata] = None """If provided, token usage information associated with the message.""" ... ```
Author
Parents
Loading