langchain
163bf165 - Add Batch Size kwarg to the llm start callback (#13483)

Commit

2 years ago

Add Batch Size kwarg to the llm start callback (#13483) So you can more easily use the token counts directly from the API endpoint for batch size of 1

References

#13483 - Add Batch Size kwarg to the llm start callback

Author

hinthornw

Parents

23566cbe

langchain 163bf165 - Add Batch Size kwarg to the llm start callback (#13483)

langchain
163bf165 - Add Batch Size kwarg to the llm start callback (#13483)