onnxruntime
89a96bdc - Reduce heap contention in Tokenizer (#20196)

Commit
1 year ago
Reduce heap contention in Tokenizer (#20196) ### Description <!-- Describe your changes. --> Re-use vector buffers to prevent frequent reallocations. ### Motivation and Context <!-- - Why is this change required? What problem does it solve? - If it fixes an open issue, please link to the issue here. --> Reduce process heap contention. ![image](https://github.com/microsoft/onnxruntime/assets/11303988/f0b78062-3d86-45b7-87fd-e0696b170cf8)
Author
Parents
Loading