transformers
a9b313a0 - docs: add continuous batching to serving (#40758)

Commit

97 days ago

docs: add continuous batching to serving (#40758) * docs: tmp * docs: add continuous batching to serving * docs: reword after @lysandrejik review

References

Author

McPatate

Parents