text-generation-inference
b4187d60
- Add tgi_batch_current_size and tgi_batch_current_size as response header
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
338 days ago
Add tgi_batch_current_size and tgi_batch_current_size as response header
References
response-header-metrics
Author
co42
Parents
c20025db
Loading