text-generation-inference
8d018483
- Update server tests
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
1 year ago
Update server tests - Default to throughput test in k6 - Use TGI_WIGGLE_ROOM to adjust wiggle room
References
#2449 - Lots of improvements (Still 2 allocators)
Author
Narsil
Parents
12325564
Loading
