text-generation-inference
25c6bbe1
- feat(backend): introduce backend_workspace_t to store precomputed information from the engine folder
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
1 year ago
feat(backend): introduce backend_workspace_t to store precomputed information from the engine folder
References
#2791 - TensorRT-LLM backend bump to latest version + misc fixes
Author
mfuntowicz
Committer
mfuntowicz
Parents
702dc9cd
Loading