text-generation-inference
849d8821
- QuantLinear is rocm compatible.
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
1 year ago
QuantLinear is rocm compatible.
References
#2673 - Choosing input/total tokens automatically based on available VRAM?
Author
Narsil
Parents
82a6cb82
Loading