text-generation-inference
170a12f3
- Update window size rocm flash decoding
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
1 year ago
Update window size rocm flash decoding
References
#3112 - Bug Fix: Sliding Window Attention
Author
mht-sharma
Parents
b30cdabf
Loading