text-generation-inference
bb37321b - allow to fix paged attention num blocks
Commit
View On GitHub
Commit
1 year ago
allow to fix paged attention num blocks
References
set-num-blocks
Author
fxmarty fxmarty
Parents
9a59ebce
FAQ Terms Privacy Refunds Impressum
Loading