transformers
b7bb2b59 - Add tips for generation with Int8 models (#21424)
Commit
View On GitHub
Commit
3 years ago
Add tips for generation with Int8 models (#21424) * Add tips for generation with Int8 models * Empty commit to trigger CI * Apply suggestions from code review Co-authored-by: Younes Belkada <49240599+younesbelkada@users.noreply.github.com> * Update docs/source/en/perf_infer_gpu_one.mdx Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com> --------- Co-authored-by: Younes Belkada <49240599+younesbelkada@users.noreply.github.com> Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
Author
lewtun lewtun
Parents
10056d89
FAQ Terms Privacy Refunds Impressum
Loading