transformers
[docs] add a comment that offloading requires CUDA GPU
#35055

Merged

[docs] add a comment that offloading requires CUDA GPU #35055

stevhliu merged 2 commits into huggingface:main from faaany:best-practices

add commen to offloading

eea83570

stevhliu approved these changes on 2024-12-03

Update docs/source/en/kv_cache.md

ca07017d

stevhliu merged baa3b221 into main 1 year ago

faaany deleted the best-practices branch 312 days ago

Reviewers

stevhliu

Assignees

No one assigned

Labels

None yet

Milestone

No milestone