transformers
Use the Hub rotary kernel for inference only on CUDA
#49439

Merged

Use the Hub rotary kernel for inference only on CUDA #49439

qgallouedec merged 2 commits into main from hub-rotary-inference-only

Use the Hub rotary kernel for inference only on CUDA

372b1368

Merge branch 'main' into hub-rotary-inference-only

95ad7211

qgallouedec requested a review from

vasqu 14 days ago

qgallouedec requested a review from

IlyasMoutawwakil 14 days ago

qgallouedec added for patch

IlyasMoutawwakil approved these changes on 2026-10-09

qgallouedec merged 4f2db330 into main 14 days ago

qgallouedec deleted the hub-rotary-inference-only branch 14 days ago

Reviewers

IlyasMoutawwakil

vasqu

Assignees

No one assigned

Labels

for patch

Milestone

No milestone