DeepSpeed
Read rope_theta from rope_parameters in the Llama injection policy
#8341
Merged
Merged
Read rope_theta from rope_parameters in the Llama injection policy #8341
tohtana
merged
6 commits into
deepspeedai:master
from
alanhuangyoo:fix/llama-injection-rope-parameters
Read rope_theta from rope_parameters in the Llama injection policy
ecda5f94
ebarkhordar
commented
on 2026-09-04
Pin the Llama rope_theta helper against a real LlamaConfig
3dd2716a
tohtana
requested changes
on 2026-09-05
Refuse rotary variants kernel injection cannot serve
8447987c
Merge remote-tracking branch 'upstream/master' into fix/llama-injecti…
ee60682a
tohtana
approved these changes
on 2026-09-08
Merge branch 'master' into fix/llama-injection-rope-parameters
e8ba2410
Apply yapf formatting to the rope_theta test
4c687f12
disabled auto-merge 9 days ago
Head branch was pushed to by a user without write access
Head branch was pushed to by a user without write access
Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub