PR #42872 Fix GraniteMoeHybrid in transformers v5

Fix GraniteMoeHybrid in transformers v5 #42872

zucchini-nlp merged 11 commits into huggingface:main from avihu111:granitemoehybrid_apply_rope_bugfix

apply_rotary_pos_emb should be called

0d73afbd

fix position_embeddings usage in granitemoehybrid

447bb785

Merge branch 'main' into granitemoehybrid_apply_rope_bugfix

d87f3cbd

setting `self.rotary_emb` to None only in hybrid models. Safer, since…

c3195cf1

minor

0ce3f674

adding `position_embedding_type` to the config.

39755d99

avihu111 commented on 2025-12-15

zucchini-nlp commented on 2025-12-15

review cleanup

ec1178a7

modeling too

f1cf3b35

avihu111 requested a review from

zucchini-nlp 155 days ago

rewrite conditionally applying rope

ff087e18

resolve rotary_emb issue

b6975bc5

zucchini-nlp approved these changes on 2025-12-15

Merge branch 'main' into granitemoehybrid_apply_rope_bugfix

a291a050

zucchini-nlp enabled auto-merge (squash) 154 days ago

zucchini-nlp merged 5d2f82b5 into main 154 days ago

Reviewers

zucchini-nlp

Assignees

No one assigned

Labels

None yet

Milestone

No milestone