transformers
perf: avoid recomputing rotary_emb for each layer in some Google and ModernBERT models
#45555
Merged

perf: avoid recomputing rotary_emb for each layer in some Google and ModernBERT models #45555

vasqu merged 2 commits into huggingface:main from casinca:gemma3-optim
casinca
casinca perf: avoid redundant rotary_emb calls for `position_embeddings`
67620c54
casinca
vasqu
vasqu approved these changes on 2026-04-21
vasqu
github-actions
casinca
vasqu
github-actions
casinca perf: avoid redundant rotary_emb calls for `position_embeddings` dict
31bb4ddc
casinca casinca changed the title perf(`gemma3`): Avoid recomputing `rotary_emb` for each layer perf: avoid recomputing rotary_emb for each layer in some Google and ModernBERT models 175 days ago
github-actions
zucchini-nlp
zucchini-nlp approved these changes on 2026-04-22
zucchini-nlp
github-actions
HuggingFaceDocBuilderDev
github-actions
vasqu
vasqu vasqu merged 628c54c2 into main 175 days ago
casinca casinca deleted the gemma3-optim branch 175 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone