perf: avoid recomputing rotary_emb for each layer in some Google and ModernBERT models #45555
perf: avoid redundant rotary_emb calls for `position_embeddings`
67620c54
vasqu
approved these changes
on 2026-04-21
perf: avoid redundant rotary_emb calls for `position_embeddings` dict
31bb4ddc
casinca
changed the title perf(`gemma3`): Avoid recomputing `rotary_emb` for each layer perf: avoid recomputing rotary_emb for each layer in some Google and ModernBERT models 175 days ago
vasqu
merged
628c54c2
into main 175 days ago
casinca
deleted the gemma3-optim branch 175 days ago
Assignees
No one assigned
Login to write a write a comment.
Login via GitHub