transformers
[`Kernels`] Sync to latest version and add new kernels (SwiGLU, CE)
#46039
Open
Open
[`Kernels`] Sync to latest version and add new kernels (SwiGLU, CE) #46039
vasqu
wants to merge
6 commits into
huggingface:main
from
vasqu:causallm-kernels
working version --> need to fix upstream kernels to match signature a…
1b2d8fb4
add swiglu mlp
f9212eb9
ArthurZucker
commented
on 2026-05-19
ArthurZucker
commented
on 2026-05-19
well well well, rms norm was the culprit all along...
dd1a67a1
fix mode logic and bump version (will need another bump)
1139b4ed
no longer maintained
b2dcc45e
fix switching mode only on changing base flags (train<->eval)
cb0ef71b
vasqu
changed the title
Login to write a write a comment.
Login via GitHub