transformers
ebea912f - Kernels and loaders robustification (#47334)

Commit
117 days ago
Kernels and loaders robustification (#47334) * claude's fix * fix multi device deepgemm * address comments * added test * sonicmoe version specs * full kernels robustification * sonicmoe: fail loud on unsupported activation; per-integration kernel tests - sonicmoe_experts_forward raises on an unsupported hidden_act instead of silently falling back to swiglu; the wrapper drops the silent enum default. - Split tests/test_kernel_loaders.py into per-integration files under tests/integrations/ (sonicmoe, deepgemm, finegrained_fp8): loader env-gating + aot_eager compile-safety, plus real forward tests that mock only the innermost kernel op and assert the value-level marshalling invariants. Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com> * fix nasty hidden warm cach issue * test * respect torch_device * fix compile _si_sm100 * test * address comments and fix compile testing * kernel loadability checker, dynamo friendly sm100 check, better error and checks * trimming * style * address more comments * support distributions * make tests work on cpu and test them on gpu as well * comments * update ci * remove unnecessary --------- Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Parents
Loading