Kernels and loaders robustification (#47334)
* claude's fix
* fix multi device deepgemm
* address comments
* added test
* sonicmoe version specs
* full kernels robustification
* sonicmoe: fail loud on unsupported activation; per-integration kernel tests
- sonicmoe_experts_forward raises on an unsupported hidden_act instead of
silently falling back to swiglu; the wrapper drops the silent enum default.
- Split tests/test_kernel_loaders.py into per-integration files under
tests/integrations/ (sonicmoe, deepgemm, finegrained_fp8): loader env-gating
+ aot_eager compile-safety, plus real forward tests that mock only the
innermost kernel op and assert the value-level marshalling invariants.
Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
* fix nasty hidden warm cach issue
* test
* respect torch_device
* fix compile _si_sm100
* test
* address comments and fix compile testing
* kernel loadability checker, dynamo friendly sm100 check, better error and checks
* trimming
* style
* address more comments
* support distributions
* make tests work on cpu and test them on gpu as well
* comments
* update ci
* remove unnecessary
---------
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>