DeepSpeed
ed86967a - fix(refresh): reach the backend cat cache on GLU-only (dense) models

Commit
1 day ago
fix(refresh): reach the backend cat cache on GLU-only (dense) models segki_refresh looked up the backend handle only through _ki_gdn_op, but GLU-only models carry theirs on the MLP modules as _ki_dual_op — for those, clear_glu_cat_cache() was never called and the process-wide gate|up concat served stale values after an in-place sync (review finding, Masahiro). Any handle reaches the process-wide cache; scan both attributes. New arena test covers the dense-model branch with a GLU-only model (DS_SEGMENT_KI_GLU_TEST_MODEL, default Qwen/Qwen3-0.6B). Signed-off-by: Guokai Ma <guokai.ma@intel.com>
Author
Parents
Loading