DeepSpeed
[SP] add SP deny list instead of allow
#7887
Open

[SP] add SP deny list instead of allow #7887

kashif wants to merge 18 commits into deepspeedai:master from kashif:sp_attn_deny
kashif
kashif kashif requested a review from tjruwase tjruwase 22 days ago
kashif kashif requested a review from tohtana tohtana 22 days ago
kashif add SP deny list instead of allow
aec2c90b
kashif kashif force pushed from 6a76b53f to aec2c90b 22 days ago
tohtana
tohtana commented on 2026-03-06
kashif kashif requested a review from loadams loadams 19 days ago
kashif hub-kernel lazy registration before validation and tests
49e0310e
kashif kashif force pushed from 50441788 to 49e0310e 19 days ago
kashif Merge branch 'master' into sp_attn_deny
2f8e77c7
kashif
stas00
tohtana Merge branch 'master' into sp_attn_deny
ce69dc0e
tohtana
kashif
stas00
stas00
kashif Merge branch 'master' into sp_attn_deny
952c3ae8
kashif Merge branch 'master' into sp_attn_deny
6e3f2cb3
kashif
kashif position_ids generation and flex_attention BlockMask
874ec62f
kashif
kashif refactor
7d0a136b
kashif update comments
58681356
kashif kashif requested a review from tohtana tohtana 13 days ago
stas00
stas00
stas00 commented on 2026-03-15
kashif
kashif do not check for has_packed_samples
b0e05f0a
stas00
kashif raise error instead of warning
89058fc8
kashif
kashif cache BlockMask
463cb302
stas00
kashif
kashif
stas00
stas00
kashif
kashif
stas00
stas00
stas00 requested changes on 2026-03-20
loadams Merge branch 'master' into sp_attn_deny
5cf053df
sfc-gh-truwase Merge branch 'master' into sp_attn_deny
e2504921
kashif flex_attention: lazy imports to fix pickle issue and add test
8f53e6cc
kashif fix flex_attention BlockMask guard and add position_ids warning in fo…
d4c89533
kashif
kashif flex_attention test: use local tiny model, fix _compile gradient issue
12bbb9ce
kashif
kashif don't compile create_block_mask inside forward()
43862532
stas00
stas00 requested changes on 2026-03-27

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone