Add chunked attn for L4 #3162
mht-sharma
wants to merge
5 commits into
main
from
add_chunked_atn
add fix
33a7ec57
reverse flash causal change
3f343cdb
support cuda graphs
d2f8caff
fix bt
a7353c35
force attn to flashdecoding
2a10a28d
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub