transformers
fix to accept cumulative_seqlens from TransformersKwargs in FA
#40194

Merged

fix to accept cumulative_seqlens from TransformersKwargs in FA #40194

ArthurZucker merged 4 commits into huggingface:main from Kurt232:fix/args_in_flash_attention_forward

Kurt232 changed the title ~~fix to accept cumulative_seqlens from TransformersKwargs in FA #40193~~ fix to accept cumulative_seqlens from TransformersKwargs in FA 204 days ago

fix to the typings which are unmatched to FA function signature

dc0624db

Kurt232 force pushed from fedbf6d0 to dc0624db 198 days ago

format changes by ruff

a9cd0b22

vasqu commented on 2025-08-21

Kurt232 changed the title ~~fix to accept cumulative_seqlens from TransformersKwargs in FA~~ 🚨 fix to accept cumulative_seqlens from TransformersKwargs in FA 198 days ago

Update src/transformers/integrations/flash_paged.py

a1415149

ArthurZucker commented on 2025-08-21

revert continuous_batching signiture, which is more meaningful

d93cdd1e

Kurt232 commented on 2025-08-22

Kurt232 changed the title ~~🚨 fix to accept cumulative_seqlens from TransformersKwargs in FA~~ fix to accept cumulative_seqlens from TransformersKwargs in FA 197 days ago

ArthurZucker approved these changes on 2025-08-25

ArthurZucker merged 14b89fed into main 194 days ago

Kurt232 deleted the fix/args_in_flash_attention_forward branch 194 days ago

Reviewers

ArthurZucker

vasqu

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

transformers fix to accept cumulative_seqlens from TransformersKwargs in FA #40194 Merged

fix to accept cumulative_seqlens from TransformersKwargs in FA #40194

transformers
fix to accept cumulative_seqlens from TransformersKwargs in FA
#40194

Merged