[CB] Fix capture of max_seqlen #45323
Fine-grained control over varlen and decode path for CGs
8dd14540
Add padding for max_seqlen
dffdc643
Add max_seqlen to the key
8e038db4
Fix padding
36aab67d
Style
5fdd97bb
Fix logits processors and compile
2937f4e2
Merge branch 'main' into cb-fix-cg-prefill
aa1ae5c0
Remove the compile disabling for varlen path
2312cd05
Add tests for fa3
88875f78
Fix bug and disable varlen compile
489a5858
Adapted checks for the new tuple behavior
991093c9
Fixing tests
4d45a84c
Style
8f96226a
Merge branch 'main' into cb-fix-cg-prefill
0ceb6590
remi-or
marked this pull request as ready for review 70 days ago
restrict kwargs
56ba0cb3
Review compliance
8a8703ef
Merge branch 'main' into cb-fix-cg-prefill
355b4780
remi-or
merged
71560f45
into main 68 days ago
remi-or
deleted the cb-fix-cg-prefill branch 68 days ago
Assignees
No one assigned
Login to write a write a comment.
Login via GitHub