transformers
Fix: Jamba batched generation
#32914
Merged

Fix: Jamba batched generation #32914

vasqu
vasqu
vasqu commented on 2024-08-21
vasqu
vasqu commented on 2024-08-21
vasqu
vasqu commented on 2024-08-21
vasqu
vasqu
vasqu commented on 2024-08-21
ArthurZucker
ArthurZucker commented on 2024-08-22
vasqu
vasqu init fix
c02bf38e
vasqu fix mask during cached forward, move mask related stuff to own function
fcd6d20a
vasqu adjust tests as left padding does not change logits as much anymore +…
e2c23412
vasqu vasqu force pushed to e2c23412 2 years ago
vasqu revert overwriting new integration tests
e81eee2b
vasqu
vasqu
vasqu commented on 2024-08-23
gante
gante approved these changes on 2024-08-23
vasqu move some comments to docstring
43e08dde
ArthurZucker
ArthurZucker approved these changes on 2024-08-28
ArthurZucker ArthurZucker merged 3bfd3e48 into main 2 years ago
vasqu vasqu deleted the jamba-batched-gen-fix branch 2 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone