Fix: Jamba batched generation #32914
vasqu
commented
on 2024-08-21
vasqu
commented
on 2024-08-21
vasqu
commented
on 2024-08-21
vasqu
commented
on 2024-08-21
init fix
c02bf38e
fix mask during cached forward, move mask related stuff to own function
fcd6d20a
adjust tests as left padding does not change logits as much anymore +…
e2c23412
vasqu
force pushed
to
e2c23412
2 years ago
revert overwriting new integration tests
e81eee2b
vasqu
commented
on 2024-08-23
gante
approved these changes
on 2024-08-23
move some comments to docstring
43e08dde
vasqu
deleted the jamba-batched-gen-fix branch 2 years ago
Assignees
No one assigned
Login to write a write a comment.
Login via GitHub