Fix: Jamba batched generation (#32914)

Commit

1 year ago

Fix: Jamba batched generation (#32914) * init fix * fix mask during cached forward, move mask related stuff to own function * adjust tests as left padding does not change logits as much anymore + batch gen (with todo on logits comp) * revert overwriting new integration tests * move some comments to docstring

References

#29969 - [SigLIP] Add fast tokenizer

#32914 - Fix: Jamba batched generation

#33174 - [Zero-shot image classification pipeline] Remove tokenizer_kwargs

#39821 - Support MetaCLIP 2

#58 - Add EoMT DINOv3 model

#59 - Fix attention mask handling in EoMT-DINOv3 converter

#41212 - Add EoMT with DINOv3 backbone

#62 - Add initial DEIMv2 model implementation

Author

vasqu

Parents

386931d9

transformers 3bfd3e48 - Fix: Jamba batched generation (#32914)

transformers
3bfd3e48 - Fix: Jamba batched generation (#32914)