transformers
61d89c19 - Fix: Mamba2 generation mismatch between input_ids and inputs_embeds (#32694)

Commit
1 year ago
Fix: Mamba2 generation mismatch between input_ids and inputs_embeds (#32694) * fix cache when using input embeddings * simplify check, we can always add input ids seq len since its 0 in first pass
Author
Parents
Loading