transformers
d521ba57 - Quantized KV cache: update quanto (#31052)

Commit

1 year ago

Quantized KV cache: update quanto (#31052) * quanto latest version was refactored * add error msg * incorrect compare sign * Update src/transformers/cache_utils.py Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com> --------- Co-authored-by: amyeroberts <22614925+amyeroberts@users.noreply.github.com>

References

#29969 - [SigLIP] Add fast tokenizer

#31052 - Quantized KV cache: update quanto

#32831 - [Docs] Update resources

#33111 - [Backbone] Remove out_features everywhere

#33174 - [Zero-shot image classification pipeline] Remove tokenizer_kwargs

#39821 - Support MetaCLIP 2

#59 - Fix attention mask handling in EoMT-DINOv3 converter

#62 - Add initial DEIMv2 model implementation

#65 - Fix RTDetrV2 sine position embedding ordering

Author

zucchini-nlp

Parents

a564d10a

transformers d521ba57 - Quantized KV cache: update quanto (#31052)

transformers
d521ba57 - Quantized KV cache: update quanto (#31052)