transformers
7805ec28
- [generate] Never use `cache_position` anymore in generation (#44816)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
161 days ago
[generate] Never use `cache_position` anymore in generation (#44816) * remove from generation * update tests * more tests * fix * doc * last changes * aqlm slipped through * add bc for remote code models * anton's review * add warning
References
#44816 - [generate] Never use `cache_position` anymore in generation
Author
Cyrilvallez
Parents
be8d8a4c
Loading