transformers
77b59dce - Fix on "cache position" for assisted generation (#30068)

Commit
1 year ago
Fix on "cache position" for assisted generation (#30068) * clean commit history I hope * get kv seq length correctly * PR suggestions * Update src/transformers/testing_utils.py Co-authored-by: Joao Gante <joaofranciscocardosogante@gmail.com> * add comment * give gpt bigcode it's own overriden method * remove code --------- Co-authored-by: Joao Gante <joaofranciscocardosogante@gmail.com>
Author
Parents
Loading