peft
03798a91 - FIX Failing Llama tests due to new kv cache (#1832)

Commit
1 year ago
FIX Failing Llama tests due to new kv cache (#1832) The issue is that past_key_values can now be an instance of DynamicCache. Therefore, just indexing into it won't work anymore. The solution is to check the type and if it's not a tuple/list, use the methods on the cache object instead.
Parents
Loading