transformers
dfd31158 - [Phi-3] Bug on stale kv cache (#33129)

Commit
1 year ago
[Phi-3] Bug on stale kv cache (#33129) * fix long seq bug * fixed format * fixed fn copy inconsistency * fix long seq bug * fixed format * fixed fn copy inconsistency * Addressed comments * added a unit test * fixed cache position * Added a warning msg to the forward fn * fixed test case
Author
Parents
Loading