PR #33129 [Phi-3] Bug on stale kv cache

[Phi-3] Bug on stale kv cache #33129

ArthurZucker merged 13 commits into huggingface:main from garg-amit:gargamit/fix_mini_long_seq

fix long seq bug

b0749fd1

garg-amit closed this 2 years ago

garg-amit changed the title ~~fix long seq bug~~ [Phi-3] Bug on stale kv cache 2 years ago

garg-amit reopened this 2 years ago

fixed format

a8820385

fixed fn copy inconsistency

6b422ab7

ArthurZucker commented on 2024-08-28

ArthurZucker commented on 2024-09-02

gante commented on 2024-09-02

fix long seq bug

7f317ed2

fixed format

03e410a6

fixed fn copy inconsistency

91bd5e22

Addressed comments

1eab9fe9

added a unit test

f476cddc

Merge branch 'huggingface:main' into gargamit/fix_mini_long_seq

a8c99f2b

Merge branch 'gargamit/fix_mini_long_seq' of https://github.com/garg-…

76272272

garg-amit requested a review from

gante 2 years ago

garg-amit requested a review from

ArthurZucker 2 years ago

gante approved these changes on 2024-09-05

gante commented on 2024-09-05

fixed cache position

13c685d3

Added a warning msg to the forward fn

2ac395fa

fixed test case

97f5d12e

garg-amit requested a review from

gante 2 years ago

ArthurZucker approved these changes on 2024-09-13

ArthurZucker merged dfd31158 into main 2 years ago

Reviewers

ArthurZucker

gante

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

transformers [Phi-3] Bug on stale kv cache #33129 Merged

[Phi-3] Bug on stale kv cache #33129

transformers
[Phi-3] Bug on stale kv cache
#33129

Merged