PR #14081 kv-cache : fix shift and defrag logic

kv-cache : fix shift and defrag logic #14081

ggerganov merged 3 commits into master from gg/kv-fix-shift

kv-cache : fix shift

eee8d481

cont : reset shift[i]

d564e04c

cont : fix defrag erasing cells that didn't move

c257a887

ggerganov changed the title ~~kv-cache : fix shift~~ kv-cache : fix shift and defrag logic 150 days ago

ggerganov marked this pull request as ready for review 150 days ago

ggerganov merged 40cbf571 into master 150 days ago

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Milestone

No milestone