PR #14081 kv-cache : fix shift and defrag logic

kv-cache : fix shift and defrag logic #14081

ggerganov merged 3 commits into master from gg/kv-fix-shift

kv-cache : fix shift

eee8d481

cont : reset shift[i]

d564e04c

cont : fix defrag erasing cells that didn't move

c257a887

ggerganov changed the title ~~kv-cache : fix shift~~ kv-cache : fix shift and defrag logic 1 year ago

ggerganov marked this pull request as ready for review 1 year ago

ggerganov merged 40cbf571 into master 1 year ago

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Milestone

No milestone