PR #18842 kv-cache : optimize KQ mask construction

kv-cache : optimize KQ mask construction #18842

ggerganov merged 3 commits into master from gg/kv-mask-opt

kv-cache : optimize KQ mask construction

6628f518

cont : add explanation + improve

bac56aef

ggerganov force pushed from edd29726 to bac56aef 3 days ago

cont : fix

490f6f70

ggerganov marked this pull request as ready for review 3 days ago

ggerganov merged 2fbde785 into master 2 days ago

ggerganov deleted the gg/kv-mask-opt branch 2 days ago

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Milestone

No milestone