PR #2179 perf: vectorize KV cache prefix matching with numpy

perf: vectorize KV cache prefix matching with numpy #2179

nausicaalii wants to merge 2 commits into abetlen:main from nausicaalii:perf/vectorize-prefix-match

perf: vectorize prefix matching with numpy

d815bba0

refactor: deduplicate prefix matching and eliminate .tolist() overhead

aeb7d7cf

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Milestone

No milestone