vllm
[CI] GSM8K eval integration test for KV offloading
#46893
Merged

[CI] GSM8K eval integration test for KV offloading #46893

tlrmchlsmth merged 20 commits into main from worktree-gsm8k-offloading-test
tlrmchlsmth
tlrmchlsmth [Eval] Add GSM8K correctness test for SSM models with KV offloading
2cfdd033
tlrmchlsmth tlrmchlsmth requested a review from mgoin mgoin 29 days ago
tlrmchlsmth tlrmchlsmth requested a review from vadiklyutiy vadiklyutiy 29 days ago
tlrmchlsmth tlrmchlsmth requested a review from AndreasKaratzas AndreasKaratzas 29 days ago
claude
claude commented on 2026-06-27
tlrmchlsmth Add Gemma-4-E4B-it and DeepSeek-V4-Flash to offloading eval
3a7b454b
tlrmchlsmth Add Buildkite CI steps for KV offloading eval
3512a46c
tlrmchlsmth tlrmchlsmth requested a review from Harry-Chen Harry-Chen 29 days ago
tlrmchlsmth tlrmchlsmth requested a review from khluu khluu 29 days ago
mergify mergify added ci/build
tlrmchlsmth Apply ruff formatting
e8a20abe
tlrmchlsmth Use [tag] labels and short keys for offloading CI steps
b10906e9
tlrmchlsmth Classify offloading CI steps by size, not architecture
09168959
tlrmchlsmth Abstract connector type; test both OffloadingConnector and SimpleCPUO…
872edfc4
tlrmchlsmth tlrmchlsmth changed the title [Eval] Add GSM8K correctness test for SSM models with KV offloading [CI] GSM8K eval integration test for KV offloading 29 days ago
tlrmchlsmth tlrmchlsmth requested a review from orozery orozery 29 days ago
tlrmchlsmth tlrmchlsmth added ready
ZJY0516
ZJY0516 commented on 2026-06-27
AndreasKaratzas
AndreasKaratzas commented on 2026-06-28
tlrmchlsmth Add Qwen 3.5 coverage and fix CI labels
32a49608
tlrmchlsmth Add SimpleCPUOffloadConnector variant for DeepSeek-V4-Flash
e79afe8f
tlrmchlsmth Run GSM8K eval twice with prefix caching disabled
64c9d191
mergify
tlrmchlsmth Fix ruff format: collapse assert expression to single line
a9a689c8
orozery
orozery commented on 2026-07-02
tlrmchlsmth Make KV-offload eval CI steps non-optional
bfe9fe85
tlrmchlsmth
tlrmchlsmth
Etelis Fix KV offloading GSM8K eval: prefix caching, CPU reload verification…
0e958862
Etelis Simplify offload-completion barrier: poll prefix cache reset instead …
57976765
orozery orozery requested a review from njhill njhill 19 days ago
mergify mergify added frontend
orozery [Eval] Clarify offloading test docstring on reload verification
93db68f4
orozery Merge branch 'main' into worktree-gsm8k-offloading-test
17f39594
orozery
orozery approved these changes on 2026-07-07
tlrmchlsmth
tlrmchlsmth
tlrmchlsmth
tlrmchlsmth commented on 2026-07-07
tlrmchlsmth Return reset prefix cache status from Rust API
7c013039
tlrmchlsmth tlrmchlsmth requested a review from BugenZhao BugenZhao 18 days ago
mergify mergify added rust
mergify[bot] Merge branch 'main' into worktree-gsm8k-offloading-test
7defea54
tlrmchlsmth bump tolerance
a4201742
tlrmchlsmth Merge branch 'main' into worktree-gsm8k-offloading-test
7b51623f
tlrmchlsmth tlrmchlsmth merged dcdd756d into main 17 days ago
tlrmchlsmth tlrmchlsmth deleted the worktree-gsm8k-offloading-test branch 17 days ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone