vllm
3512a46c - Add Buildkite CI steps for KV offloading eval

Commit
32 days ago
Add Buildkite CI steps for KV offloading eval Three steps sized to the models they run: - Nemotron-H-8B: 1xH200 (35 GiB slice), 30 min - Gemma-4-E4B-it: 1xH200 (35 GiB slice), 30 min - DeepSeek-V4-Flash: 2xH100 (80 GiB each), 60 min Triggered by changes to the offloading connector or the test itself. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com> Signed-off-by: Tyler Michael Smith <tyler@tylermsmith.com> Signed-off-by: Tyler Michael Smith <tlrmchlsmth@gmail.com>
Author
Parents
Loading