feat(ci): add continuous batching to benchmarks #41916
McPatate
merged
15 commits into
main
from
feat/add_cb_to_bench_ci
feat(ci): add continuous batching to benchmarks
ed280fa5
refactor(ci): PR comments
a69f1a87
refactor(cb): when stopping, block by default
b7b10bb8
fix(benchmarks): `stream` -> `streaming`
d5fbaf3e
fix(benchmarks): invalid configuration when cb has attn_impl == sdpa
8b376134
tests(cb): fix attn impl
0848f9e7
fix(benchmarks): update `get_throughput` formula
de76311b
fix(benchmarks): prevent version conflicts and ensure proper cleanup …
bd7bbf8c
fix(benchmarks): raise the exception on failure instead of ignoring
1b1bdc6f
test(cb): comment out failing tests for now
8dd6063c
fix(benchmarks): revert `finally` removal but keep raising exception
5d3f62c4
test(cb): fix missing `require_read_token` import
24d01637
refactor(benchmarks): error if no benchmarks were run
23c9735c
refactor(benchmarks): change default lvls of cb bench config
df9d2a22
fix(ci): improper git sha checkout out
2d9ca276
Reviewers
Assignees
No one assigned
Labels
run-benchmark
Milestone
No milestone
Login to write a write a comment.
Login via GitHub