DeepSpeed
perf(rollout): select generation and prefill buckets with a tunable cost model
#8786
Merged

perf(rollout): select generation and prefill buckets with a tunable cost model #8786

SuperGoodGame
SuperGoodGame SuperGoodGame requested a review from tjruwase tjruwase 41 days ago
SuperGoodGame SuperGoodGame requested a review from tohtana tohtana 41 days ago
SuperGoodGame SuperGoodGame requested a review from loadams loadams 41 days ago
chatgpt-codex-connector
chatgpt-codex-connector
chatgpt-codex-connector commented on 2026-10-09
delock
delock delock requested a review from delock delock 40 days ago
SuperGoodGame
nathon-lee
SuperGoodGame
nathon-lee
chatgpt-codex-connector
chatgpt-codex-connector commented on 2026-10-10
SuperGoodGame
nathon-lee
SuperGoodGame
chatgpt-codex-connector
chatgpt-codex-connector commented on 2026-10-10
SuperGoodGame
chatgpt-codex-connector
chatgpt-codex-connector commented on 2026-10-10
chatgpt-codex-connector
chatgpt-codex-connector commented on 2026-10-10
delock
SuperGoodGame
SuperGoodGame
SuperGoodGame SuperGoodGame force pushed from a0588b7d to d9a2cc32 14 days ago
SuperGoodGame
delock
SuperGoodGame
delock
SuperGoodGame SuperGoodGame force pushed from 8a9641bb to dbf14796 9 days ago
SuperGoodGame
delock
tohtana tohtana added needs-gpu-test
delock
SuperGoodGame SuperGoodGame force pushed from dbf14796 to 3ad54c70 8 days ago
SuperGoodGame
chatgpt-codex-connector
chatgpt-codex-connector commented on 2026-11-11
delock
delock approved these changes on 2026-11-11
SuperGoodGame SuperGoodGame force pushed from 3ad54c70 to 7a45c196 7 days ago
SuperGoodGame
chatgpt-codex-connector
chatgpt-codex-connector commented on 2026-11-11
chatgpt-codex-connector
chatgpt-codex-connector commented on 2026-11-11
chatgpt-codex-connector
chatgpt-codex-connector commented on 2026-11-11
chatgpt-codex-connector
chatgpt-codex-connector commented on 2026-11-11
chatgpt-codex-connector
chatgpt-codex-connector commented on 2026-11-11
SuperGoodGame SuperGoodGame force pushed from 353d0148 to edfbf883 6 days ago
SuperGoodGame
chatgpt-codex-connector
chatgpt-codex-connector commented on 2026-11-13
delock
SuperGoodGame
chatgpt-codex-connector
delock
delock approved these changes on 2026-11-13
SuperGoodGame perf(rollout): select generation and prefill buckets with calibrated …
27eac0c8
SuperGoodGame feat(rollout): combine bucketed prefill with fixed-slot graph decode
9368450c
SuperGoodGame fix(rollout): accept aligned fronts with Auto graph decode
27ffac85
SuperGoodGame fix(rollout): reject sampling configs from custom generation preparers
3b04d7de
SuperGoodGame fix(rollout): reject any request setting changed by a generation prep…
e6c7f14b
SuperGoodGame fix(rollout): count mask lengths exactly and reject replaced preparer…
50aaca43
SuperGoodGame fix(rollout): reject in-place mask edits by custom generation preparers
2d71f2ce
SuperGoodGame test(rollout): check route-planning profile time with a frozen clock
b4ea3624
SuperGoodGame test(rollout): inject planning delay through the model preparer
8bb25e5a
SuperGoodGame fix(rollout): match Transformers generation defaults and padding sema…
b40cac42
SuperGoodGame fix(rollout): prepare batched configs from their original settings
3e651b9c
SuperGoodGame SuperGoodGame force pushed from 810fb39c to 3e651b9c 6 days ago
SuperGoodGame
chatgpt-codex-connector
chatgpt-codex-connector commented on 2026-11-13
delock
tohtana tohtana removed needs-gpu-test
delock
SuperGoodGame Merge origin/master into feature/adaptive-cb-prefill
0b71e5c6
SuperGoodGame
SuperGoodGame Merge origin/master into feature/adaptive-cb-prefill
9f7c14b5
delock delock enabled auto-merge 3 days ago
delock delock merged a7f1e4d0 into master 3 days ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone