feat(rollout): align decode fronts and trim dead zones #8497
nathon-lee
force pushed
from
4c768545
to
095c8838
67 days ago
delock
commented
on 2026-09-14
delock
commented
on 2026-09-14
nathon-lee
force pushed
from
2519d70b
to
9ddbdac3
61 days ago
feat(rollout): align decode fronts and trim dead zones
c527d26f
fix(rollout): simplify continuous batch admission
fd52dfd7
fix: fix some format err by yapf
55d7edd0
fix(rollout): preserve greedy generation semantics in continuous batc…
7e26f35e
fix(rollout): preserve continuous profiling after rebase
440bc14d
nathon-lee
force pushed
from
9ddbdac3
to
440bc14d
61 days ago
docs(rollout): clarify decode front alignment semantics
24e96bf1
nathon-lee
marked this pull request as draft 58 days ago
fix(rollout): make cache trimming opt-in Add configurable cache capac…
9eb84bba
nathon-lee
marked this pull request as ready for review 57 days ago
nathon-lee
marked this pull request as draft 57 days ago
fix(rollout): handle unset repetition penalty
4a314db4
fix(rollout): reclaim dead cache prefixes at capacity
8bd28019
nathon-lee
force pushed
from
faf4eb06
to
8bd28019
55 days ago
nathon-lee
marked this pull request as ready for review 55 days ago
Merge branch 'master' into feat/cb-decode-align-trim
bcda012e
delock
approved these changes
on 2026-09-28
nathon-lee
force pushed
from
248bf899
to
bcda012e
48 days ago
Merge upstream/master into PR-8497 and resolve inference docs conflict
8fdb53e6
test: add StaticCache per_layer_config compatibility to rollout Cache…
c3954e25
delock
enabled auto-merge 47 days ago
delock
merged
a77aeb67
into master 47 days ago
Assignees
No one assigned
Login to write a write a comment.
Login via GitHub