vllm
[EPLB] Mask padding in EPLB load recording
#38128
Merged
Overview
Commits
18
Changes
View On GitHub

[EPLB] Mask padding in EPLB load recording #38128

vllm-bot merged 18 commits into vllm-project:main from neuralmagic:imarkov/eplb-mask-padded-tokens
ilmarkov
ilmarkov Update fwd ctx and eplb record
b14b65c1
mergify mergify added speculative-decoding
mergify mergify added v1
gemini-code-assist
gemini-code-assist commented on 2026-03-25
ilmarkov Prettify
f6929d23
ilmarkov Upd for DBO
d46d2015
mergify
mergify mergify added needs-rebase
ilmarkov Merge branch 'main' into imarkov/eplb-mask-padded-tokens
03919875
ilmarkov Move to tensor
9b434b0a
mergify mergify removed needs-rebase
ilmarkov Update forward_ctx
28466767
ilmarkov Upd dummy_run
1483255b
mergify mergify added nvidia
ilmarkov ilmarkov marked this pull request as ready for review 96 days ago
ilmarkov ilmarkov requested a review from mgoin mgoin 96 days ago
ilmarkov ilmarkov requested a review from tlrmchlsmth tlrmchlsmth 96 days ago
ilmarkov ilmarkov requested a review from WoosukKwon WoosukKwon 96 days ago
ilmarkov ilmarkov requested a review from yewentao256 yewentao256 96 days ago
ilmarkov ilmarkov requested a review from njhill njhill 96 days ago
ilmarkov ilmarkov requested a review from benchislett benchislett 96 days ago
ilmarkov ilmarkov requested a review from luccafong luccafong 96 days ago
ilmarkov ilmarkov requested a review from MatthewBonanni MatthewBonanni 96 days ago
ilmarkov ilmarkov requested a review from pavanimajety pavanimajety 96 days ago
ilmarkov Fix for full cudagraph
9a60d0b2
ilmarkov
Merge branch 'main' into imarkov/eplb-mask-padded-tokens
60a77ec4
mergify
mergify mergify added needs-rebase
Merge branch 'main' into imarkov/eplb-mask-padded-tokens
0b3e28cf
Move tensors to EplbModelState
b79f06e9
mergify
Cleanup
6182d8ce
mergify mergify removed needs-rebase
mergify
mergify mergify added needs-rebase
SageMoore
SageMoore commented on 2026-06-01
Merge branch 'main' into imarkov/eplb-mask-padded-tokens
fb6ddc4e
ilmarkov ilmarkov requested a review from zyongye zyongye 14 days ago
ilmarkov ilmarkov requested a review from AndreasKaratzas AndreasKaratzas 14 days ago
Address comment
a01bcd65
mergify mergify removed needs-rebase
tlrmchlsmth
tlrmchlsmth commented on 2026-06-25
tlrmchlsmth
tlrmchlsmth commented on 2026-06-25
tlrmchlsmth
Address comments
40d0aeee
ilmarkov ilmarkov requested a review from hmellor hmellor 10 days ago
mergify
mergify mergify added needs-rebase
Merge branch 'main' into imarkov/eplb-mask-padded-tokens
5495c5ba
mergify mergify removed needs-rebase
tlrmchlsmth tlrmchlsmth added ready
Fix tests
4548cd4e
tlrmchlsmth
tlrmchlsmth approved these changes on 2026-06-26
ilmarkov Merge branch 'main' into imarkov/eplb-mask-padded-tokens
403cfba9
vllm-bot vllm-bot merged a2abce64 into main 7 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
speculative-decoding ready v1 nvidia
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum