vllm
[V1][Spec Decode] Eagle Model loading
#16035
Merged
Overview
Commits
20
Changes
View On GitHub

[V1][Spec Decode] Eagle Model loading #16035

WoosukKwon merged 20 commits into vllm-project:main from LiuXiaoxuanPKU:eagle-weight
LiuXiaoxuanPKU
LiuXiaoxuanPKU register model
19b8b73a
LiuXiaoxuanPKU fix config and init
b566516f
LiuXiaoxuanPKU torch compile
bc1b7d07
LiuXiaoxuanPKU remove lambda, add prefix
e5ad7482
LiuXiaoxuanPKU runnable v1
41e4d03c
LiuXiaoxuanPKU change the way of getting vllm_config, cleanup
10b107d2
LiuXiaoxuanPKU minor
59ee4503
LiuXiaoxuanPKU LiuXiaoxuanPKU requested a review from WoosukKwon WoosukKwon 1 year ago
LiuXiaoxuanPKU LiuXiaoxuanPKU requested a review from robertgshaw2-redhat robertgshaw2-redhat 1 year ago
LiuXiaoxuanPKU LiuXiaoxuanPKU requested a review from njhill njhill 1 year ago
LiuXiaoxuanPKU LiuXiaoxuanPKU requested a review from ywang96 ywang96 1 year ago
LiuXiaoxuanPKU LiuXiaoxuanPKU requested a review from comaniac comaniac 1 year ago
LiuXiaoxuanPKU LiuXiaoxuanPKU requested a review from alexm-redhat alexm-redhat 1 year ago
github-actions
mergify mergify added documentation
mergify mergify added v1
markmc
markmc
markmc commented on 2025-04-04
ekagra-ranjan
ekagra-ranjan commented on 2025-04-04
ekagra-ranjan
ekagra-ranjan commented on 2025-04-04
LiuXiaoxuanPKU fix weights loading
2ce60846
LiuXiaoxuanPKU fix layernorm and fix cudagraph
b0388cff
LiuXiaoxuanPKU
ekagra-ranjan
LiuXiaoxuanPKU
LiuXiaoxuanPKU example
a6f46cfa
ekagra-ranjan
luyuzhe111
mergify
mergify mergify added needs-rebase
v-lmn
LiuXiaoxuanPKU revert example and test
5bb90c42
LiuXiaoxuanPKU Merge branch 'main' into eagle-weight
be3a01b9
LiuXiaoxuanPKU merge
ba1671ec
mergify mergify removed needs-rebase
luyuzhe111
ekagra-ranjan
WoosukKwon
WoosukKwon commented on 2025-04-08
WoosukKwon
WoosukKwon commented on 2025-04-08
WoosukKwon
WoosukKwon commented on 2025-04-08
WoosukKwon
WoosukKwon commented on 2025-04-08
luyuzhe111
LiuXiaoxuanPKU fix comments
560eaee6
WoosukKwon
WoosukKwon commented on 2025-04-09
LiuXiaoxuanPKU add tests
32bbd984
LiuXiaoxuanPKU LiuXiaoxuanPKU added ready
LiuXiaoxuanPKU less strict
302b591a
LiuXiaoxuanPKU fix registry test
bcf23889
LiuXiaoxuanPKU LiuXiaoxuanPKU requested a review from DarkLight1337 DarkLight1337 1 year ago
LiuXiaoxuanPKU minor
29e76372
ekagra-ranjan
WoosukKwon
luyuzhe111
LiuXiaoxuanPKU force tokenizer
d511a0e2
ekagra-ranjan
luyuzhe111
luyuzhe111
LiuXiaoxuanPKU Merge branch 'main' into eagle-weight
1eb4fb9f
wwl2755
ekagra-ranjan
WoosukKwon
WoosukKwon approved these changes on 2025-04-10
WoosukKwon WoosukKwon merged e8224f3d into main 1 year ago
luyuzhe111
ekagra-ranjan

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
documentation ready v1
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum