PR #16035 [V1][Spec Decode] Eagle Model loading - SemanticDiff

Commits

register model

LiuXiaoxuanPKU committed 1 year ago
fix config and init

LiuXiaoxuanPKU committed 1 year ago
torch compile

LiuXiaoxuanPKU committed 1 year ago
remove lambda, add prefix

LiuXiaoxuanPKU committed 1 year ago
runnable v1

LiuXiaoxuanPKU committed 1 year ago
change the way of getting vllm_config, cleanup

LiuXiaoxuanPKU committed 1 year ago
minor

LiuXiaoxuanPKU committed 1 year ago
fix weights loading

LiuXiaoxuanPKU committed 1 year ago
fix layernorm and fix cudagraph

LiuXiaoxuanPKU committed 1 year ago
example

LiuXiaoxuanPKU committed 1 year ago
revert example and test

LiuXiaoxuanPKU committed 1 year ago
Merge branch 'main' into eagle-weight

LiuXiaoxuanPKU committed 1 year ago
merge

LiuXiaoxuanPKU committed 1 year ago
fix comments

LiuXiaoxuanPKU committed 1 year ago
add tests

LiuXiaoxuanPKU committed 1 year ago
less strict

LiuXiaoxuanPKU committed 1 year ago
fix registry test

LiuXiaoxuanPKU committed 1 year ago
minor

LiuXiaoxuanPKU committed 1 year ago
force tokenizer

LiuXiaoxuanPKU committed 1 year ago
Merge branch 'main' into eagle-weight

LiuXiaoxuanPKU committed 1 year ago

Loading