vllm-project/vllm

Pull Requests Commits
trt fix
WoosukKwon committed 7 days ago
1139a313
unwrap moe more
WoosukKwon committed 7 days ago
5066b190
unwrap moe
WoosukKwon committed 7 days ago
4fc9a061
fuse parallel linears
WoosukKwon committed 7 days ago
f9bf662e
remove torch compile decorator
WoosukKwon committed 8 days ago
14e2241f
dummy loader hack
WoosukKwon committed 8 days ago
cdd23258
registry
WoosukKwon committed 8 days ago
cec6774e
fuse & parallelize linears
WoosukKwon committed 8 days ago
355be167
fuse moe scale_and_add
WoosukKwon committed 8 days ago
d67e21b2
fuse concat + fp8
WoosukKwon committed 8 days ago
6a2c13a6
fuse mla cache
WoosukKwon committed 8 days ago
b443e670
Fuse indexer k cache update
WoosukKwon committed 9 days ago
34d73a33
indexer_k_quant_triton
WoosukKwon committed 9 days ago
9d7beab9
topk init
WoosukKwon committed 9 days ago
f2ecfa9c
minor
WoosukKwon committed 9 days ago
e4cdaf19
inline indexer
WoosukKwon committed 9 days ago
2b729356
all reduce + residual + rms norm
WoosukKwon committed 9 days ago
1903df83
fix
WoosukKwon committed 9 days ago
d872b0a0
remove attn
WoosukKwon committed 9 days ago
84deceff
fuse quant & indexer weight update
WoosukKwon committed 9 days ago
e269b614
adjust fused_q grid
WoosukKwon committed 9 days ago
24090c52
fused op 1
WoosukKwon committed 9 days ago
063fd29c
indexer rope
WoosukKwon committed 9 days ago
156e12ba
rope
WoosukKwon committed 9 days ago
3e5c06dd
layernorm
WoosukKwon committed 10 days ago
cc08dad7
wip
WoosukKwon committed 10 days ago
976293e3
wip
WoosukKwon committed 10 days ago
6efd9195
Merge branch 'main' into woosuk/ds-exp
WoosukKwon committed 12 days ago
2145abaa
[Model Runner V2] Rebuild attention metadata before eagle decode full… (#38311)
TheEpicDolphin committed 12 days ago
Verified 384e4d5f
[CI] Skip failing test (#38369)
NickLucche committed 12 days ago
Verified 44a65280
Terms Of Use Privacy Policy Refund Policy Impressum