vllm-project/vllm

Pull Requests Commits

[Model] fix model testing for TeleChat2ForCausalLM and V0 llama4 (#16112)

luccafong committed 323 days ago

Verified 620fc2d0

[Model] use AutoWeightsLoader for phi, gemma, deepseek (#16088)

jonghyunchoe committed 323 days ago

Verified 29283eaa

[Bugfix] fix use_atomic_add support of marlin kernel when using v1 engine (#15946)

jinzhen-lin committed 323 days ago

Verified 2fa66ef7

[Misc] Remove redundant code (#16098)

chaunceyjiang committed 323 days ago

Verified 13affc43

[Misc] format output for encoder_decoder.py (#16095)

reidliu41 committed 323 days ago

Verified d8f094a9

Fix some capitalisations in generated examples doc titles (#16094)

hmellor committed 324 days ago

Verified 97ae6d77

Revert "doc: add info for macos clang errors (#16049)" (#16091)

yihong0618 committed 324 days ago

Verified 6baeee70

[doc] fix 404 (#16082)

reidliu41 committed 324 days ago

Verified d2517a49

fix: support clang17 for macos and fix the real libomp (#16086)

yihong0618 committed 324 days ago

Verified 6342adc4

[CI] Fix benchmark script level (#16089)

khluu committed 324 days ago

Verified 0adba915

[Misc] Auto detect bitsandbytes pre-quantized models (#16027)

tristanleclercq committed 324 days ago

Verified 4285e423

[V1][Spec Decode] Update N-gram Proposer Interface (#15750)

WoosukKwon committed 324 days ago

Verified 63375f0c

[Bugfix][TPU] Fix V1 TPU worker for sliding window (#16059)

mgoin committed 324 days ago

Verified 70ad3f9e

[Kernel][Minor] Re-fuse triton moe weight application (#16071)

bnellnm committed 324 days ago

Verified d6fc629f

Revert "[V1] Scatter and gather placeholders in the model runner" (#16075)

ywang96 committed 324 days ago

Verified af51d80f

[V1] Scatter and gather placeholders in the model runner (#15712)

DarkLight1337 committed 324 days ago

Verified f5722a50

[V1] DP scale-out (1/N): Use zmq ROUTER/DEALER sockets for input queue (#15906)

njhill committed 325 days ago

Verified 651cf0fe

[CI] Reorganize .buildkite directory (#16001)

khluu committed 325 days ago

Verified 4dc52e1c

[Bugfix] Fix default behavior/fallback for pp in v1 (#16057)

mgoin committed 325 days ago

Verified 4708f13a

[ROCm][Bugfix] Bring back fallback to eager mode removed in #14917, but for ROCm only (#15413)

gshtras committed 325 days ago

Verified a6d042df

[ROCm][Bugfix] Use platform specific FP8 dtype (#15717)

gshtras committed 325 days ago

Verified 40a36ccf

[Distributed] [ROCM] Fix custom allreduce enable checks (#16010)

ilmarkov committed 325 days ago

Verified ef608c37

[CPU] Change default block_size for CPU backend (#16002)

bigPYJ1151 committed 325 days ago

Verified 2386803f

[Benchmark][Doc] Update throughput benchmark and README (#15998)

StevenShi-23 committed 325 days ago

Verified 95862f7b

[Bugfix][kernels] Fix half2float conversion in gguf kernels (#15995)

Isotr0py committed 325 days ago

Verified 230b131b

[Hardware][Gaudi][BugFix] fix arguments of hpu fused moe (#15945)

zhenwei-intel committed 325 days ago

Verified 0812d8dd

[Model] use AutoWeightsLoader for baichuan, gpt-neox, mpt (#15939)

jonghyunchoe committed 325 days ago

Verified bf7e3c51

[V1][Spec Decode] Avoid logging useless nan metrics (#16023)

markmc committed 325 days ago

Verified a35a8a83

doc: add info for macos clang errors (#16049)

yihong0618 committed 325 days ago

Verified 4ef0bb1f

[TPU][V1] Remove ragged attention kernel parameter hard coding (#16041)

yaochengji committed 325 days ago

Verified fadc59c0

Newer Older