vllm-project/vllm

Pull Requests Commits

[Misc] improve gguf check (#15974)

reidliu41 committed 326 days ago

Verified 86cbd2ee

[ROCm] Tweak the benchmark script to run on ROCm (#14252)

huydhn committed 326 days ago

Verified 092475f7

[Bugfix] Fix function names in test_block_fp8.py (#16033)

bnellnm committed 326 days ago

Verified dcc56d62

[TPU] Switch Test to Non-Sliding Window (#15981)

robertgshaw2-redhat committed 326 days ago

Verified f15e70d9

[TPU] Support sliding window and logit soft capping in the paged attention kernel for TPU. (#15732)

vanbasten23 committed 326 days ago

Verified b6be6f8d

Re-enable the AMD Testing for the passing tests. (#15586)

Alexei-V-Ivanov-AMD committed 326 days ago

Verified 03a70eac

[Misc][Performance] Advance tpu.txt to the most recent nightly torch … (#16024)

yarongmu-google committed 326 days ago

Verified 45b1ff7a

[Minor] Fused experts refactor (#15914)

bnellnm committed 326 days ago

Verified 15ba07ef

[Neuron][kernel] Fuse kv cache into a single tensor (#15911)

liangfu committed 326 days ago

Verified d2b58ca2

[SupportsQuant] Chameleon, Chatglm, Commandr (#15952)

kylesayrs committed 327 days ago

Verified 82e7e19a

[SupportsQuant] Bert, Blip, Blip2, Bloom (#15573)

kylesayrs committed 327 days ago

Verified 421c4629

fix: tiny fix make format.sh excutable (#16015)

yihong0618 committed 327 days ago

Verified 84884cd9

[doc] update contribution link (#15922)

reidliu41 committed 327 days ago

Verified a43aa183

[Bugfix][V1] Fix bug from putting llm_engine.model_executor in a background process (#15367)

wwl2755 committed 327 days ago

Verified 463bbb18

[misc] improve error message for "Failed to infer device type" (#15994)

youkaichao committed 327 days ago

Verified 5e125e74

[Benchmark] Add AIMO Dataset to Benchmark (#15955)

StevenShi-23 committed 327 days ago

Verified 06f21ce7

[ROCM][V0] PA kennel selection when no sliding window provided (#15982)

maleksan85 committed 327 days ago

Verified 57a810db

[bugfix] add seed in torchrun_example.py (#15980)

youkaichao committed 327 days ago

Verified 8b664706

fix: better error message for get_config close #13889 (#15943)

yihong0618 committed 327 days ago

Verified 37bfee92

[ROCM][KERNEL] Paged attention for V1 (#15720)

maleksan85 committed 327 days ago

Verified e73ff24e

[V1][TPU] Do not compile sampling more than needed (#15883)

NickLucche committed 327 days ago

Verified bd7599d3

[TPU] optimize the all-reduce performance (#15903)

yaochengji committed 327 days ago

Verified 01b61136

[V1][TPU] TPU-optimized top-p implementation (avoids scattering). (#15736)

hyeygit committed 327 days ago

Verified 1b84eff0

Fix `huggingface-cli[hf-xet]` -> `huggingface-cli[hf_xet]` (#15969)

hmellor committed 327 days ago

Verified 55acf86b

[V1] Support Mistral3 in V1 (#15950)

mgoin committed 327 days ago

Verified f021b979

[misc] instruct pytorch to use nvml-based cuda check (#15951)

youkaichao committed 327 days ago

Verified 1cab43c2

Restricted cmake to be less than version 4 as 4.x breaks the build of… (#15859)

npanpaliya committed 327 days ago

Verified 8bd651b3

[Misc] V1 LoRA support CPU offload (#15843)

jeejeelee committed 328 days ago

Verified 58e234a7

[Model] use AutoWeightsLoader in model load_weights (#15770)

lengrongfu committed 328 days ago

Verified e86c414d

[CPU][Bugfix] Using custom allreduce for CPU backend (#15934)

bigPYJ1151 committed 328 days ago

Verified 550b2801

Newer Older