vllm-project/vllm

Pull Requests Commits

[Core] Don't force uppercase for VLLM_LOGGING_LEVEL (#15306)

russellb committed 102 days ago

Verified 8abe69b4

[Core] Integrate `fastsafetensors` loader for loading model weights (#10647)

manish-sethi committed 102 days ago

Verified 761702fd

[distributed] fix dp group (#15355)

youkaichao committed 102 days ago

Verified 9606d572

[Bugfix] Fix chat template loading (#15143)

DarkLight1337 committed 102 days ago

Verified cbcdf2c6

Fix zmq IPv6 URL format error (#15341)

russellb committed 102 days ago

Verified 038de04d

[Kernel] allow non-contiguous input for marlin kernel (#14658)

jinzhen-lin committed 102 days ago

Verified 6b3cc75b

Revert "[CI/Build] Use uv python for docker rather than ppa:deadsnakess/ppa (#13569)" (#15377)

simon-mo committed 102 days ago

Verified 7ffcccfa

[Misc] Update guided decoding logs to debug (#15310)

sfbemerk committed 102 days ago

Verified cc8accfd

[Bugfix][V1] Avoid importing PreTrainedModel (#15366)

HollowMan6 committed 102 days ago

Verified 948ab03e

[Misc] Remove ignore_reinit_error for ray.init() (#15373)

ruisearch42 committed 102 days ago

Verified 5797fb97

[Misc] Upgrade BNB version (#15183)

jeejeelee committed 102 days ago

Verified 3892e58a

Fix non-contiguous input passed to Marlin kernel (#15319)

Qubitium committed 103 days ago

Verified d20e2611

[Fix] [torch.compile] Improve UUID system for custom passes (#15249)

ProExpertProg committed 103 days ago

Verified f622dbcf

[V1] Enable V1 Fp8 cache for FA3 in the oracle (#15191)

LucasWilkinson committed 103 days ago

Verified dccf535f

[Misc][Doc] Add note regarding loading `generation_config` by default (#15281)

ywang96 committed 103 days ago

Verified 9c5c81b0

[Frontend] Support tool calling and reasoning parser (#14511)

WangErXiao committed 103 days ago

Verified d6cd59f1

[V1][Spec Decode] Use better defaults for N-gram (#15358)

WoosukKwon committed 103 days ago

Verified bc8ed3c4

[V1][Spec Decode] Respect prompt_lookup_max (#15348)

WoosukKwon committed 103 days ago

Verified b9bd76ca

[Bugfix] consider related env vars for torch.compiled cache hash (#14953)

DefTruth committed 103 days ago

Verified 6ebaf9ac

[Misc] Add tuned R1 w8a8 and MoE configs for NVIDIA L20 (#15322)

DefTruth committed 103 days ago

Verified f90d34b4

[ci/build] fix broken tests in LLM.collective_rpc (#15350)

youkaichao committed 103 days ago

Verified f68cce8e

[ci/build] update torch nightly version for GH200 (#15135)

youkaichao committed 103 days ago

Verified 09b6a955

[V1][Usage] Refactor speculative decoding configuration and tests (#14434)

ShangmingCai committed 103 days ago

Verified 50c9636d

Fix v1 supported oracle for worker-cls and worker-extension-cls (#15324)

hijkzzz committed 104 days ago

Verified 0661cfef

[doc] Add back previous news (#15331)

heheda12345 committed 104 days ago

Verified a827aa81

Remove openvino support in favor of external plugin (#15339)

russellb committed 104 days ago

Verified b877031d

[BugFix][Typing] Fix Imprecise Type Annotations (#15208)

WrRan committed 104 days ago

Verified dd861b99

[V1] Add `disable-any-whitespace` option support for xgrammar (#15316)

russellb committed 104 days ago

Verified eb63ea1e

[Model] Support Tele-FLM Model (#15023)

atone committed 104 days ago

Verified 2f4bd358

[Bugfix] LoRA V0 - Fix case where `max_num_seqs` is between cudagraph capture sizes (#15308)

varun-sundar-rabindranath committed 104 days ago

Verified 8a8b30ea

Newer Older