vllm-project/vllm

Pull Requests Commits

[Misc] reuse num_tokens_across_dp of get_dp_padding to avoid unnecessary dp all reduce in set_forward_context (#18935)

izhuhaoran committed 195 days ago

Verified d6fd3a33

[doc] wrong output (#19000)

reidliu41 committed 195 days ago

Verified 432ec992

[BugFix] Fix incorrect metrics shutdown error log message (#18992)

njhill committed 195 days ago

Verified 2b102d51

[BugFix] fix data parallel construct ipv6 url addres (#18991)

lengrongfu committed 195 days ago

Verified aa54a7bf

Let max_num_batched_tokens use human_readable_int for large numbers (#18968)

mgoin committed 195 days ago

Verified 2ad6194a

[doc] small fix - mkdocs (#18996)

reidliu41 committed 195 days ago

Verified c594cbf5

[LoRA] Support dynamically initialize `packed_modules_mapping` for VLM with arbitrary components (#18987)

Isotr0py committed 195 days ago

Verified a35ca765

[Core] Rework dtype resolution (#18751)

DarkLight1337 committed 195 days ago

Verified 6aa8f9a4

[Bugfix] Fix EAGLE3 broken logits (#18909)

benchislett committed 195 days ago

Verified 1bc86a3d

[Misc][Benchmark] Add support for CustomDataset (#18511)

ekagra-ranjan committed 196 days ago

Verified bbfa0c61

[Misc] add return token strs for tokenize (#18941)

reidliu41 committed 196 days ago

Verified 20079c6e

[BugFix] Fix multi-node offline data-parallel (#18981)

njhill committed 196 days ago

Verified 9a1b9b99

[P/D] NixlConnector use cache device index for memory registration (#18969)

ptarasiewiczNV committed 196 days ago

Verified 8bf507d7

[ROCm][Kernel] Add gfx950 support for skinny gemms (#18010)

charlifu committed 196 days ago

Verified 306d6040

[Bugfix] Fix for issue 17396 (#18773)

frreiss committed 196 days ago

Verified f2c3f66d

[FEAT][ROCm] Add AITER grouped topk for DeepSeekV2 (#18825)

vllmellm committed 196 days ago

Verified 0f5e0d56

[BugFix] Pydantic part 2 (#18911)

ProExpertProg committed 196 days ago

Verified c55d8046

[doc] fix the list rendering issue - security.md (#18982)

reidliu41 committed 196 days ago

Verified 749f5bdd

[Neuron] Add Multi-Modal model support for Neuron (#18921)

aws-satyajith committed 196 days ago

Verified 2a50ef57

fix security issue of logging llm output (#18980)

luccafong committed 196 days ago

Verified b8b90479

[Bugfix]: Fix the incompatibility issue with Structured Outputs when Thinking is disabled (#18879)

chaunceyjiang committed 196 days ago

Verified ba5111f2

[Misc] Fix estimated max model len msg (#18966)

sarckk committed 196 days ago

Verified 1e123529

[Frontend] Add rerank support to run_batch endpoint (#16278)

pooyadavoodi committed 196 days ago

Verified dff80b0e

create util function for batched arange (#18937)

yuguo68 committed 196 days ago

Verified 7782464a

[Docs] Correct multiprocessing design doc (#18964)

lgeiger committed 196 days ago

Verified 0f71e240

Tool parser regex timeout handling (#18960)

wseaton committed 197 days ago

Verified 1dab4d57

[Misc] add group_size is -1 in awq quantization (#18910)

lengrongfu committed 197 days ago

Verified 7f21e805

[VLM] Add PP support and fix GPTQ inference for Ovis models (#18958)

Isotr0py committed 197 days ago

Verified 5a864163

Benchmark script for fp8 vs bf16 gemm (#17126)

mgoin committed 197 days ago

Verified f49239cb

[Perf] API-server scaleout with many-to-many server-engine comms (#17546)

njhill committed 197 days ago

Verified 2dbe8c07

Newer Older