vllm-project/vllm

Pull Requests Commits

tlrmchlsmth committed 1 year ago

37cf1f27

tlrmchlsmth committed 1 year ago

45ea3c31

tlrmchlsmth committed 1 year ago

df866cfe

tlrmchlsmth committed 1 year ago

29596317

tlrmchlsmth committed 1 year ago

7b86860f

tlrmchlsmth committed 1 year ago

f386a9e5

[doc] update doc format (#20673)

reidliu41 committed 1 year ago

Verified efe73d05

[Docs] Improve docs for RLHF co-location example (#20599)

crypdick committed 1 year ago

Verified 853487bc

[Benchmark] Parameterization of streaming loading of multimodal datasets (#20528)

Potabk committed 1 year ago

Verified 9ff2af6d

[Doc] Update notes (#20668)

DarkLight1337 committed 1 year ago

Verified 70ca5484

[V1] [Doc] Update V1 docs for Mamba models (#20499)

tdoublep committed 1 year ago

Verified 5358cce5

[Bugfix] Fix the issue where `reasoning_content` is `None` when Thinkng is enabled and `tool_choice` is set to `'required'`. (#20662)

chaunceyjiang committed 1 year ago

Verified 2155e95e

[Docs] fix minimax tool_calling docs error (#20667)

qscqesze committed 1 year ago

Verified f95570a5

[Intel GPU] support ray as distributed executor backend for XPU. (#20659)

jikunshang committed 1 year ago

Verified b6e7e3d5

[XPU] Use spawn with XPU multiprocessing (#20649)

dvrogozh committed 1 year ago

Verified e760fcef

[Misc] Fix the size of batched_dummy_mm_inputs in profile_run (#20434)

linitra24 committed 1 year ago

Verified 6bbf1795

Fix bullets in incremental_build.md (#20642)

mgoin committed 1 year ago

Verified 9e0ef888

[feat] enable SM100 CUTLASS block scaled group gemm for smaller batch sizes (#20640)

djmmoss committed 1 year ago

Verified 97abeb1d

[Bugfix] set default set cuda_graph_sizes to min(self.max_num_seqs * 2, 512) (#20628)

izhuhaoran committed 1 year ago

Verified 34dad19e

[Hardware][PPC64LE] Enable V1 for ppc64le and ARM (#20554)

Akashcodes732 committed 1 year ago

Verified 6db31e7a

[Docs] Improve documentation for multi-node service helper script (#20600)

crypdick committed 1 year ago

Verified 977180c9

[BugFix][Intel GPU] Use refactored API for dist_backend in V1 worker (#20596)

ratnampa committed 1 year ago

Verified c40784c7

[tech debt] Revisit lora request model checker (#20636)

kouroshHakha committed 1 year ago

Verified baed180a

[misc]refactor `Platform.set_device` method (#20262)

jikunshang committed 1 year ago

Verified 0b407479

Replace `multiply_add` with `homogeneous_multiply_add` to Address Clang Template Parameter Issue (#20142)

wenxin0319 committed 1 year ago

Verified 5eaf5700

[TPU][Bugfix] disable phi-3 test (#20632)

QiliangCui committed 1 year ago

Verified d8ee5a2c

[Bugfix] Fix GLM-4.1-V video prompt update (#20635)

Isotr0py committed 1 year ago

Verified b9fca832

[Core] Rename `get_max_tokens_per_item` for backward compatibility (#20630)

DarkLight1337 committed 1 year ago

Verified 32dffc27

[Bugfix] Fix topk_ids indices_type for CUTLASS w8a8 FP8 MoE (#20166)

minosfuture committed 1 year ago

Verified c438183e

[CI] Increase the threshold of the MTEB RERANK tests (#20615)

noooop committed 1 year ago

Verified baba0389

Older