vllm-project/vllm

Pull Requests Commits

[V1] Minor V1 async engine test refactor (#15075)

andoorve committed 64 days ago

Verified 61c7a1b8

[Frontend] Remove custom_cache_manager (#13791)

fulvius31 committed 64 days ago

Verified 374ee287

[Misc] Update the "the first vLLM China Meetup" slides link to point to the first page (#15134)

imkero committed 65 days ago

Verified a4d83661

[Bugfix] Adjust mllama to regional compilation (#15112)

jkaniecki committed 65 days ago

Verified 8363cd09

[Misc][Benchmark] Add support for different `tokenizer_mode` (#15040)

aarnphm committed 65 days ago

Verified 6c5a3195

[Doc] Update tip info on using latest transformers when creating a custom Dockerfile (#15070)

MarcCote committed 65 days ago

Verified 073d1ed3

[Bugfix] Fix size calculation of processing cache (#15114)

DarkLight1337 committed 65 days ago

Verified 3d446433

[Misc] Avoid unnecessary HF `do_rescale` warning when passing dummy data (#15107)

DarkLight1337 committed 65 days ago

Verified 1fe0fd12

[V1][Bugfix] Fix oracle for device checking (#15104)

ywang96 committed 65 days ago

Verified dafb4e50

[CI][Intel GPU] update XPU dockerfile and CI script (#15109)

jikunshang committed 65 days ago

Verified 68cf1601

[Bugfix] Re-enable Gemma3 for V1 (#14980)

DarkLight1337 committed 65 days ago

Verified 61f41218

[V1] Ensure using int64 for sampled token ids (#15065)

WoosukKwon committed 65 days ago

Verified 05ccd0aa

[Core] Update dtype detection and defaults (#14858)

DarkLight1337 committed 65 days ago

Verified f690372b

[Model] Remove duplicated message check in Mistral chat completion request (#15069)

b8zhong committed 65 days ago

Verified 8b3e94a3

[Model] Pixtral: Remove layer instantiation duplication (#15053)

juliendenize committed 65 days ago

Verified 437f9162

[Misc][V1] Skip device checking if not available (#15061)

comaniac committed 65 days ago

Verified 4f065f12

[Doc] Minor v1_user_guide update (#15064)

JenZhao committed 65 days ago

Verified 228b768d

fix long dtype in topk sampling (#15049)

chujiezheng committed 65 days ago

Verified 027827cc

[V1] TPU - CI/CD use smaller model (#15054)

alexm-redhat committed 65 days ago

Verified 72a8639b

[V1][Spec Decode] Optimize Rejection Sampler with Triton Kernels (#14930)

WoosukKwon committed 65 days ago

Verified 99abb8b6

[V1] Refactor Structured Output for multiple backends (#14694)

russellb committed 65 days ago

Verified 3a1e6481

[Bugfix] Fix LoRA extra vocab size (#15047)

jeejeelee committed 65 days ago

Verified 46c759c1

[Bugfix] Fix broken CPU quantization due to triton import (#15038)

Isotr0py committed 65 days ago

Verified 179a619c

[MODEL] Add support for Zamba2 models (#13185)

yury-tokpanov committed 65 days ago

Verified 452e8fd9

MI325 configs, fused_moe_kernel bugfix (#14987)

ekuznetsov139 committed 66 days ago

Verified 8b793f7e

[TPU][V1][Bugfix] Fix chunked prefill with padding (#15037)

NickLucche committed 66 days ago

Verified af35d3a3

[Bugfix] Register serializers for V0 MQ Engine (#15009)

simon-mo committed 66 days ago

Verified 3b457143

[Bugfix] Loosen type check to avoid errors in V1 (#15021)

DarkLight1337 committed 66 days ago

Verified ab656f2c

[Misc][Docs] fix the comments of KV_T and CACHE_T in CALL_RESHAPE_AND_CACHE_XX macros (#14347)

yangsijia-serena committed 66 days ago

Verified 64fc2193

[Bugfix][Frontend] Fix validation of `logprobs` in `ChatCompletionRequest` (#14352)

schoennenbeck committed 66 days ago

Verified dd732028

Older