vllm-project/vllm

Pull Requests Commits

[Misc] remove unused try-except in pooling config check (#21618)

reidliu41 committed 210 days ago

Verified 05c1126f

Support Intern-S1 (#21628)

lvhan028 committed 210 days ago

Verified 875af38e

[TPU][Test] Divide TPU v1 Test into 2 parts. (#21431)

QiliangCui committed 210 days ago

Verified 7728dd77

[Bugfix] Fix isinstance check for tensor types in _load_prompt_embeds to use dtype comparison (#21612)

Mitix-EPI committed 210 days ago

Verified 2f6e6b33

Correctly kill vLLM processes after finishing serving benchmarks (#21641)

huydhn committed 210 days ago

Verified a55c9509

[Docs] add offline serving multi-modal video input expamle Qwen2.5-VL (#21530)

david6666666 committed 210 days ago

Verified 97349fe2

[Model] Ultravox: Support Llama 4 and Gemma 3 backends (#17818)

farzadab committed 210 days ago

Verified 62965de5

[Feature] Add support for MoE models in the calibration-free RTN-based quantization (#20766)

sakogan committed 210 days ago

Verified 7ae75fa6

[TPU] Update ptxla nightly version to 20250724 (#21555)

yaochengji committed 210 days ago

Verified f1b286b2

[Bugfix] Always set RAY_ADDRESS for Ray actor before spawn (#21540)

ruisearch42 committed 210 days ago

Verified c7742d61

[Bugfix] Fix sync_and_slice_intermediate_tensors (#21537)

ruisearch42 committed 210 days ago

Verified cea96a01

Add interleaved RoPE test for Llama4 (Maverick) (#21478)

sarckk committed 210 days ago

Verified 2eddd437

[Perf] Cuda Kernel for Int8 Per Token Group Quant (#21476)

yewentao256 committed 210 days ago

Verified 75d29cf4

Add Unsloth to RLHF.md (#21636)

danielhanchen committed 210 days ago

Verified 41d3082c

[TPU][Test] Rollback PR-21550. (#21619)

QiliangCui committed 210 days ago

Verified 7cfea0df

[Docs] add auto-round quantization readme (#21600)

wenhuach21 committed 211 days ago

Verified 5ac3168e

[BugFix] Harden coordinator startup

njhill committed 211 days ago

ec125042

[BugFix] Improve internal DP load balancing

njhill committed 211 days ago

8177e2f0

[CI] Unifying Dockerfiles for ARM and X86 Builds (#21343)

kebe7jun committed 211 days ago

Verified 396ee941

Add support for Prithvi in Online serving mode (#21518)

mgazz committed 211 days ago

Verified e189b50f

[Kernel] Improve machete memory bound perf (#21556)

czhu-cohere committed 211 days ago

Verified 136d750f

[ROCm][AITER] Enable fp8 kv cache on rocm aiter backend. (#20295)

fsx950223 committed 211 days ago

Verified b3caeb82

[Model] Replace Mamba2 RMSNorm Gated with Fused Triton Kernel (#20839)

cyang49 committed 211 days ago

Verified eab2f398

[Frontend] Add request_id to the Request object so they can be controlled better via external load balancers (#21009)

kouroshHakha committed 211 days ago

Verified 9fe98d42

[MODEL] New model support for naver-hyperclovax/HyperCLOVAX-SEED-Vision-Instruct-3B (#20931)

bigshanedogg committed 211 days ago

Verified 29c6fbe5

[Model] Fix Ernie4.5MoE e_score_correction_bias parameter (#21586)

xyxinyang committed 211 days ago

Verified c72f049c

[Bugfix][Logprobs] Fix logprobs op to support more backend (#21591)

MengqingCao committed 211 days ago

Verified f3a683b7

[V1] Get supported tasks from model runner instead of model config (#21585)

DarkLight1337 committed 211 days ago

Verified 46d81d69

[Quantization] Enable BNB support for more MoE models (#21370)

jeejeelee committed 211 days ago

Verified 5c3f2628

[Bugfix] GGUF: fix AttributeError: 'PosixPath' object has no attribute 'startswith' (#21579)

kebe7jun committed 211 days ago

Verified 7311f744

Newer Older