vllm-project/vllm

Pull Requests Commits

[vLLM Benchmark Suite] Add default parameters section and update CPU benchmark cases (#29381)

louie-tsai committed 29 days ago

Verified 8bbcf8b6

[BugFix] add max-num-batched-token to scheduler hash (#29829)

BoyuanFeng committed 29 days ago

Verified 70fb77b4

[CI] Fix Bad_words test for tokenizer encode/decode asymmetry (#28193)

zhyajie committed 29 days ago

Verified 48d15a32

[BugFix] respect VLLM_LOGGING_LEVEL in logger (#29761)

BoyuanFeng committed 29 days ago

Verified 3b221cb6

[Core] Eliminate redundant is_encoder_decoder lookups (20-40us/step) (#29800)

wushidonguc committed 29 days ago

Verified 0037b574

Fix some Transformers nightly tests (#29802)

hmellor committed 29 days ago

Verified f5b0846b

[CPU]Parallelize over tokens in int4 moe (#29600)

xiangze-arm committed 29 days ago

Verified 13ea39bc

[CI] Renovation of nightly wheel build & generation (take 2) (#29838)

Harry-Chen committed 29 days ago

Verified 4b612664

[Chore] Move tokenizer initialization methods (#29793)

DarkLight1337 committed 29 days ago

Verified 653591d5

[CI][AMD] spec_decode:eagle skip FLASH_ATTN for deepseek on ROCm (#29827)

divakar-amd committed 29 days ago

Verified e2fbfc95

[CI][ROCm] Fix test_correctness_sliding_window (#29243)

divakar-amd committed 29 days ago

Verified a690fb5b

[BugFix] Fix index error in ngram_proposer (#29779)

usberkeley committed 29 days ago

Verified 81fe3f82

[Misc] Update conftest for entrypoints/sagemaker test folder (#29799)

zhaozuy committed 29 days ago

Verified 53bf71b0

Add missing return in _check_vllm_model_embed_input_ids (#29834)

jcyang43 committed 29 days ago

Verified f441d36c

[Misc] Add ReplicaId to Ray metrics (#24267)

eicherseiji committed 29 days ago

Verified 22274b21

[Misc] Throw error on unintended access to scheduler_config.max_model_len (#29771)

frank-wei committed 29 days ago

Verified fc95521b

[Core] Support reseting all running requests' KV while calling `reset_prefix_cache` (#28827)

zhuohan123 committed 29 days ago

Verified d0cd7289

[responsesAPI][4] fix responseOutputItem Kimi K2 thinking bug (#29555)

qandrew committed 29 days ago

Verified fa8804ad

[ROCm] Fallback pytorch GELU with tanh approximation to GELU() (#29244)

divakar-amd committed 29 days ago

Verified 4b409249

SM120 / NVFP4: add device guard and runtime SM dispatch to cutlass_scaled_fp4_mm (#29711)

hholtmann committed 29 days ago

Verified c0dfc894

[BugFix] Preserve spec decoding uniform decode when scheduling (#29759)

njhill committed 30 days ago

Verified 44822d7f

Updated CI mirror 2025-11-25 (#29434)

Alexei-V-Ivanov-AMD committed 30 days ago

Verified 342c4f14

Revert #29787 and #29690 (#29815)

khluu committed 30 days ago

Verified 1336a1ea

[Ascend]: Fixed the issue where OOT Platform vllm-ascend could not enable SP in Eager mode (#28935)

leo-pony committed 30 days ago

Verified eaf81485

Update FAQ on interleaving sliding windows support (#29796)

finbarrtimbers committed 30 days ago

Verified 38caf7fa

[Core][Observability] Add KV cache residency metrics (#27793)

shivampr committed 30 days ago

Verified cabc77cc

[ci] Make distributed 8 gpus test optional (#29801)

khluu committed 30 days ago

Verified ec7035c9

[Bugfix] Missing cached item in the MultiModalReceiverCache (#28525)

knlnguyen1802 committed 30 days ago

Verified fc6acc88

[Hardware][AMD] Remove ROCm skip conditions for transformers backend tests (#29782)

Abdennacer-Badaoui committed 30 days ago

Verified d0985c5f

[Frontend] add 'verbose_json' and 'timestamp' feature on Whisper Transcription/Translation (#24209)

sangbumlikeagod committed 30 days ago

Verified 092bb73b

Newer Older