vllm-project/vllm

Pull Requests Commits

Merge branch 'main' into wentao-TritonMLA-support-without-prefix-caching

yewentao256 committed 6 days ago

Verified 9ecc6120

Revert #29787 and #29690 (#29815)

khluu committed 6 days ago

Verified 1336a1ea

[Ascend]: Fixed the issue where OOT Platform vllm-ascend could not enable SP in Eager mode (#28935)

leo-pony committed 7 days ago

Verified eaf81485

Update FAQ on interleaving sliding windows support (#29796)

finbarrtimbers committed 7 days ago

Verified 38caf7fa

[Core][Observability] Add KV cache residency metrics (#27793)

shivampr committed 7 days ago

Verified cabc77cc

[ci] Make distributed 8 gpus test optional (#29801)

khluu committed 7 days ago

Verified ec7035c9

[Bugfix] Missing cached item in the MultiModalReceiverCache (#28525)

knlnguyen1802 committed 7 days ago

Verified fc6acc88

Merge branch 'main' into wentao-TritonMLA-support-without-prefix-caching

yewentao256 committed 7 days ago

Verified 6c913b8a

[Hardware][AMD] Remove ROCm skip conditions for transformers backend tests (#29782)

Abdennacer-Badaoui committed 7 days ago

Verified d0985c5f

yewentao256 committed 7 days ago

da5aeab3

yewentao256 committed 7 days ago

5a787d3b

[Frontend] add 'verbose_json' and 'timestamp' feature on Whisper Transcription/Translation (#24209)

sangbumlikeagod committed 7 days ago

Verified 092bb73b

[Doc] Update description disable_any_whitespace (#29784)

FredericOdermatt committed 7 days ago

Verified 5d43f737

Merge branch 'main' into wentao-TritonMLA-support-without-prefix-caching

yewentao256 committed 7 days ago

2e1d0f86

yewentao256 committed 7 days ago

817285b3

Merge branch 'main' into wentao-TritonMLA-support-without-prefix-caching

yewentao256 committed 7 days ago

5ab2285a

[CI] fix url-encoding behavior in nightly metadata generation (#29787)

Harry-Chen committed 7 days ago

Verified 37593deb

[Doc] fix heading levels (#29783)

KKKZOZ committed 7 days ago

Verified f5516039

[CI] Renovation of nightly wheel build & generation (#29690)

Harry-Chen committed 7 days ago

Verified 36db0a35

[Bugfix] TypeError: 'NoneType' object is not callable (#29414)

mostrowskix committed 7 days ago

Verified 5cfa967e

[v1] Add real sliding window calculation to FlexAttention direct BlockMask building (#26015)

Isotr0py committed 7 days ago

Verified b95db244

[multimodal][test] Reduce memory utilization for test_siglip to avoid OOM (#29504)

zhxchen17 committed 7 days ago

Verified ad9d656b

[XPU] Fix AWQ skipped layer detection in IPEX quantization (#29774)

faaany committed 7 days ago

Verified f37e8938

[Misc] Unify tokenizer registration (#29767)

DarkLight1337 committed 7 days ago

Verified f0a28bf6

[crashfix] Eagle + multimodal can crash on mm cache miss (#29750)

mickaelseznec committed 7 days ago

Verified 86e178f7

[Frontend] Add tool filtering support to ToolServer (#29224)

daniel-salib committed 7 days ago

Verified 014ece97

[Frontend] Resettle pooling entrypoints (#29634)

noooop committed 7 days ago

Verified 62de4f42

[CI] Skip paddleocr_vl for transformer 4.57.3 (#29758)

hl475 committed 7 days ago

Verified 83805a60

Make PyTorch profiler gzip and CUDA time dump configurable (#29568)

zhangruoxu committed 7 days ago

Verified 1ab8fc81

[MoE] CuteDSL MoE with Nvfp4 DeepEP dispatch (#27141)

wenscarl committed 7 days ago

Verified f72a817b

Older