vllm-project/vllm

Pull Requests Commits

Resolve race conditions in Marlin kernel (#11493)

wchen61 committed 339 days ago

Verified 5dba2575

[Bugfix] Change kv scaling factor by param json on nvidia gpu (#11688)

bjmsong committed 339 days ago

Verified 187e3299

[V1][Minor] Optimize token_ids_cpu copy (#11692)

WoosukKwon committed 340 days ago

Verified b55ed6ef

[Bugfix] Free cross attention block table for preempted-for-recompute sequence group. (#10013)

kathyyu-google committed 340 days ago

Verified 2f385183

According to vllm.EngineArgs, the name should be distributed_executor_backend (#11689)

chunyang-wen committed 340 days ago

Verified 84c35c37

[VLM] Merged multi-modal processor for LLaVA-NeXT (#11682)

DarkLight1337 committed 340 days ago

Verified 8c38ee70

[mypy] Pass type checking in vllm/inputs (#11680)

CloseChoice committed 340 days ago

Verified b6087a6b

[VLM][Bugfix] Multi-modal processor compatible with V1 multi-input (#11674)

DarkLight1337 committed 340 days ago

Verified 23c1b10a

[VLM] Move supported limits and max tokens to merged multi-modal processor (#11669)

DarkLight1337 committed 341 days ago

Verified a115ac46

[V1] Implement Cascade Attention (#11635)

WoosukKwon committed 341 days ago

Verified 73001445

[Doc] Fix typo (#11666)

serihiro committed 341 days ago

Verified 6d70198b

[Misc] Replace space with - in the file names (#11667)

houseroad committed 341 days ago

Verified f962f426

[Misc] Optimize Qwen2-VL LoRA test (#11663)

jeejeelee committed 341 days ago

Verified 11d8a091

[VLM] Add max-count checking in data parser for single image models (#11661)

DarkLight1337 committed 341 days ago

Verified 365801fe

[Bugfix][Refactor] Unify model management in frontend (#11660)

joerunde committed 341 days ago

Verified 4db72e57

[Benchmark] Add benchmark script for CPU offloading (#11533)

ApostaC committed 341 days ago

Verified 0c6f9985

[V1][VLM] V1 support for selected single-image models. (#11632)

ywang96 committed 341 days ago

Verified e7c7c5e8

[V1] Simpify vision block hash for prefix caching by removing offset from hash (#11646)

heheda12345 committed 342 days ago

Verified 8c3230d8

[Bugfix] Move the _touch(computed_blocks) call in the allocate_slots method to after the check for allocating new blocks. (#11565)

sakunkun committed 342 days ago

Verified 2c571880

[Misc][LoRA] Support Rank Stabilized LoRA (RSLoRA) (#6909)

JohnGiorgi committed 342 days ago

Verified 82c49d32

[Bugfix] Fix OpenAI parallel sampling when using xgrammar (#11637)

mgoin committed 342 days ago

Verified 74fa1d12

[Model][LoRA]LoRA support added for MolmoForCausalLM (#11439)

ayylemao committed 342 days ago

Verified a2a40bcd

[benchmark] Remove dependency for H100 benchmark step (#11572)

khluu committed 342 days ago

Verified ccb1aabc

[Bugfix] Validate and concatenate image embeddings in MiniCPMVBaseModel (#11631)

whyiug committed 343 days ago

Verified 36e76700

[V1] [6/N] API Server: Better Shutdown (#11586)

robertgshaw2-redhat committed 343 days ago

Verified 5886aa49

[VLM] Abstract out multi-modal data parsing in merged processor (#11620)

DarkLight1337 committed 343 days ago

Verified 8d9b6721

[platforms] enable platform plugins (#11602)

youkaichao committed 343 days ago

Verified b12e87f9

[CI/Build][CPU] Fix CPU CI by lazy importing triton FP8 kernels (#11618)

bigPYJ1151 committed 343 days ago

Verified 5dbf8545

[Build][Kernel] Update CUTLASS to v3.6.0 (#11607)

tlrmchlsmth committed 343 days ago

Verified 970d6d07

[Docker] bump up neuron sdk v2.21 (#11593)

liangfu committed 343 days ago

Verified 628ec6c1

Newer Older