vllm-project/vllm

Pull Requests Commits

[Bugfix] Fix mismatched nvfp4 gemm output shape (#29742)

Isotr0py committed 11 days ago

Verified 47539cfd

[Misc] Update `TokenizerLike` interface and move `get_cached_tokenizer` (#29730)

DarkLight1337 committed 11 days ago

Verified 2afcec4d

[Doc]: Fix typo in fused_moe layer (#29731)

BowTen committed 11 days ago

Verified 9381b5cd

[Bugfix][sleepmode][fp8 kv cache]: Fix FP8 KV cache + sleep(level=2) gibberish output (#28783)

Flink-ddd committed 11 days ago

Verified 66b58402

Fix AttributeError about _use_fi_prefill (#29734)

hl475 committed 11 days ago

Verified 82c795d6

[Quantization] Enable compressed-tensors AWQ for Turing GPU (#29732)

Isotr0py committed 11 days ago

Verified e1464c3a

[LoRA] Support FusedMoE LoRA Triton kernel for mxfp4 (#29708)

xyang16 committed 12 days ago

Verified a491b091

[Bugfix] Revert test_tokenization.py (#29729)

jeejeelee committed 12 days ago

Verified b9d0504a

[Kernel][Quantization] add w4a8 support for marlin kernel (#24722)

jinzhen-lin committed 12 days ago

Verified 1656ad37

[Chore] Move `detokenizer_utils` to `vllm/tokenizers` (#29727)

DarkLight1337 committed 12 days ago

Verified fa59fe41

[Chore] Enable passing `tokenizer=None` into MM processor (#29724)

DarkLight1337 committed 12 days ago

Verified fe3398fa

hfrunner.classify should return list[list[float]] not list[str] (#29671)

nwaughachukwuma committed 12 days ago

Verified ad7f714d

[Doc]: fix code block rendering (#29728)

dublc committed 12 days ago

Verified f4341f45

[Misc] Refactor tokenizer interface (#29693)

DarkLight1337 committed 12 days ago

Verified 34a98427

[Model Runner V2] Fuse penalties and temperature into single kernel (#29720)

WoosukKwon committed 12 days ago

Verified f223ed41

[Doc]: fixing typos in various files. (#29717)

didier-durand committed 12 days ago

Verified 04a797cd

[Model Runner V2] Add sample/ directory and reorganize files (#29719)

WoosukKwon committed 12 days ago

Verified 6afc0ffa

[LoRA] Cleanup LoRA unused code (#29611)

jeejeelee committed 12 days ago

Verified 39e63dec

[Model Runner V2] Don't use UVA buffer for prefill_len (#29713)

WoosukKwon committed 12 days ago

Verified 4a80ad0a

Add gpu memory wait before test_async_tp (#28893)

angelayi committed 12 days ago

Verified 4b17ce68

[BugFix] Fix DBO failing with TypeError: 'NoneType' object is not iterable (#29698)

LucasWilkinson committed 12 days ago

Verified e23f665d

[Model Runner V2] Refactor prefill token preparation (#29712)

WoosukKwon committed 12 days ago

Verified ca1b1e72

[Frontend] Perform offline path replacement to `tokenizer` (#29706)

a4lg committed 13 days ago

Verified 762a4a6c

[Bugfix] Fix wrong mock attribute (#29704)

DarkLight1337 committed 13 days ago

Verified b2c50eda

[Model Runner V2] Support penalties using bin counts (#29703)

WoosukKwon committed 13 days ago

Verified 1dcafb3d

[ROCm][Bugfix] Patch for the `Multi-Modal Processor Test` group (#29702)

AndreasKaratzas committed 13 days ago

Verified ea3370b4

[Bugfix] Fix O(n²) multimodal string prompt processing (#29667)

mertunsall committed 13 days ago

Verified c625d7b1

[compile] Include `enable_sleep_mode` into caching factors. (#29696)

zhxchen17 committed 13 days ago

Verified 6173682b

bugfix: correct attn output with base 2 or e (#28840)

staugust committed 13 days ago

Verified 9726e645

Revert "[LoRA] Support FusedMoE LoRA Triton kernel for mxfp4 (#28971)" (#29697)

hl475 committed 13 days ago

Verified 3fd1fb0b

Newer Older