Commits vllm-project/vllm

[Refactor] Merge Compressed Tensor FP8 `CompressedTensorsW8A8Fp8MoEMethod` and `CompressedTensorsW8A8Fp8MoECutlassMethod` (#21775)

yewentao256 committed 134 days ago

Verified 48b763d6

[Docs] Minimize spacing for supported_hardware.md table (#21779)

mgoin committed 134 days ago

Verified 947e982e

[Kernel] SM90 CUTLASS FP8 GEMM: add support for swap AB + kernel tuning (#20396)

LyrisZhong committed 134 days ago

Verified c6c9122d

[Perf] Disable chunked local attention by default with llama4 (#21761)

LucasWilkinson committed 134 days ago

Verified 8aa1485f

[Feat]: Add support for Dynamic Quant 4 bit CPU kleidiai kernels (#17112)

nikhil-arm committed 134 days ago

Verified 89ac266b

[Bugfix] DeepGEMM is not enabled on B200 due to `_lazy_init()` (#21472)

smarterclayton committed 134 days ago

Verified c6f36cfa

Revert "[V1] Exception Handling when Loading KV Cache from Remote Store" (#21778)

KuntaiDu committed 134 days ago

Verified b18b417f

[AMD][CI/Build] Fix the AMD issue caused by inappropriate of symbol exposure (#21647)

houseroad committed 134 days ago

Verified 9ba1c88a

[Bug] Enforce contiguous input for `dynamic_scaled_fp8_quant` and `static_scaled_fp8_quant` (#21773)

yewentao256 committed 134 days ago

Verified e0e58f97

[AMD][BugFix] Fix omission of wvSplitK kernel for small batch sizes (1-4) due to torch.compile (#21350)

rasmith committed 134 days ago

Verified b361f14e

update flashinfer to v0.2.9rc2 (#21701)

weireweire committed 134 days ago

Verified 01c753ed

Use `metavar` to list the choices for a CLI arg when custom values are also accepted (#21760)

hmellor committed 134 days ago

Verified 94b71ae1

[P/D] Log warnings related to prefill KV expiry (#21753)

njhill committed 134 days ago

Verified 7d44c691

[Bugfix] Fix granite speech shape validation (#21762)

DarkLight1337 committed 134 days ago

Verified e17a4d3b

[XPU] IPEX-optimized Punica Wrapper on XPU (#21703)

chaojun-zhang committed 134 days ago

Verified ec261b02

[CI/Build] Fix plugin tests (#21758)

DarkLight1337 committed 134 days ago

Verified 04fe61aa

[Bugfix] Mistral crashes on tool with no description (#21167)

HugoMichard committed 135 days ago

Verified 25708d31

[Misc] Reduce logs for model resolution (#21765)

DarkLight1337 committed 135 days ago

Verified 0e18a5d0

[Logs] Change flashinfer sampler logs to once (#21759)

mgoin committed 135 days ago

Verified 34a20c49

[Bugfix][CI/Build] Update peft version in test requirement (#21729)

Isotr0py committed 135 days ago

Verified 31084b3b

[Bugfix]check health for engine core process exiting unexpectedly (#21728)

wuhang2014 committed 135 days ago

Verified bccc43c0

[Docs] Add revision date to rendered docs (#21752)

hmellor committed 135 days ago

Verified 1395dd9c

[Bugfix] Improve JSON extraction in LlamaToolParser (#19024)

key4ng committed 135 days ago

Verified 9ace2eaf

[`Ernie 4.5`] Name Change for Base 0.3B Model (#21735)

vasqu committed 135 days ago

Verified 656c24f1

[PD] let p2p nccl toy proxy handle /chat/completions (#21734)

chaunceyjiang committed 135 days ago

Verified 63fe3a70

[Bugfix] Fix glm4.1v video_grid_thw tensor shape scheme (#21744)

Isotr0py committed 135 days ago

Verified 0ae970ed

[Bugfix] Fix environment variable setting in CPU Dockerfile (#21730)

bigPYJ1151 committed 135 days ago

Verified 65e8466c

[Bugfix] Fix Ernie4_5_MoeForCausalLM shared experts (#21717)

jeejeelee committed 135 days ago

Verified 1b769dcc

[feature] add log non default args in LLM (#21680)

lengrongfu committed 135 days ago

Verified 2cc57119

[Model] Prioritize Transformers fallback over suffix matching (#21719)

DarkLight1337 committed 135 days ago

Verified a4ed7315