vllm-project/vllm

Pull Requests Commits

Merge remote-tracking branch 'origin/main' into fix-flashinfer-experts-quant-config-hack

Robert Shaw committed 1 day ago

173e67d9

[MoE Refactor][13/N] Convert FI to Use PFNoEP (#31533)

robertgshaw2-redhat committed 1 day ago

Verified 268b1c55

[CI][Bugfix] Fix token counting in chunked prefill compl test (#31630)

AndreasKaratzas committed 1 day ago

Verified 4f9ce35a

Improve HF qwen3_omni: preserve audio_sample_rate in kwargs restructuring (#29255)

jeremyteboul committed 1 day ago

Verified 97a01308

[Core] Parse vLLM engine required fields from hf_config to model_arch_config (#28454)

charlotte12l committed 2 days ago

Verified 0eee877f

[Benchmark] Fix OOM during MoE kernel tuning for large models (#31604)

massif-01 committed 2 days ago

Verified a0e9ee83

[MoE Refactor] Explicit construct mk for flashinfer bf16 kernel (#31504)

zyongye committed 2 days ago

Verified a3f2f409

[MoE Refactor] Split `invoke_fused_moe_kernel` (#31050)

zyongye committed 2 days ago

Verified 5a468ff7

Robert Shaw committed 2 days ago

de6faa1e

Robert Shaw committed 2 days ago

140f447c

revert the llama weight loading hack

Robert Shaw committed 2 days ago

39987f68

Robert Shaw committed 2 days ago

e917f5db

a few small nits

Robert Shaw committed 2 days ago

56edecab

Robert Shaw committed 2 days ago

3d22ba38

Robert Shaw committed 2 days ago

dd304162

Robert Shaw committed 2 days ago

b2e3a500

standardize how we add the params

Robert Shaw committed 2 days ago

218e6976

remove unneeded assert

Robert Shaw committed 2 days ago

d4d42310

Robert Shaw committed 2 days ago

b887c4f3

Robert Shaw committed 2 days ago

344167d0

Robert Shaw committed 2 days ago

7300bc58

Robert Shaw committed 2 days ago

83a7d9b0

updated doc string

Robert Shaw committed 2 days ago

7eaa18be

fix assign float to parameter

Robert Shaw committed 2 days ago

86a0e5c2

Robert Shaw committed 2 days ago

23e79fd8

clean up fi checking

Robert Shaw committed 2 days ago

870fc6ab

Robert Shaw committed 2 days ago

d2decd6d

Robert Shaw committed 2 days ago

a9108728

reduce LOC change

Robert Shaw committed 2 days ago

2d96161f

update to address pavani's feedback

Robert Shaw committed 2 days ago

a285f5e0

Older