vllm-project/vllm

Pull Requests Commits

[V1][Core] Support MistralTokenizer for Structured Output (#14625)

aarnphm committed 1 year ago

Verified 77a318bd

[Model] Extend Ultravox to accept audio longer than 30s (#13631)

farzadab committed 1 year ago

Verified 80e78d02

[Doc] Update benchmarks README (#14646)

JenZhao committed 1 year ago

Verified 4a42b9f5

[core][V1] pluggable scheduler (#14466)

joerunde committed 1 year ago

Verified 47532cd9

[Feature] Add `vllm bench` CLI (#13993)

randyjhc committed 1 year ago

Verified 36e0c8f7

[release] Add commands to clean up logs on TPU release node (#14642)

khluu committed 1 year ago

Verified 9f583e36

[Bugfix][V1][PP] Only warmup sampler at last PP rank (#14643)

comaniac committed 1 year ago

Verified b706d898

[V1][TPU] Pad the block_table.shape[1] so the ragged paged attention can handle correctly (#14597)

vanbasten23 committed 1 year ago

Verified 863d315c

Fix run_tpu_test (#14641)

richardsliu committed 1 year ago

Verified d374f04a

[V1] Delay all xgrammar usage until needed (#14616)

russellb committed 1 year ago

Verified 61a01b27

fix some typos : supported_head_sizes (#14627)

hackty committed 1 year ago

Verified 53056731

[V1] Remove cache from StructuredOutputManager (#14622)

russellb committed 1 year ago

Verified 4cbf2867

[Hardware][Intel GPU] upgrade IPEX dependency to 2.6.10. (#14564)

jikunshang committed 1 year ago

Verified c6e14a61

[BugFix/Build] Fix sparse kernels not getting built on hopper (#14572)

LucasWilkinson committed 1 year ago

Verified 07b4b7a3

docs: Add documentation for s390x cpu implementation (#14198)

dilipgb committed 1 year ago

Verified 07964e2f

[V1] Add regex structured output support with xgrammar (#14590)

russellb committed 1 year ago

Verified 4bf82d4b

Uninstall dependencies before installing requirements/tpu.txt (#14586)

richardsliu committed 1 year ago

Verified 9ab32671

[Bugfix] Update `--hf-overrides` for `Alibaba-NLP/gte-Qwen2` (#14609)

DarkLight1337 committed 1 year ago

Verified af295e9b

dynamic distpatch of fp8 kernels (#14245)

jeffdaily committed 1 year ago

Verified a1c8f379

benchmarks: simplify test jsonschema (#14567)

russellb committed 1 year ago

Verified 08a1a112

[VLM] Cleanup siglip legacy code and fix broken paligemma multimodal processor (#14602)

Isotr0py committed 1 year ago

Verified 1477ffc3

[Perf]:Optimize qwen2-vl to reduce cudaMemcpyAsync (#14377)

cynthieye committed 1 year ago

Verified 70b808fe

[Misc] Correct deepseek-vl2 chat template (#14558)

Isotr0py committed 1 year ago

Verified 63d635d1

[V1][Core] Fix memory issue with logits & sampling (#14508)

ywang96 committed 1 year ago

Verified 1fc973c0

[Bugfix] Fix FP16 overflow for DeepSeek V2 (#13232)

Concurrensee committed 1 year ago

Verified c982ac57

[V1][PP] Do not block engine core when no requests to schedule (#14585)

comaniac committed 1 year ago

Verified 4290b704

[neuron] add reshape_and_cache (#14391)

liangfu committed 1 year ago

Verified c91b64f7

[Neuron] Add Neuron device communicator for vLLM v1 (#14085)

gnovack committed 1 year ago

Verified d6123170

[MISC][V1] Handle exception of current_platform.get_device_name() in arg_utils (#14379)

comaniac committed 1 year ago

Verified 485afdd3

[Kernel] moe wna16 cuda kernel (#13321)

jinzhen-lin committed 1 year ago

Verified 90e88ab7

Newer Older