vllm-project/vllm

Pull Requests Commits

[CI/Build][CPU][Bugfix] Fix CPU CI (#12150)

bigPYJ1151 committed 1 year ago

Verified d4e61945

[Misc][LoRA] Improve the readability of LoRA error messages (#12102)

jeejeelee committed 1 year ago

Verified 07934cc2

[V1] Move more control of kv cache initialization from model_executor to EngineCore (#11960)

heheda12345 committed 1 year ago

Verified 69d765f5

[ROCm][MoE] moe tuning support for rocm (#12049)

divakar-amd committed 1 year ago

Verified 8027a724

[Misc] Add deepseek_vl2 chat template (#12143)

Isotr0py committed 1 year ago

Verified d75ab55f

[BugFix] add more `is not None` check in VllmConfig.__post_init__ (#12138)

heheda12345 committed 1 year ago

Verified d1adb9b4

[Bugfix] Fix issues in CPU build Dockerfile (#12135)

terrytangyuan committed 1 year ago

Verified b8bfa46a

[Doc] Add instructions on using Podman when SELinux is active (#12136)

terrytangyuan committed 1 year ago

Verified 1475847a

[CI]add genai-perf benchmark in nightly benchmark (#10704)

jikunshang committed 1 year ago

Verified fead53ba

[Bugfix] Fix a path bug in disaggregated prefill example script. (#12121)

KuntaiDu committed 1 year ago

Verified ebc73f28

[Bugfix] Set enforce_eager automatically for mllama (#12127)

heheda12345 committed 1 year ago

Verified d06e8240

[Model] Add support for deepseek-vl2-tiny model (#12068)

Isotr0py committed 1 year ago

Verified 62b06ba2

[misc] Add LoRA kernel micro benchmarks (#11579)

varun-sundar-rabindranath committed 1 year ago

Verified 5fd24ec0

[Bugfix] Fix max image feature size for Llava-one-vision (#12104)

ywang96 committed 1 year ago

Verified 874f7c29

[core] LLM.collective_rpc interface and RLHF example (#12084)

youkaichao committed 1 year ago

Verified 92e793d9

Support torchrun and SPMD-style offline inference (#12071)

youkaichao committed 1 year ago

Verified bf53e0c7

[Bugfix] Remove hardcoded `head_size=256` for Deepseek v2 and v3 (#12067)

Isotr0py committed 1 year ago

Verified dd7c9ad8

Various cosmetic/comment fixes (#12089)

mgoin committed 1 year ago

Verified 9aa1519f

[Doc] Add documentation for specifying model architecture (#12105)

DarkLight1337 committed 1 year ago

Verified f8ef146f

[Core] Default to using per_token quantization for fp8 when cutlass is supported. (#8651)

elfiegg committed 1 year ago

Verified fa0050db

Allow hip sources to be directly included when compiling for rocm. (#12087)

tvirolai-amd committed 1 year ago

Verified cd9d06fb

[Bugfix] Fix _get_lora_device for HQQ marlin (#12090)

varun-sundar-rabindranath committed 1 year ago

Verified ebd8c669

[V1][Core] Autotune encoder cache budget (#11895)

ywang96 committed 1 year ago

Verified 70755e81

[Bugfix] use right truncation for non-generative tasks (#12050)

joerunde committed 1 year ago

Verified edce722e

[Doc]: Update `OpenAI-Compatible Server` documents (#12082)

maang-h committed 1 year ago

Verified 57e729e8

[Misc][Quark] Upstream Quark format to VLLM (#10765)

kewang-xlnx committed 1 year ago

Verified de0526f6

Misc: allow to use proxy in `HTTPConnection` (#12042)

zhouyuan committed 1 year ago

Verified 5ecf3e0a

[Model]: Support internlm3 (#12037)

RunningLeon committed 1 year ago

Verified 97eb97b5

[Platform] Do not raise error if _Backend is not found (#12023)

wangxiyuan committed 1 year ago

Verified 3adf0ffd

Type-fix: make execute_model output type optional (#12020)

youngkent committed 1 year ago

Verified ad388d25

Newer Older