vllm-project/vllm

Pull Requests Commits

Merge branch 'main' into moondream2

ywang96 committed 1 year ago

a7ca0cc4

[misc] add placeholder format.sh (#12206)

youkaichao committed 1 year ago

Verified 5c89a29c

[Core] Interface for accessing model from `VllmRunner` (#10353)

DarkLight1337 committed 1 year ago

Verified 59a0192f

[Model] Add Qwen2 PRM model support (#12202)

Isotr0py committed 1 year ago

Verified 83609791

[Bugfix] Fix incorrect types in LayerwiseProfileResults (#12196)

terrytangyuan committed 1 year ago

Verified 0974c9bc

[DOC] Add missing docstring in LLMEngine.add_request() (#12195)

terrytangyuan committed 1 year ago

Verified d2643128

[DOC] Fix typo in docstring and assert message (#12194)

terrytangyuan committed 1 year ago

Verified c5c06209

Move linting to `pre-commit` (#11975)

hmellor committed 1 year ago

Verified 3ea7b945

[torch.compile] fix sym_tensor_indices (#12191)

youkaichao committed 1 year ago

Verified 51ef828f

[Bugfix] Fix num_heads value for simple connector when tp enabled (#12074)

ShangmingCai committed 1 year ago

Verified df450aa5

[Model] Support for fairseq2 Llama (#11442)

MartinGleize committed 1 year ago

Verified bbe5f9de

[V1] Add V1 support of Qwen2-VL (#12128)

ywang96 committed 1 year ago

Verified 81763c58

[Misc] Add BNB support to GLM4-V model (#12184)

Isotr0py committed 1 year ago

Verified edaae198

benchmark_serving support --served-model-name param (#12109)

gujingit committed 1 year ago

Verified 936db119

[torch.compile] store inductor compiled Python file (#12182)

youkaichao committed 1 year ago

Verified e66faf48

[Bugfix] Fix multi-modal processors for transformers 4.48 (#12187)

DarkLight1337 committed 1 year ago

Verified 630eb5b5

[BUGFIX] Move scores to float32 in case of running xgrammar on cpu (#12152)

madamczyk-intel committed 1 year ago

Verified 4e94951b

[V1] Collect env var for usage stats (#12115)

simon-mo committed 1 year ago

Verified 7a8a48d5

[Misc] Support register quantization method out-of-tree (#11969)

ice-tong committed 1 year ago

Verified 32eb0da8

[core] clean up executor class hierarchy between v1 and v0 (#12171)

youkaichao committed 1 year ago

Verified 6d0e3d37

[Model] Port deepseek-vl2 processor, remove dependency (#12169)

Isotr0py committed 1 year ago

Verified 02798eca

[Docs] Fix broken link in SECURITY.md (#12175)

russellb committed 1 year ago

Verified 813f249f

[core] further polish memory profiling (#12126)

youkaichao committed 1 year ago

Verified da02cb4b

[AMD][CI/Build][Bugfix] use pytorch stale wheel (#12172)

hongxiayang committed 1 year ago

Verified c09503dd

[misc] fix cross-node TP (#12166)

youkaichao committed 1 year ago

Verified 2b835032

[torch.compile] disable logging when cache is disabled (#12043)

youkaichao committed 1 year ago

Verified 7b98a65a

[AMD][FP8] Using MI300 FP8 format on ROCm for block_quant (#12134)

gshtras committed 1 year ago

Verified b5b57e30

[Bugfix] Mistral tokenizer encode accept list of str (#12149)

jikunshang committed 1 year ago

Verified 54cacf00

[Bugfix] Fix score api for missing max_model_len validation (#12119)

wallashss committed 1 year ago

Verified 58fd57ff

[core] allow callable in collective_rpc (#12151)

youkaichao committed 1 year ago

Verified 87a0c076

Older