vllm-project/vllm

Pull Requests Commits

i honestly can't believe i spelled it that way

tlrmchlsmth committed 1 year ago

8209f905

merge main, add environment variable, factor into function

tlrmchlsmth committed 1 year ago

19c51c34

[feat]: CUTLASS block scaled group gemm for SM100 (#19757)

djmmoss committed 1 year ago

Verified 3d184b95

Enable V1 for Hybrid SSM/Attention Models (#20016)

tdoublep committed 1 year ago

Verified 2f35a022

[Misc] Small: Remove global media connector. Each test should have its own test connector object. (#20395)

huachenheli committed 1 year ago

Verified ffe00ef7

[CI] add kvcache-connector dependency definition and add into CI build (#18193)

panpan0000 committed 1 year ago

Verified 5561681d

[Doc] Fix classification table in list of supported models (#20489)

DarkLight1337 committed 1 year ago

Verified fbd62d87

[Model][3/N] Automatic conversion of CrossEncoding model (#20168)

noooop committed 1 year ago

Verified 2e26f915

[Bug][Frontend] Fix structure of transcription's decoder_prompt (#18809)

sangbumlikeagod committed 1 year ago

Verified 9e5452ee

Support Llama 4 for fused_marlin_moe (#20457)

mgoin committed 1 year ago

Verified 0e3fe896

[Misc] Add SPDX-FileCopyrightText (#20428)

jeejeelee committed 1 year ago

Verified 1caca5a5

[Perf] Optimize Vectorization Utils for Int 8 Quantization Kernels (#20331)

yewentao256 committed 1 year ago

Verified 783921d8

[Structured Outputs][V1] Skipping with models doesn't contain tokenizers (#20365)

aarnphm committed 1 year ago

Verified 4a98edff

[Misc] small update (#20462)

reidliu41 committed 1 year ago

Verified a7bab0c9

Add ignore consolidated file in mistral example code (#20420)

princepride committed 1 year ago

Verified 25950dca

[Platform] Add custom default max tokens (#18557)

gmarinho2 committed 1 year ago

Verified a4113b03

[Misc] Change warn_for_unimplemented_methods to debug (#20455)

mgoin committed 1 year ago

Verified 7e1665b0

[Bugfix] Register reducer even if transformers_modules not available (#19510)

eicherseiji committed 1 year ago

Verified 8d1096e7

[Misc] Fix `Unable to detect current VLLM config. Defaulting to NHD kv cache layout` warning (#20400)

NickLucche committed 1 year ago

Verified 8d775dd3

[Kernel] Enable fp8 support for pplx and BatchedTritonExperts. (#18864)

bnellnm committed 1 year ago

Verified 78fe7753

[Misc] Remove _maybe_ignore_quant_config from GLM4.1v (#20432)

zRzRzRzRzRzRzR committed 1 year ago

Verified 2f2fcb31

[Misc] adjust for ipv6 for mookcacke url parse (#20107)

andyxning committed 1 year ago

Verified 1dba2c4e

[Misc] Clean up InternVL family config registration (#19992)

Isotr0py committed 1 year ago

Verified 71d6de3a

[CI] Trimming some failing test groups from AMDPRODUCTION. (#20390)

Alexei-V-Ivanov-AMD committed 1 year ago

Verified 536fd330

[Frontend] fix duplicate output for bench subcmd (#20446)

reidliu41 committed 1 year ago

Verified 619b9f5c

[Bugfix] Fix flaky `test_streaming_response` test (#20363)

NickLucche committed 1 year ago

Verified d1b689c4

[Frontend] improve vllm bench <bench_type> --help display (#20430)

reidliu41 committed 1 year ago

Verified 9854dc90

[Misc] Automatically tag PRs to add new models (#20222)

Isotr0py committed 1 year ago

Verified ff5c60fa

[Model][2/N] Automatic conversion of CrossEncoding model (#19978)

noooop committed 1 year ago

Verified 6f1229f9

[Quantization] Bump to use latest bitsandbytes (#20424)

jeejeelee committed 1 year ago

Verified 1819fbda

Older