vllm-project/vllm

Pull Requests Commits

Fix failing `MyGemma2Embedding` test (#13820)

hmellor committed 1 year ago

Verified 34e3494e

[Neuron] Add custom_ops for neuron backend (#13246)

liangfu committed 1 year ago

Verified f75aa727

Fix string parsing error (#13825)

Chen-0210 committed 1 year ago

Verified 340e39e3

[Bugfix] Revert inspection code in #13743 (#13832)

DarkLight1337 committed 1 year ago

Verified f4133ce4

Fix `/v1/audio/transcriptions ` Bad Request Error (#13811)

HermitSun committed 1 year ago

Verified 6522d55b

[Bugfix] Fix deepseek-vl2 inference with more than 2 images (#13818)

Isotr0py committed 1 year ago

Verified 6ff51862

[Bugfix] Flush TunableOp results before worker processes are destroyed. (#13623)

naromero77amd committed 1 year ago

Verified fa820741

[Bugfix] Initialize attention bias on the same device as Query/Key/Value (#13468)

edwardzjl committed 1 year ago

Verified 75e9d497

[Misc]Clarify Error Handling for Non-existent Model Paths and HF Repo IDs (#13724)

Chen-0210 committed 1 year ago

Verified 32c3b6bf

[CI/Build] Fix V1 LoRA failure (#13767)

jeejeelee committed 1 year ago

Verified 37b6cb49

[ROCm][Quantization][Kernel] Using HIP FP8 header (#12593)

gshtras committed 1 year ago

Verified aabeb268

[Feature] Support KV cache offloading and disagg prefill with LMCache connector. (#12953)

YaoJiayi committed 1 year ago

Verified 2f42a488

[misc] Clean up ray compiled graph type hints (#13731)

ruisearch42 committed 1 year ago

Verified 3173c3b3

[Bugfix] Modify modelscope api usage in transformer_utils (#13807)

shen-shanshan committed 1 year ago

Verified 2d87d7d1

[Core] xgrammar: Expand list of unsupported jsonschema keywords (#13783)

russellb committed 1 year ago

Verified aab39277

[Misc] Check that the model can be inspected upon registration (#13743)

DarkLight1337 committed 1 year ago

Verified 6724e791

[Core] LoRA V1 - Add add/pin/list/remove_lora functions (#13705)

varun-sundar-rabindranath committed 1 year ago

Verified 03f48b3d

Fix CompressedTensorsWNA16MoE with grouped scales (#13769)

mgoin committed 1 year ago

Verified 4d251ad0

[Bugfix] Support MLA for CompressedTensorsWNA16 (#13725)

mgoin committed 1 year ago

Verified 18e50593

[Bugfix] Fix deepseek-v2 error: "missing 1 required positional argument: 'residual'" (#13802)

LucasWilkinson committed 1 year ago

Verified 4a8cfc75

[V1][Metrics] Implement vllm:lora_requests_info metric (#13504)

markmc committed 1 year ago

Verified bc32bc73

[Misc][Attention][Quantization] init property earlier (#13733)

wangxiyuan committed 1 year ago

Verified ab1091d5

[Bugfix][Quantization] Fix FP8 + EP (#13784)

tlrmchlsmth committed 1 year ago

Verified 1e15aaef

[Misc] set single whitespace between log sentences (#13771)

cjackal committed 1 year ago

Verified 51010a18

[Doc] arg_utils.py: fixed a typo (#13785)

eli-b committed 1 year ago

Verified 7196a3b1

Remove unused kwargs from model definitions (#13555)

hmellor committed 1 year ago

Verified cdc1fa12

[Misc][Chore] Clean Up `AsyncOutputProcessing` Logs (#13780)

robertgshaw2-redhat committed 1 year ago

Verified f61528d4

[Misc] Clean Up `EngineArgs.create_engine_config` (#13734)

robertgshaw2-redhat committed 1 year ago

Verified 1f0ae3ed

Fix precommit fail in fused_moe intermediate_cache2 chunking (#13772)

mgoin committed 1 year ago

Verified db986c19

Revert "[V1][Core] Fix memory issue with logits & sampling" (#13775)

ywang96 committed 1 year ago

Verified 22757848

Older