vllm-project/vllm

Pull Requests Commits

[Bugfix] fix rotary embedding test for _get_padded_tensor_shape (#18229)

LucasWilkinson committed 1 year ago

Verified 4e1c6a02

[Build] Allow shipping PTX on a per-file basis (#18155)

LucasWilkinson committed 1 year ago

Verified c7852a6d

[Bugfix] Fix test_eagle test (#18223)

luccafong committed 1 year ago

Verified 8795eb99

Adding "AMD: Tensorizer Test" to amdproduction. (#18216)

Alexei-V-Ivanov-AMD committed 1 year ago

Verified 0b345930

[Misc] Avoid cuda graph log when sizes still match (#18202)

NickLucche committed 1 year ago

Verified e3f3aee6

[Bugfix] [ROCm]: Remove assertion logic when using AITER fused moe in unquantizedMethod to reenable LLama4 BF16 (#18205)

tjtanaa committed 1 year ago

Verified 92540529

[Bugfix]Change the exception thrown by call_hf_processor from RuntimeError to ValueError (#18181)

Abatom committed 1 year ago

Verified fadb8d5c

[Frontend] Fix chat template content format detection (#18190)

schoennenbeck committed 1 year ago

Verified 2aa5470a

Improve examples rendering in docs and GitHub (#18203)

hmellor committed 1 year ago

Verified 51ff1546

Adding "Basic Models Test" and "Multi-Modal Models Test (Extended) 3" in AMD Pipeline (#18106)

Alexei-V-Ivanov-AMD committed 1 year ago

Verified 566ec04c

[Kernel] [V1] Fix performance regression for triton unified attention (#18161)

tdoublep committed 1 year ago

Verified 01c22335

add tools into TokenizeChatRequest (#18187)

hustxiayang committed 1 year ago

Verified 451da4bc

Update deprecated type hinting in `model_loader` (#18130)

hmellor committed 1 year ago

Verified 07ad2712

fix: typos (#18151)

omahs committed 1 year ago

Verified a9944aab

[V1] Update zmq socket creation in nixl connector (#18148)

russellb committed 1 year ago

Verified a8f5aec2

[CI] don't skip fixed `test_kv_cache_events()` (#18183)

davidxia committed 1 year ago

Verified de71fec8

[Bugfix] Fix FusedMoEPrepareAndFinalize for cuda-disalike backends (#18178)

MengqingCao committed 1 year ago

Verified 70f8b967

[Model] Allow the use of sliding window in Qwen2 (#17772)

inkcherry committed 1 year ago

Verified dd2a9459

[UT] Add ut for none hash (#17892)

andyxning committed 1 year ago

Verified 420caf75

Support custom implementations of VideoLoader backends. (#18091)

huachenheli committed 1 year ago

Verified 4f07a640

[Bugfix] Fix fp8 tests for triton_unified_attention for Triton 3.3 (#18013)

tdoublep committed 1 year ago

Verified e6b8e65d

Update deprecated type hinting in `models` (#18132)

hmellor committed 1 year ago

Verified 26d04193

[Fix][ROCm] Enforce eager for all encoder-decoder models on ROCm (#18154)

ProExpertProg committed 1 year ago

Verified 83f74c69

[Misc] add lobe-chat support (#18177)

reidliu41 committed 1 year ago

Verified 2dff0935

[Chore] astral's ty (#18116)

aarnphm committed 1 year ago

Verified afe3236e

[V1][Metrics] Remove unused code (#18158)

markmc committed 1 year ago

Verified 65334ef3

[v1] Support multiple KV cache groups in GPU model runner (#17945)

heheda12345 committed 1 year ago

Verified e60f550b

[Bugfix]: make most of `test_openai_schema.py` pass (#17664)

davidxia committed 1 year ago

Verified f25e0d11

Upload vllm index for the rc builds (#18173)

atalman committed 1 year ago

Verified 09f106a9

[V1] Support multiple kv connectors (#17564)

mgoin committed 1 year ago

Verified 2142035b

Newer Older