vllm-project/vllm

Pull Requests Commits

[V1] Support interleaved modality items (#15605)

ywang96 committed 1 year ago

Verified c67abd61

[Feature][Disaggregated] Support XpYd disaggregated prefill with MooncakeStore (#12957)

ShangmingCai committed 1 year ago

Verified 6fa7cd3d

[V1] [Feature] Collective RPC (#15444)

wwl2755 committed 1 year ago

Verified 94744ba4

[FEAT] [ROCm] Add AITER int8 scaled gemm kernel (#15433)

tjtanaa committed 1 year ago

Verified 4965ec42

[doc] update doc (#15740)

reidliu41 committed 1 year ago

Verified 73aa7041

[Kernel][TPU][ragged-paged-attn] vLLM code change for PR#8896 (#15659)

yarongmu-google committed 1 year ago

Verified 7c1f7600

[TPU][V1][Bugfix] Fix w8a8 recompiilation with GSM8K (#15714)

NickLucche committed 1 year ago

Verified da461f3c

[Bugfix] set VLLM_WORKER_MULTIPROC_METHOD=spawn for vllm.entrypoionts.openai.api_server (#15700)

jinzhen-lin committed 1 year ago

Verified 5b800f09

Use numba 0.61 for python 3.10+ to support numpy>=2 (#15692)

cyyever committed 1 year ago

Verified 8427f704

[CI] Speed up V1 structured output tests (#15718)

russellb committed 1 year ago

Verified 7a799208

[Bugfix] LoRA V1: add and fix entrypoints tests (#15715)

varun-sundar-rabindranath committed 1 year ago

Verified 1286211f

[Misc][V1] Misc code streamlining (#15723)

njhill committed 1 year ago

Verified 6d531ad7

[Docs] Document v0 engine support in reasoning outputs (#15739)

gaocegege committed 1 year ago

Verified 762b424a

[Model] Support Skywork-R1V (#15397)

pengyuange committed 1 year ago

Verified de1cb387

[ROCm][AMD][Build] Update AMD supported arch list (#15632)

gshtras committed 1 year ago

Verified c802f543

[Docs][V1] Optimize diagrams in prefix caching design (#15716)

simpx committed 1 year ago

Verified cff8991a

implement prometheus fast-api-instrumentor for http service metrics (#15657)

daniel-salib committed 1 year ago

Verified f3f8d8ff

[Misc] cli auto show default value (#15582)

reidliu41 committed 1 year ago

Verified 26df46ee

[V1] TPU - Fix the chunked prompt bug (#15713)

alexm-redhat committed 1 year ago

Verified c3f687ac

[Bugfix] [torch.compile] Add Dynamo metrics context during compilation (#15639)

ProExpertProg committed 1 year ago

Verified 04437e31

[TPU] [Perf] Improve Memory Usage Estimation (#15671)

robertgshaw2-redhat committed 1 year ago

Verified 038beded

[Misc] Remove stale func in KVTransferConfig (#14746)

ShangmingCai committed 1 year ago

Verified d03308be

[Misc] Remove unused utils and clean up imports (#15708)

DarkLight1337 committed 1 year ago

Verified c6bc0034

[Minor] Remove TGI launching script (#15646)

WoosukKwon committed 1 year ago

Verified 70e13224

Fix cpu offload testing for gptq/awq/ct (#15648)

mgoin committed 1 year ago

Verified 47e9038d

[Bugfix] Fix regex compile display format (#15368)

kebe7jun committed 1 year ago

Verified 432cf22a

[doc] add missing imports (#15699)

reidliu41 committed 1 year ago

Verified 2914006f

[V1] Support disable_any_whtespace for guidance backend (#15584)

russellb committed 1 year ago

Verified 7329ff54

[Bugfix] `embed_is_patch` for Idefics3 (#15696)

DarkLight1337 committed 1 year ago

Verified 541d1df4

[Bugfix][v1] xgrammar structured output supports Enum. (#15594)

chaunceyjiang committed 1 year ago

Verified 3b00ff91

Newer Older