vllm-project/vllm

Pull Requests Commits

WoosukKwon committed 43 days ago

0fa97479

Merge branch 'main' into woosuk-hybrid-mem

WoosukKwon committed 43 days ago

8359f838

WoosukKwon committed 43 days ago

13274da4

WoosukKwon committed 43 days ago

fbfe9f23

[Hardware] Add processor inputs to platform validation (#16680)

joerunde committed 43 days ago

Verified e1b00483

Merge branch 'main' into woosuk-hybrid-mem

WoosukKwon committed 43 days ago

8221c64c

WoosukKwon committed 43 days ago

c4547656

[Model] support modernbert (#16648)

xsank committed 43 days ago

Verified ee378f3d

WoosukKwon committed 43 days ago

3e97ae4d

[Bugfix][Kernel] fix potential cuda graph broken for merge_attn_states kernel (#16693)

DefTruth committed 43 days ago

Verified e82ee40d

[Doc] Improve OOM troubleshooting (#16704)

DarkLight1337 committed 43 days ago

Verified facbe2a1

[Misc] refactor examples series (#16708)

reidliu41 committed 43 days ago

Verified 71689204

[CI] Cleanup `additional_dependencies: [toml]` for pre-commit yapf hook (#16405)

yankay committed 43 days ago

Verified 21378a23

WoosukKwon committed 43 days ago

7d9e93b3

WoosukKwon committed 43 days ago

ea4bc011

WoosukKwon committed 43 days ago

f91b50fa

WoosukKwon committed 43 days ago

44c3d859

WoosukKwon committed 43 days ago

2cdcd222

[V1][Structured Output] Move xgrammar related utils to `backend_xgrammar.py` (#16578)

shen-shanshan committed 43 days ago

Verified 976711d9

[ROCM] Bind triton version to 3.2 in requirements-built.txt (#16664)

SageMoore committed 43 days ago

Verified 44fa4d55

[Feature] add model aware kv ops helper (#16020)

billishyahao committed 43 days ago

Verified 3ac98edc

Disable remote caching when calling compile_fx (#16611)

zou3519 committed 43 days ago

Verified 966c742e

[Misc] Modify LRUCache touch (#16689)

jeejeelee committed 44 days ago

Verified 0d7d05f4

[Bugfix] fix gpu docker image mis benchmarks dir (#16628)

lengrongfu committed 44 days ago

Verified 96bb8aa6

[Model] Add PLaMo2 (#14323)

Alnusjaponica committed 44 days ago

Verified 3badb021

[Misc] Enable vLLM to Dynamically Load LoRA from a Remote Server (#10546)

angkywilliam committed 44 days ago

Verified fdcb850f

Merge branch 'main' into woosuk-hybrid-mem

WoosukKwon committed 44 days ago

41b7d5d7

[Misc] Update `compressed-tensors` WNA16 to support zero-points (#14211)

dsikka committed 44 days ago

Verified 54a66e5f

[Kernel] Remove redundant Exp calculations (#16123)

DefTruth committed 44 days ago

Verified 280d62b8

Add "/server_info" endpoint in api_server to retrieve the vllm_config. (#16572)

Cangxihui committed 44 days ago

Verified 1666e664

Older