vllm-project/vllm

Pull Requests Commits

tlrmchlsmth committed 1 year ago

ab153be2

[Bugfix] [CI] Fix Tensorizer LoRA test (#20760)

sangstar committed 1 year ago

Verified 5e53c89a

[Test] Remove docker build from test. (#20542)

QiliangCui committed 1 year ago

Verified c66e38ea

Fix DeepSeek-R1-0528 chat template (#20717)

sfbemerk committed 1 year ago

Verified 25159536

[Model][VLM] Support JinaVL Reranker (#20260)

shineran96 committed 1 year ago

Verified 4bed1677

[Model] Add reason parser for Hunyuan A13B Model. (#20625)

kzjeef committed 1 year ago

Verified b140416a

[ROCm][Regression] Remove tensor creation that harms performance on ROCm (#20741)

gshtras committed 1 year ago

Verified 5b8366b6

[Hardware][CPU] Vllm int8 quantization enablement for ARM CPU (#14129)

nishith-fujitsu committed 1 year ago

Verified c7753a98

Update Dockerfile FlashInfer to v0.2.8rc1 (#20718)

mgoin committed 1 year ago

Verified 4b9a9435

[Doc] Add engine args back in to the docs (#20674)

hmellor committed 1 year ago

Verified 3482fd7e

[Misc] Clean up mark to fork process in BNB tests (#20692)

Isotr0py committed 1 year ago

Verified 77f77a95

Normalize lm-eval command between baseline and correctness test (#18560)

mgoin committed 1 year ago

Verified 1a4f35e2

[CI Bugfix] Skip failing Tensorizer+LoRA test (#20724)

mgoin committed 1 year ago

Verified be1e128d

[doc] fix ordered list (#20749)

reidliu41 committed 1 year ago

Verified 65393ee0

[Bugfix][Build][Non-CUDA] Only referencing CMAKE_CUDA_COMPILER_VERSION on CUDA where it is defined (#20738)

gshtras committed 1 year ago

Verified dc221ad7

[CI/Build] Fix Basic Models Test (#20728)

jeejeelee committed 1 year ago

Verified 7571a4a7

[Misc] loose new-model tagger conditions (#20747)

Isotr0py committed 1 year ago

Verified f67d986d

[KVConnector] Aggregate finished requests on the scheduler (#19555)

orozery committed 1 year ago

Verified cc876d0f

[TPU][Core]Make load weight exceed hbm error more instructive for customers (#20644)

Chenyaaang committed 1 year ago

Verified fdfd409f

[BugFix] Fix `VllmConfig()` construction on all platforms (#20695)

njhill committed 1 year ago

Verified ffbcc9e7

[BugFix][CPU] Fix CPU worker dependency on cumem_allocator (#20696)

njhill committed 1 year ago

Verified 59389c92

[Frontend] Support Tool Calling with both `tool_choice='required'` and `$defs`. (#20629)

chaunceyjiang committed 1 year ago

Verified 8f2720de

Correct PPMissingLayer handling in Deepseek-V2-Lite PP deployment (#20665)

eicherseiji committed 1 year ago

Verified ad6c2e1a

Use NVCC `--compress-mode` to reduce binary size by 30% (#20694)

mgoin committed 1 year ago

Verified 49e8c7ea

[Misc] DP : Add ExpertTokensMetadata (#20332)

varun-sundar-rabindranath committed 1 year ago

Verified 805d62ca

[CI/Build] Fix FlashInfer double build in Dockerfile (#20651)

mgoin committed 1 year ago

Verified b7d9e941

[Misc] Simplify the prefix caching logic on draft tokens (#20701)

WoosukKwon committed 1 year ago

Verified 7c12a765

[BugFix]: Properly set engine_id when using multi connector (#19487)

Missmiaom committed 1 year ago

Verified cd587c93

[Feature][Quantization] MXFP4 support for MOE models (#17888)

fxmarty-amd committed 1 year ago

Verified 332d4cb1

[Kernel] Add Conch backend for mixed-precision linear layer (#19818)

jmanning-stackav committed 1 year ago

Verified bf03ff35

Older