vllm-project/vllm

Pull Requests Commits

Mock gguf in doc build

simon-mo committed 1 year ago

Verified 1db4b78a

[Bugfix] Fused MoE Modular Kernel chunking loop (#20392)

varun-sundar-rabindranath committed 1 year ago

Verified fdadb6f4

[Core] Add Support for Default Modality Specific LoRAs [generate / chat completions] (#19126)

alex-jw-brooks committed 1 year ago

Verified 41060c6e

[Bugfix] Remove assertion of expert_map being None (#20714)

minosfuture committed 1 year ago

Verified 3de2ed76

[CI] Fix pre commit issue (#20782)

yewentao256 committed 1 year ago

Verified 299252ea

[V0][V1][Core] Add outlines integration for V1, and update V0 integration. (#15975)

unaidedelf8777 committed 1 year ago

Verified d6902ce7

[Bugfix] [CI] Fix Tensorizer LoRA test (#20760)

sangstar committed 1 year ago

Verified 5e53c89a

[Test] Remove docker build from test. (#20542)

QiliangCui committed 1 year ago

Verified c66e38ea

Fix DeepSeek-R1-0528 chat template (#20717)

sfbemerk committed 1 year ago

Verified 25159536

[Model][VLM] Support JinaVL Reranker (#20260)

shineran96 committed 1 year ago

Verified 4bed1677

[Model] Add reason parser for Hunyuan A13B Model. (#20625)

kzjeef committed 1 year ago

Verified b140416a

[ROCm][Regression] Remove tensor creation that harms performance on ROCm (#20741)

gshtras committed 1 year ago

Verified 5b8366b6

[Hardware][CPU] Vllm int8 quantization enablement for ARM CPU (#14129)

nishith-fujitsu committed 1 year ago

Verified c7753a98

Update Dockerfile FlashInfer to v0.2.8rc1 (#20718)

mgoin committed 1 year ago

Verified 4b9a9435

[Doc] Add engine args back in to the docs (#20674)

hmellor committed 1 year ago

Verified 3482fd7e

[Misc] Clean up mark to fork process in BNB tests (#20692)

Isotr0py committed 1 year ago

Verified 77f77a95

Normalize lm-eval command between baseline and correctness test (#18560)

mgoin committed 1 year ago

Verified 1a4f35e2

[CI Bugfix] Skip failing Tensorizer+LoRA test (#20724)

mgoin committed 1 year ago

Verified be1e128d

[doc] fix ordered list (#20749)

reidliu41 committed 1 year ago

Verified 65393ee0

[Bugfix][Build][Non-CUDA] Only referencing CMAKE_CUDA_COMPILER_VERSION on CUDA where it is defined (#20738)

gshtras committed 1 year ago

Verified dc221ad7

[CI/Build] Fix Basic Models Test (#20728)

jeejeelee committed 1 year ago

Verified 7571a4a7

[Misc] loose new-model tagger conditions (#20747)

Isotr0py committed 1 year ago

Verified f67d986d

[KVConnector] Aggregate finished requests on the scheduler (#19555)

orozery committed 1 year ago

Verified cc876d0f

[TPU][Core]Make load weight exceed hbm error more instructive for customers (#20644)

Chenyaaang committed 1 year ago

Verified fdfd409f

[BugFix] Fix `VllmConfig()` construction on all platforms (#20695)

njhill committed 1 year ago

Verified ffbcc9e7

[BugFix][CPU] Fix CPU worker dependency on cumem_allocator (#20696)

njhill committed 1 year ago

Verified 59389c92

[Frontend] Support Tool Calling with both `tool_choice='required'` and `$defs`. (#20629)

chaunceyjiang committed 1 year ago

Verified 8f2720de

Correct PPMissingLayer handling in Deepseek-V2-Lite PP deployment (#20665)

eicherseiji committed 1 year ago

Verified ad6c2e1a

Use NVCC `--compress-mode` to reduce binary size by 30% (#20694)

mgoin committed 1 year ago

Verified 49e8c7ea

[Misc] DP : Add ExpertTokensMetadata (#20332)

varun-sundar-rabindranath committed 1 year ago

Verified 805d62ca

Older