vllm
[QeRL] Compose online quantization with quantized reloading
#38032
Merged
Overview
Commits
8
Changes
View On GitHub

[QeRL] Compose online quantization with quantized reloading #38032

vllm-bot merged 8 commits into vllm-project:main from neuralmagic:kylesayrs/online-quant-integration
kylesayrs
gemini-code-assist
gemini-code-assist commented on 2026-03-24
kylesayrs
gemini-code-assist
gemini-code-assist commented on 2026-03-25
kylesayrs kylesayrs force pushed 46 days ago
kylesayrs kylesayrs force pushed 46 days ago
kylesayrs kylesayrs marked this pull request as ready for review 46 days ago
kylesayrs kylesayrs requested a review from 22quinn 22quinn 46 days ago
kylesayrs kylesayrs requested a review from mgoin mgoin 46 days ago
kylesayrs kylesayrs requested a review from robertgshaw2-redhat robertgshaw2-redhat 46 days ago
kylesayrs kylesayrs requested a review from tlrmchlsmth tlrmchlsmth 46 days ago
kylesayrs kylesayrs requested a review from yewentao256 yewentao256 46 days ago
kylesayrs kylesayrs requested a review from pavanimajety pavanimajety 46 days ago
mgoin mgoin added ready
mgoin mgoin added quantization
vkuzo
vkuzo commented on 2026-03-25
vkuzo
vkuzo commented on 2026-03-25
vkuzo
vkuzo commented on 2026-03-25
vkuzo
vkuzo commented on 2026-03-25
vkuzo
vkuzo commented on 2026-03-25
vkuzo
vkuzo commented on 2026-03-25
vkuzo
vkuzo commented on 2026-03-25
vkuzo
vkuzo approved these changes on 2026-03-25
kylesayrs base implementation
51820475
kylesayrs fix typo
18bc45ef
kylesayrs cleaner
260ef0b1
kylesayrs Fix process bug, reduce scope of
37ed7a51
kylesayrs rename, cleanup
f5b7309d
kylesayrs simplify dummy loader changes
acf09599
kylesayrs kylesayrs force pushed to acf09599 46 days ago
kylesayrs comments, cleanup
d08a8c3e
kylesayrs kylesayrs changed the title Compose online quantization with quantized reloading [QeRL] Compose online quantization with quantized reloading 46 days ago
kylesayrs
kylesayrs commented on 2026-03-25
kylesayrs simplify initialize_dummy_weights
3dbbfa25
mgoin
mgoin approved these changes on 2026-03-27
vllm-bot vllm-bot merged 648edcf7 into main 44 days ago
jikunshang
jikunshang commented on 2026-03-28

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
ready quantization
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum