vllm
online fp8 quant with streaming weight post-processing
#29196

Merged

online fp8 quant with streaming weight post-processing #29196

robertgshaw2-redhat merged 1 commit into vllm-project:main from vkuzo:20251121_fp8_online_quant_hack

vkuzo requested a review from

mgoin 19 days ago

vkuzo requested a review from

robertgshaw2-redhat 19 days ago

vkuzo requested a review from

tlrmchlsmth 19 days ago

vkuzo requested a review from

yewentao256 19 days ago

vkuzo requested a review from

pavanimajety 19 days ago

chatgpt-codex-connector commented on 2025-11-21

gemini-code-assist commented on 2025-11-21

vkuzo force pushed from 53268927 to 9583e3bf 19 days ago

vkuzo force pushed from 9583e3bf to 89563640 14 days ago

vkuzo changed the title ~~[not for land] online fp8 quant with streaming weight post-processing~~ online fp8 quant with streaming weight post-processing 14 days ago

robertgshaw2-redhat added ready

kylesayrs approved these changes on 2025-12-03

[not for land] online fp8 quant with streaming weight post-processing

427f05d2

vkuzo force pushed from fda3623c to 427f05d2 6 days ago

robertgshaw2-redhat approved these changes on 2025-12-08

robertgshaw2-redhat enabled auto-merge (squash) 2 days ago

robertgshaw2-redhat merged 0d402d26 into main 2 days ago

Reviewers

robertgshaw2-redhat

kylesayrs

chatgpt-codex-connector

gemini-code-assist

mgoin

tlrmchlsmth

yewentao256

pavanimajety

Assignees

No one assigned

Labels

ready

Milestone

No milestone

vllm online fp8 quant with streaming weight post-processing #29196 Merged

online fp8 quant with streaming weight post-processing #29196

vllm
online fp8 quant with streaming weight post-processing
#29196

Merged