DeepSpeed
Fix bf16 dtype mismatch in ZeRO-3 with zero_quantized_weights
#7792

Open

Fix bf16 dtype mismatch in ZeRO-3 with zero_quantized_weights #7792

juyterman1000 wants to merge 5 commits into deepspeedai:master from juyterman1000:fix/bf16-zero3-quantized-weights

juyterman1000 requested a review from

tjruwase 144 days ago

juyterman1000 requested a review from

tohtana 144 days ago

juyterman1000 force pushed from 8f820045 to 1c95ade3 144 days ago

PKUWZP requested a review from

PKUWZP 144 days ago

juyterman1000 requested a review from

loadams 143 days ago

juyterman1000 force pushed from ffd54561 to 27359208 143 days ago

juyterman1000 force pushed from 27359208 to e25d8f1a 143 days ago

juyterman1000 force pushed from e25d8f1a to 72da75fa 143 days ago

juyterman1000 force pushed from 1f94bc78 to 72da75fa 143 days ago

juyterman1000 force pushed from 72da75fa to a770a374 143 days ago

juyterman1000 force pushed from a770a374 to 377b76b9 142 days ago

juyterman1000 force pushed from 377b76b9 to 83bd5d19 142 days ago

Fix bf16 dtype mismatch in ZeRO-3 with zero_quantized_weights

3940f49d

juyterman1000 force pushed from 83bd5d19 to 3940f49d 142 days ago

juyterman1000 force pushed from 90ae56e7 to 3940f49d 136 days ago

Fix formatting and linting violations in ZeRO-3 bf16 fix

c376a985

Merge branch 'master' into fix/bf16-zero3-quantized-weights

66076da8

tjruwase commented on 2026-03-01

Merge branch 'master' into fix/bf16-zero3-quantized-weights

3d0c53c4

Merge branch 'master' into fix/bf16-zero3-quantized-weights

a004b497

Reviewers

tjruwase

tohtana

PKUWZP

loadams

Assignees

No one assigned

Labels

None yet

Milestone

No milestone