accelerate
Tweak defaults for quantized-typed FP8 TE weights
#3018

Merged

Tweak defaults for quantized-typed FP8 TE weights #3018

muellerzr merged 3 commits into main from tweak-fp8-defaults

Tweak defaults

b324b2f8

Can't forget about CLI

0795a506

muellerzr requested a review from

BenjaminBossan 2 years ago

BenjaminBossan approved these changes on 2024-08-16

Update docs

880801d2

muellerzr merged 7ec8eab9 into main 2 years ago

muellerzr deleted the tweak-fp8-defaults branch 2 years ago

Reviewers

BenjaminBossan

Assignees

No one assigned

Labels

None yet

Milestone

No milestone