peft
FIX: Initialize DoRA weights in float32 if float16 is being used
#1653

Merged

FIX: Initialize DoRA weights in float32 if float16 is being used #1653

BenjaminBossan merged 1 commit into huggingface:main from BenjaminBossan:fix-dora-init-with-float16

FIX Init DoRA weights in float32 if float16 used

471ec4b2

BenjaminBossan requested a review from

pacman100 1 year ago

BenjaminBossan requested a review from

younesbelkada 1 year ago

younesbelkada approved these changes on 2024-04-29

BenjaminBossan merged e7b47ac0 into main 1 year ago

BenjaminBossan deleted the fix-dora-init-with-float16 branch 1 year ago

Reviewers

younesbelkada

pacman100

Assignees

No one assigned

Labels

None yet

Milestone

No milestone