transformers
Fix GatedDeltaNet A_log dtype to prevent -inf under bfloat16 init
#47944
Merged
Merged
Fix GatedDeltaNet A_log dtype to prevent -inf under bfloat16 init #47944
Rocketknight1
merged
5 commits into
huggingface:main
from
Nkluge-correa:fix/gdn-a-log-bf16-init
Fix GatedDeltaNet A_log dtype to prevent -inf under bfloat16 init
9a28e78a
Rocketknight1
commented
on 2026-08-13
Simplify A_log init fix: bump uniform_ lower bound instead of float32…
2b4fa862
Merge branch 'huggingface:main' into fix/gdn-a-log-bf16-init
5ed425db
Merge branch 'main' into fix/gdn-a-log-bf16-init
d9fd8939
Merge branch 'huggingface:main' into fix/gdn-a-log-bf16-init
e806cfdd
Rocketknight1
approved these changes
on 2026-08-14
Login to write a write a comment.
Login via GitHub