Fix NaN weights on non-rank-0 FSDP processes #45050
albertvillanova
wants to merge
4 commits into
huggingface:main
from
albertvillanova:fix-trl-5386
Init with zeros instead of empty in _move_missing_keys_from_meta_to_d…
8348bdad
Merge remote-tracking branch 'upstream/main' into fix-trl-5386
3377c263
Merge branch 'main' into fix-trl-5386
8df64e45
Merge branch 'main' into fix-trl-5386
d155605a
ArthurZucker
approved these changes
on 2026-04-02
Login to write a write a comment.
Login via GitHub