accelerate
[TP] Keep optimizer state aligned after parameter swaps
#4141
Open
Overview
Commits
1
Changes
View On GitHub

[TP] Keep optimizer state aligned after parameter swaps #4141

sdjasj wants to merge 1 commit into huggingface:main from sdjasj:agent/fix-tp-adagrad-state
sdjasj
sdjasj Keep optimizer state aligned after TP parameter swaps
1f16385b
sdjasj sdjasj marked this pull request as ready for review 3 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum