DeepSpeed
Preserve tensor learning rates across scheduler updates
#8202

Merged

Commits

Preserve tensor learning rates in schedulers

n33levo committed 92 days ago
Preserve tensor base LRs in cosine scheduler

n33levo committed 92 days ago

Loading