DeepSpeed
Optimize zero3 fetch params using all_reduce
#5420
Merged
Overview
Commits
5
Changes
View On GitHub
Commits
  • Optimize zero3 fetch params using all_reduce
    deepcharm committed 1 year ago
  • Merge branch 'master' into use-all-reduce-for-fetch-params
    loadams committed 1 year ago
  • Merge branch 'master' into use-all-reduce-for-fetch-params
    tjruwase committed 1 year ago
  • Merge branch 'master' into use-all-reduce-for-fetch-params
    loadams committed 1 year ago
  • Merge branch 'master' into use-all-reduce-for-fetch-params
    deepcharm committed 1 year ago
FAQ Terms Privacy Refunds Impressum
Loading