accelerate
Enable FSDP & Deepspeed + FP8
#2983
Merged
Overview
Commits
22
Changes
View On GitHub
Commits
  • Working version rebased from main
    muellerzr committed 1 year ago
  • kwargs
    muellerzr committed 1 year ago
  • Clean
    muellerzr committed 1 year ago
  • Fix more nits
    muellerzr committed 1 year ago
  • Fin
    muellerzr committed 1 year ago
  • Delay autocast flag
    muellerzr committed 1 year ago
  • Enable FP8 autocast during eval only if specified
    muellerzr committed 1 year ago
  • Fin
    muellerzr committed 1 year ago
  • Rm comment
    muellerzr committed 1 year ago
  • All done
    muellerzr committed 1 year ago
  • Zero3 works!
    muellerzr committed 1 year ago
  • Let the wrapper come off during unwrap_model
    muellerzr committed 1 year ago
  • Add import check
    muellerzr committed 1 year ago
  • Migrate all to benchmarks folder and make TE import check work
    muellerzr committed 1 year ago
  • Add readme
    muellerzr committed 1 year ago
  • Add README to benchmarks folder
    muellerzr committed 1 year ago
  • Update CLI to now include fp8 args
    muellerzr committed 1 year ago
  • Add test config for 0_34
    muellerzr committed 1 year ago
  • Finish adding to config yaml
    muellerzr committed 1 year ago
  • Write docs
    muellerzr committed 1 year ago
  • Expound docs w/ FP8
    muellerzr committed 1 year ago
  • Add to toctree
    muellerzr committed 1 year ago
FAQ Terms Privacy Refunds Impressum
Loading