DeepSpeed
Automatic tensor parallelism v2
#2670
Merged

Commits
  • loop through pipe.model
    molly-smith committed 3 years ago
  • tp_parser first draft
    molly-smith committed 3 years ago
  • client_module must be type object
    molly-smith committed 3 years ago
  • Simplify layernorm tracking. Add unittest.
    molly-smith committed 3 years ago
  • cleanup
    molly-smith committed 3 years ago
  • Add more models to unittest
    molly-smith committed 3 years ago
  • cleanup inference pytest for merging
    molly-smith committed 3 years ago
  • Merge branch 'master' into mosm/tp2
    molly-smith committed 3 years ago
  • Add unittest
    molly-smith committed 3 years ago
  • cleanup
    molly-smith committed 3 years ago
  • pre-commit
    molly-smith committed 3 years ago
  • unittest id and pytest marker
    molly-smith committed 3 years ago
  • try marian for unittest
    molly-smith committed 3 years ago
  • precommit
    molly-smith committed 3 years ago
  • Move tp code to seperate file
    molly-smith committed 3 years ago
  • Add new auto tp file
    molly-smith committed 3 years ago
  • pre-commit and type
    molly-smith committed 3 years ago
  • Update deepspeed/module_inject/auto_tp.py
    molly-smith committed 3 years ago
  • Update deepspeed/module_inject/auto_tp.py
    molly-smith committed 3 years ago
  • Update tests/unit/inference/test_inference.py
    molly-smith committed 3 years ago
  • remove unused fillmask function
    molly-smith committed 3 years ago
  • Merge branch 'master' into mosm/tp2
    molly-smith committed 3 years ago
Loading