PR #144 [Feature] Porting bitsandbytes to meg-deepspeed

Port bitsandbytes for meg-deepspeed

wade3han committed 4 years ago

Cleanup commit

wade3han committed 4 years ago

Add functional test

wade3han committed 4 years ago

fix test

stas00 committed 4 years ago

Merge remote-tracking branch 'origin/main' into feature/bnb-optimizer

stas00 committed 4 years ago

refactor the new test into the existing one

stas00 committed 4 years ago

fix args

stas00 committed 4 years ago

deal with custom optimizer

stas00 committed 4 years ago

more refactoring

stas00 committed 4 years ago

Megatron-DeepSpeed [Feature] Porting bitsandbytes to meg-deepspeed #144 Merged