microsoft/DeepSpeed

Pull Requests Commits

Merge branch 'olruwase/override_module_apply' of github.com:microsoft/DeepSpeed into olruwase/override_module_apply

tjruwase committed 2 years ago

4f19b59c

tjruwase committed 2 years ago

1fd80f09

tjruwase committed 2 years ago

831dfb29

Merge branch 'master' into olruwase/override_module_apply

tjruwase committed 2 years ago

Verified 92d557f0

tjruwase committed 2 years ago

dc8e81ca

tjruwase committed 2 years ago

8cb2418b

faster allreduce with omp parallel for reduce kernel (#4049)

delock committed 2 years ago

Verified 7f26bb6a

autoTP for fused qkv weight (#3844)

inkcherry committed 2 years ago

Verified 6b877d2d

enable autoTP for MPT (#3861)

sywangyi committed 2 years ago

Verified 0bafeac4

fix opt-350m shard loading issue in AutoTP (#3600)

sywangyi committed 2 years ago

Verified 76953a37

fix comm logging for inference (#4043)

delock committed 2 years ago

Verified 0b507253

fix: Remove duplicate word the (#4051)

digger-yu committed 2 years ago

Verified 389bf693

Engine side fix for loading llama checkpoint fine-tuned with zero3 (#3981)

minjiaz committed 2 years ago

Verified 15f94ae7

polishing timers and log_dist (#3996)

Alexander Jipa committed 2 years ago

Verified b354c28b

Merge branch 'master' into olruwase/override_module_apply

tjruwase committed 2 years ago

Verified 3d93b25c

Merge branch 'master' into olruwase/override_module_apply

tjruwase committed 2 years ago

Verified c6cc44d5

tjruwase committed 2 years ago

e66a5c3f

fix(pipe): `strict` parameter of method `PipelineModule.load_state_dir` is not work (#4020)

hughpu committed 2 years ago

Verified 09601bb8

Monitored Loss Calculations (#4030)

jomayeri committed 2 years ago

Verified eeab613a

Remove print of weight parameter in RMS norm (#4031)

Puneesh Khanna committed 2 years ago

Verified ad661b8e

Merge branch 'master' into olruwase/override_module_apply

tjruwase committed 2 years ago

Verified afa4a032

Pass missing positional arguments in `DeepSpeedHybridEngine.generate()` (#4026)

XuehaiPan committed 2 years ago

Verified 43188ff0

Merge branch 'olruwase/override_module_apply' of github.com:microsoft/DeepSpeed into olruwase/override_module_apply

tjruwase committed 2 years ago

dd6f334a

Handle missed params

tjruwase committed 2 years ago

fcb3bad4

remove duplicate check for pp and zero stage (#4033)

inkcherry committed 2 years ago

Verified e8600b7f

Merge branch 'master' into olruwase/override_module_apply

tjruwase committed 2 years ago

Verified 7a0c339d

[CPU] FusedAdam and CPU training support (#3991)

delock committed 2 years ago

Verified 0f540632

Adapt unit test to succeed

tjruwase committed 2 years ago

2343cfe5

Merge branch 'master' into olruwase/override_module_apply

tjruwase committed 2 years ago

Verified 0f5a5087

[zero_to_fp32] 3x less cpu memory requirements (#4025)

stas00 committed 2 years ago

Verified 1cc9caa9

Older