deepspeedai/DeepSpeed

Pull Requests Commits

Fix typo in model name

loadams committed 1 year ago

b2cde988

Merge branch 'master' into olruwase/windows_blog

loadams committed 1 year ago

Verified 6c0b6353

Pin transformers version on nv-nightly (#6002)

loadams committed 1 year ago

Verified ba0ab713

loadams committed 1 year ago

79a7cf42

loadams committed 1 year ago

cf601713

Update formatting/spelling

loadams committed 1 year ago

81c79e35

tjruwase committed 1 year ago

e948a390

tjruwase committed 1 year ago

4aca0da9

Merge conflicts

tjruwase committed 1 year ago

4411fcc6

Merge branch 'master' into olruwase/windows_blog

tjruwase committed 1 year ago

Verified 4d29bb58

tjruwase committed 1 year ago

47e539bb

Add pip install image

tjruwase committed 1 year ago

dcde7581

DeepNVMe GDS (#5852)

jomayeri committed 1 year ago

Verified 5f0d177f

Add and Remove ZeRO 3 Hooks (#5658)

jomayeri committed 1 year ago

Verified c2e3a706

Enable dynamic shapes for pipeline parallel engine inputs (#5481)

tohtana committed 1 year ago

Verified 1ab1928d

Move inf_or_nan_tracker to cpu for cpu offload (#5826)

BacharL committed 1 year ago

Verified 4d4ff0ed

add moe topk(k>2) gate support (#5881)

inkcherry committed 1 year ago

Verified 9a3ede70

move pynvml install to setup.py (#5840)

Rohan138 committed 1 year ago

Verified 30428d03

Update version.txt after 0.14.5 release (#5982)

loadams committed 1 year ago

Verified 3f6df9a2

Allow accelerator to instantiate the device (#5255)

nelyahu committed 1 year ago

Verified eb07d41f

Update xpu-max1100.yml with new config and add some tests (#5668)

Liangliang-Ma committed 1 year ago

Verified 4ba49dda

Z3: optimizations for grad norm calculation and gradient clipping (#5504)

nelyahu committed 1 year ago

Verified 6eed634e

Add accelerator setup guides (#5827)

delock committed 1 year ago

Verified 19b01e1d

HPUAccelerator: remove support in set_visible_devices_envs (#5929)

nelyahu committed 1 year ago

Verified a8d1b44d

Update LR scheduler configuration (#5846)

xiyang-aads-lilly committed 1 year ago

Verified f994fb2c

Fix missing ds_id bug (#5824)

tjruwase committed 1 year ago

Verified e3177de6

Update container version for Gaudi2 CI (#5937)

raza-sikander committed 1 year ago

Verified 051c9933

[Zero2] Reduce the unnecessary all-reduce when tensor size is 0. (#5868)

ys950902 committed 1 year ago

Verified 24d1d86b

Use `torch.nan_to_num` replace numpy wrapper one (#5877)

jinyouzhi committed 1 year ago

Verified 862aff37

Log operator warnings only in verbose mode (#5917)

tjruwase committed 1 year ago

Verified 0f2d485c

Older