microsoft/DeepSpeed

Pull Requests Commits

Add venv to .gitignore (#7605)

zhengchenyu committed 1 year ago

Verified 177c25c9

Add blog for SuperOffload (#7594)

xylian86 committed 1 year ago

Verified 462d28c5

DeepCompile: Fuse allgather and downcast (#7588)

eternalNight committed 1 year ago

Verified 4efd7eca

DeepCompile: Specify tensor aliasing in C++ op schema (#7597)

eternalNight committed 1 year ago

Verified 6fcccfa2

Fixed the problem of loading universal checkpoint error in multi-machine mode. (#7601)

zhengchenyu committed 1 year ago

Verified 47b3fb5e

Change current_device() to current_device_name() (#7600)

delock committed 1 year ago

Verified 66c70312

Fix the universal checkpoint issue for stage3 when there are multiple subgroups. (#7585)

zhengchenyu committed 1 year ago

Verified 91d14527

Simplify leaf module hook (#7592)

tohtana committed 1 year ago

Verified 6ea345ae

disables ZeRO checkpoint loading path when stage=0 (#7586)

therealnaveenkamal committed 1 year ago

Verified b7565400

Include init file for superoffload folder (#7591)

nguyen599 committed 1 year ago

Verified 16c1bf42

SuperOffload Release (#7559)

xylian86 committed 1 year ago

Verified af56ed4d

Deepcompile: Make size of activation to free configurable (#7582)

eternalNight committed 1 year ago

Verified 17d80ce4

Broadcast fp16 overflow in Z1 (#7580)

sfc-gh-truwase committed 1 year ago

Verified bc9ed477

Deepcompile: Fix bugs when applying deepcompile to VLA-like models (#7569)

eternalNight committed 1 year ago

Verified 8c7c56a9

logging: Also set log level of logger handlers (#7576)

eternalNight committed 1 year ago

Verified 35de2030

DeepCompile ZeRO-3: robust allgather for uneven shards; fix profiling… (#7489)

juyterman1000 committed 1 year ago

Verified 325c6c5e

Update version.txt post 0.17.6 release (#7572)

loadams committed 1 year ago

Verified 80033a82

[bugfix] fix partition context unpatch (#7566)

hjh0119 committed 1 year ago

Verified e4f6da96

scripts: Check .is_cuda only in non-C++ files (#7561)

eternalNight committed 1 year ago

Verified 6b731c5c

Make Muon optimizer easier to enable (#7555)

delock committed 1 year ago

Verified 2585881a

fix npu device_id AttributeError issue (#7560)

we1sper committed 1 year ago

Verified aa539c6d

deepcompile: Create a full list of no-copy ops (#7562)

eternalNight committed 1 year ago

Verified 2d84be81

deepcompile: Record graph order using OrderedDict (#7563)

eternalNight committed 1 year ago

Verified e9d5d416

deepcompile: Create dummy inputs using empty_strided (#7564)

eternalNight committed 1 year ago

Verified 660ee895

Add dependency for deepcompile test (#7558)

tohtana committed 1 year ago

Verified d40a0f5d

Move modal tests to tests/v1 (#7557)

tohtana committed 1 year ago

Verified b9bd03a2

Fix gradient buffer access for DeepCompile Z1/2 (#7548)

tohtana committed 1 year ago

Verified 0e859aa0

Limit random seed range in tests (#7553)

tohtana committed 1 year ago

Verified 0012ff6e

[MoE] Fix misuse of num_experts as expert parallel group size (ep_size) (#7551)

Flakes342 committed 1 year ago

Verified 8cbbbb53

[alstn tutorial] support bs>1 (#7550)

sfc-gh-sbekman committed 1 year ago

Verified 533e834b

Newer Older