microsoft/DeepSpeed

Pull Requests Commits

Merge branch 'master' into loadams/amd-pre-compile

loadams committed 1 year ago

Verified 0e88c5c0

Update torch1.9 tests to 1.10 to match latest accelerate. (#4126)

loadams committed 1 year ago

Verified ff7d5275

Update nightly workflows to open an issue if CI fails (#3952)

loadams committed 1 year ago

Verified 0c75f4a3

Add ops (#4119)

loadams committed 1 year ago

Verified d300517f

Fix Issue 4083 (#4084)

jomayeri committed 1 year ago

Verified 8a8683d3

enable pipeline checkpoint loading mode (#3629)

leiwen83 committed 1 year ago

Verified 1e0c39c6

add deepspeed chat arxiv report (#4110)

conglongli committed 1 year ago

Verified 78d985ab

Pass correct node size for ZeRO++ (#4085)

cmikeh2 committed 1 year ago

Verified f0463b4d

Disable z3 tracing profiler (#4106)

tjruwase committed 1 year ago

Verified 977254c1

use correct ckpt path when base_dir not available (#4101)

polisettyvarma committed 1 year ago

Verified abe293b4

set temperature to avoid config validation error (#4107)

mrwyattii committed 1 year ago

Verified 975bcbc0

add type checker ignore to resolve that pylance can't resolved noqa annotation (#4102)

EeyoreLee committed 1 year ago

Verified 57a27b08

zero_to_fp32 script adds support for tag argument (#4089)

EeyoreLee committed 1 year ago

Verified 241ae39a

update ut/doc for glm/codegen (#4057)

inkcherry committed 1 year ago

Verified 85dc854b

fix typo: change polciies to policies (#4090)

digger-yu committed 1 year ago

Verified 4cde5da8

Spread layers more uniformly when using partition_uniform (#4053)

marcobellagente93 committed 1 year ago

Verified e8318634

Fix Stable Diffusion Injection (#4078)

lekurile committed 1 year ago

Verified 1ba40989

unpin datasets in UT (#4079)

mrwyattii committed 1 year ago

Verified a7fe3bcc

Switch to using version from dockerfile

loadams committed 1 year ago

aa0447ac

Merge branch 'master' into loadams/amd-pre-compile

loadams committed 1 year ago

2711badd

Refactor autoTP inference for HE (#4040)

molly-smith committed 1 year ago

Verified 94c7233a

fix: remove unnessary `#` punct in the second `sed` command (#4061)

hughpu committed 1 year ago

Verified e31b4041

add reproducible compilation environment (#3943)

fecet committed 1 year ago

Verified f763b93d

save_non_zero_checkpoint on first partition group (#3787)

zarzen committed 1 year ago

Verified 8a63754b

Fix deadlock when SHM based allreduce spin too fast (#4048)

delock committed 1 year ago

Verified 82c498d9

Multiple zero stage 3 related fixes (#3886)

tjruwase committed 1 year ago

Verified 7f90ef4b

faster allreduce with omp parallel for reduce kernel (#4049)

delock committed 1 year ago

Verified 7f26bb6a

autoTP for fused qkv weight (#3844)

inkcherry committed 1 year ago

Verified 6b877d2d

enable autoTP for MPT (#3861)

sywangyi committed 1 year ago

Verified 0bafeac4

fix opt-350m shard loading issue in AutoTP (#3600)

sywangyi committed 1 year ago

Verified 76953a37

Older