microsoft/DeepSpeed

Pull Requests Commits

Merge branch 'master' into fix-injection

RezaYazdaniAminabadi committed 1 year ago

Verified 542a1879

Refactor the injection to accept policy when using kernels

Reza Yazdani committed 1 year ago

9e8fa35d

Add check that opening issues on CI failure requires schedule (#4242)

loadams committed 1 year ago

Verified c93e89a3

Checks for user injection policy (#3052)

satpalsr committed 1 year ago

Verified 430510bf

Allow modification of zero partitioned parameters (#4192)

tjruwase committed 1 year ago

Verified a23cda6c

Pin Triton version to >=2.0.0 and <2.1.0 (#4251)

lekurile committed 1 year ago

Verified f96c1c0a

Update README.md (#4244)

awan-10 committed 1 year ago

Verified 844eb685

DeepSpeed-Chat Llama2/stability release (#4240)

awan-10 committed 1 year ago

Verified 2420e23f

Add Mixed Precision ZeRO++ tutorial (#4241)

HeyangQin committed 1 year ago

Verified 69e89dd5

jeffra committed 1 year ago

dc7b65f6

Enable hpz when running with torch.no_grad (#4232)

HeyangQin committed 1 year ago

Verified 462def45

fix MegatronLayerPolicy to be compatible with the newest ParallelTransformerLayer (#4236)

Dino Chen committed 1 year ago

Verified 6cbf6661

Enable AMD MI200 and H100 to run on branches for testing (#4238)

loadams committed 1 year ago

Verified 5dbc5313

fix: linker issues in conda environments #3929 (#4235)

maximegmd committed 1 year ago

Verified 194b0043

Empty tensor size check (#4186)

jomayeri committed 1 year ago

Verified 57d629a1

added port argument for ssh (#4117)

Hiromasa-H committed 1 year ago

Verified 8145b5e4

Fix fused qkv sizing for bloom (#4161)

molly-smith committed 1 year ago

Verified 042115c8

add npu support dtypes (#4223)

CurryRice233 committed 1 year ago

Verified 60d7b0a3

feat(activation_checkpointing): add `non_reentrant_checkpoint` to support inputs require no grad (#4118)

hughpu committed 1 year ago

Verified 42c1e916

Fix pipline dataloader when batch elements contain tuple (#565)

ghosthamlet committed 1 year ago

Verified c69bd1f7

Fixes timer error referenced in #4212 (#4213)

bjoernpl committed 1 year ago

Verified 0b7a760c

add meta onDevice support for LLAMA2 (#4147)

Dino Chen committed 1 year ago

Verified 0712e299

Simplify Gradient Attribute Names (#4214)

jomayeri committed 1 year ago

Verified f6903190

Add MuP optimizers (#2043)

mrwyattii committed 1 year ago

Verified 9647ea79

add ulysses blog index (#4215)

conglongli committed 1 year ago

Verified d6c2e6b0

DeepSpeed Ulysses Chinese blog translation (#4210)

HeyangQin committed 1 year ago

Verified 63e17769

Add Japanese blog of DS-Ulysses (#4209)

tohtana committed 1 year ago

Verified 3808273c

Update README.md (#4211)

samadejacobs committed 1 year ago

Verified c274e512

Update Ulyssess (#4205)

samadejacobs committed 1 year ago

Verified 10bef7ac

DS-Ulysses formating (#4204)

samadejacobs committed 1 year ago

Verified 961827be

Older