microsoft/DeepSpeed

Pull Requests Commits

Merge branch 'master' into jomayeri/issue-4095

jomayeri committed 2 years ago

Verified 0875f8db

Fix pipline dataloader when batch elements contain tuple (#565)

ghosthamlet committed 2 years ago

Verified c69bd1f7

jomayeri committed 2 years ago

52e04728

Merge branch 'master' into jomayeri/issue-4095

jomayeri committed 2 years ago

Verified de64b7b8

Fixes timer error referenced in #4212 (#4213)

bjoernpl committed 2 years ago

Verified 0b7a760c

jomayeri committed 2 years ago

501d2ec1

add meta onDevice support for LLAMA2 (#4147)

Dino Chen committed 2 years ago

Verified 0712e299

Simplify Gradient Attribute Names (#4214)

jomayeri committed 2 years ago

Verified f6903190

Merge branch 'master' into jomayeri/issue-4095

jomayeri committed 2 years ago

Verified 0a08eb61

Add MuP optimizers (#2043)

mrwyattii committed 2 years ago

Verified 9647ea79

add ulysses blog index (#4215)

conglongli committed 2 years ago

Verified d6c2e6b0

DeepSpeed Ulysses Chinese blog translation (#4210)

HeyangQin committed 2 years ago

Verified 63e17769

Add Japanese blog of DS-Ulysses (#4209)

tohtana committed 2 years ago

Verified 3808273c

Merge branch 'master' into jomayeri/issue-4095

jomayeri committed 2 years ago

Verified d2ca7579

Update README.md (#4211)

samadejacobs committed 2 years ago

Verified c274e512

Update Ulyssess (#4205)

samadejacobs committed 2 years ago

Verified 10bef7ac

DS-Ulysses formating (#4204)

samadejacobs committed 2 years ago

Verified 961827be

[docs] fix pypi badge

jeffra committed 2 years ago

Verified 3e82cb64

Ds ulysses news (#4202)

samadejacobs committed 2 years ago

Verified 5de0662c

Deepspeed-Ulysses blog (#4201)

samadejacobs committed 2 years ago

Verified 4e5d39fe

DeepSpeed Ulysses release (#4198)

samadejacobs committed 2 years ago

Verified a855405e

jomayeri committed 2 years ago

496b6a25

Load z3 checkpoints for inference (#4171)

tjruwase committed 2 years ago

Verified 6df15873

DeepSpeed Ulysses tutorial (#4200)

minjiaz committed 2 years ago

Verified b5453990

Fix ZeRO parameter initialization for tensors with `requires_grad=True` (#4138)

XuehaiPan committed 2 years ago

Verified 426810a2

Add unit test to check HF low_cpu_mem_usage_flag (#4184)

loadams committed 2 years ago

Verified 9723a879

Fix path (#4193)

kytimmylai committed 2 years ago

Verified 6c684e12

Fix nv-nightly workflow (#4163)

mrwyattii committed 2 years ago

Verified d9a889d5

enable autoTP for mpt in huggingface model hub without trust_remote_code (#4062)

sywangyi committed 2 years ago

Verified 5e16eb2c

Treat empty environment variables as unset in (#4185)

loadams committed 2 years ago

Verified 8fb111c0

Older