DeepSpeed
Fairseq support
#1915
Merged
Overview
Commits
19
Changes
View On GitHub

Fairseq support #1915

jeffra merged 19 commits into master from jeffra/fs-v062
jeffra
jeffra add zero12 support
87f41420
jeffra add support for fs w. fp16/z123, plus z3 linear fix
876064cb
jeffra cleanup
9c7a82dc
jeffra jeffra requested a review from samyam samyam 3 years ago
jeffra jeffra requested a review from tjruwase tjruwase 3 years ago
jeffra jeffra requested a review from ShadenSmith ShadenSmith 3 years ago
jeffra jeffra requested a review from conglongli conglongli 3 years ago
jeffra jeffra requested a review from awan-10 awan-10 3 years ago
jeffra jeffra requested a review from cli99 cli99 3 years ago
jeffra jeffra requested a review from eltonzheng eltonzheng 3 years ago
jeffra jeffra requested a review from minjiaz minjiaz 3 years ago
jeffra jeffra requested a review from RezaYazdaniAminabadi RezaYazdaniAminabadi 3 years ago
jeffra jeffra marked this pull request as draft 3 years ago
jeffra jeffra changed the title Fairseq support [WIP] Fairseq support 3 years ago
jeffra Merge branch 'master' into jeffra/fs-v062
0003660d
jeffra remove pytest tmp
537df2ed
jeffra add base class to all deepspeed optimizer wrappers
b2bbf60c
mrwyattii
mrwyattii approved these changes on 2022-04-29
jeffra Merge branch 'master' into jeffra/fs-v062
ad30db14
jeffra fix issue w. attr passthrough, nn.module attrs were not passed
4a97bc8e
jeffra add model_f to pipe load_module_state_dict
e5b2df81
jeffra register client model in nn.module + other clean-up
143a348e
jeffra add lr override support to fused fp16 optim
271e509d
jeffra use the loss fn directly from the module
5ecad475
jeffra set client model when amp is enabled
beb3cea2
jeffra Merge branch 'master' into jeffra/fs-v062
4f7f1883
jeffra jeffra marked this pull request as ready for review 3 years ago
jeffra jeffra changed the title [WIP] Fairseq support Fairseq support 3 years ago
cli99
cli99 approved these changes on 2022-05-06
jeffra Merge branch 'master' into jeffra/fs-v062
36ec58f0
jeffra skip zero tiled linear tests for now
f95a1e4d
jeffra Merge branch 'master' into jeffra/fs-v062
62b00411
jeffra Merge branch 'master' into jeffra/fs-v062
52745f0d
tjruwase
tjruwase requested changes on 2022-05-10
jeffra rename model_f -> custom_load_fn
e9a5289b
jeffra jeffra merged 50893458 into master 3 years ago
stas00
stas00
stas00
VictorSanh
stas00
stas00
stas00
mrwyattii mrwyattii deleted the jeffra/fs-v062 branch 2 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum