accelerate
POC: multiple model/configuration DeepSpeed support
#3097
Merged
Overview
Commits
65
Changes
View On GitHub

POC: multiple model/configuration DeepSpeed support #3097

muellerzr merged 65 commits into main from muellerzr-multiple-model-deepspeed
muellerzr
muellerzr Bookmark
b8b77e79
muellerzr Migratory
602f6f63
muellerzr Uncomment
0dd96a1f
muellerzr Rm name to model for now
8db38daa
muellerzr Rm container
2f8c5dd7
muellerzr Left: test
4b1bc151
muellerzr muellerzr requested a review from BenjaminBossan BenjaminBossan 2 years ago
muellerzr muellerzr requested a review from SunMarc SunMarc 2 years ago
HuggingFaceDocBuilderDev
muellerzr Allow only wrapping one model
3488b110
muellerzr Add warning but only ref once
3a42fcd2
muellerzr Refine
26b3c2bc
stas00
stas00 commented on 2024-09-10
muellerzr Update src/accelerate/accelerator.py
a059e36d
muellerzr Finish stas nits
8a3e628e
muellerzr Merge branch 'muellerzr-multiple-model-deepspeed' of https://github.c…
bcfcf551
muellerzr Merge branch 'main' into muellerzr-multiple-model-deepspeed
599986c8
muellerzr Clean
447091b2
muellerzr Fixup test + test writing
7049f6c2
muellerzr Fully working
9ff52964
muellerzr Fin
db37ea2c
muellerzr Nit
5ebbae7a
muellerzr Quality
fb53edd2
stas00
stas00 commented on 2024-09-10
muellerzr Update src/accelerate/accelerator.py
d1078b81
muellerzr Actionable error
d01aea43
muellerzr Merge branch 'muellerzr-multiple-model-deepspeed' of https://github.c…
082f8ec5
stas00
stas00 commented on 2024-09-10
muellerzr Make note of when its enabled
4f8adfdd
stas00
stas00 commented on 2024-09-10
muellerzr Apply suggestions from code review
1c6d50df
muellerzr Merge tests
faef63be
muellerzr Merge branch 'muellerzr-multiple-model-deepspeed' of https://github.c…
5a593df9
muellerzr Merge
be80f876
muellerzr Add currently broken test script
f0546849
lewtun
lewtun commented on 2024-09-11
BenjaminBossan
BenjaminBossan requested changes on 2024-09-11
muellerzr
muellerzr Push the working implementation
a191f3b8
muellerzr Fin
844355b1
muellerzr Add guards for user behavior
87dba327
muellerzr Test nits
fa462ffa
muellerzr TODO: finish knowledge distillation example
fa291b3b
muellerzr Update tests/deepspeed/test_deepspeed_multiple_model.py
4593c529
muellerzr Allow for dict-like interface
3ff05bf9
muellerzr Merge branch 'muellerzr-multiple-model-deepspeed' of https://github.c…
d99a431d
muellerzr Get rid of disable
6a804c99
muellerzr Uncomment
1d81c4cd
stas00
stas00 commented on 2024-09-11
BenjaminBossan
BenjaminBossan commented on 2024-09-12
muellerzr Complete rewrite to force a dict to be used
6abff04c
muellerzr Working tests/fin
7b703b60
muellerzr Use name as stas suggestion
f1939f52
muellerzr Clean
96bf3f98
muellerzr muellerzr requested a review from BenjaminBossan BenjaminBossan 2 years ago
muellerzr muellerzr requested a review from stas00 stas00 2 years ago
muellerzr
muellerzr docnit
c7c6ccca
muellerzr toctree
2def7aa7
muellerzr muellerzr removed review request from stas00 stas00 2 years ago
muellerzr muellerzr requested a review from stevhliu stevhliu 2 years ago
muellerzr toctree
0df29400
muellerzr Missing ref
43d9def5
muellerzr Put in break
0eae50ca
BenjaminBossan
BenjaminBossan approved these changes on 2024-09-12
muellerzr Smaller diff
718e5ef6
muellerzr Make note on how to use zeroinit
a0792676
muellerzr Make note about accelerator ds plugin
2e2f0dc1
muellerzr More docnits
7d4e7123
muellerzr Apply suggestions from code review
837272f3
SunMarc
SunMarc approved these changes on 2024-09-12
stas00
stas00 commented on 2024-09-12
stas00
stas00 commented on 2024-09-12
muellerzr Limit users to not pass in another ds plugin to another accelerator
a17e03e9
stas00
stas00 commented on 2024-09-12
muellerzr not implemented err + Make a note about why no params
3e35dd37
stas00
muellerzr
muellerzr Apply suggestions from code review from Stas
08c2c5fe
stas00
stas00 commented on 2024-09-12
stas00
stas00 commented on 2024-09-12
muellerzr Add deepspeed_plugins arg + update doc
f889b882
muellerzr Plugin -> plugins
91ab4199
muellerzr Change enable() -> select()
70bc7283
muellerzr Update ref properly + test
f193ece6
muellerzr Conflict
2375a0a4
muellerzr Be consistent, model1,model2...
c9baf0db
muellerzr first_, second_
6d66b921
muellerzr A few more auto values
254a3eff
stevhliu
stevhliu approved these changes on 2024-09-12
muellerzr Apply suggestions from code review
88cbbdf0
lewtun
lewtun commented on 2024-09-13
muellerzr Apply suggestions from code review
dd77813f
muellerzr muellerzr merged e9e5a73f into main 2 years ago
muellerzr muellerzr deleted the muellerzr-multiple-model-deepspeed branch 2 years ago
lzy37ld

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum