accelerate
torch-native pipeline parallelism for big models
#2345
Merged
Overview
Commits
39
Changes
View On GitHub

torch-native pipeline parallelism for big models #2345

muellerzr merged 39 commits into main from pippy-integration-v2
muellerzr
muellerzr Broken version
e713e28e
muellerzr Timing I would expect
2767bb19
muellerzr Working version!
06f04a99
muellerzr muellerzr marked this pull request as draft 1 year ago
HuggingFaceDocBuilderDev
SunMarc
SunMarc commented on 2024-01-16
SunMarc
SunMarc commented on 2024-01-16
muellerzr Use MethodType
9eef9dd4
muellerzr muellerzr force pushed from 66fb6116 to 9eef9dd4 1 year ago
muellerzr working test
449eb8d9
muellerzr Tests
77f8e92b
muellerzr Use no split module classes explicitly
df7779aa
muellerzr Put split_points in pipelien
e3f6b99b
muellerzr Store split points in hf_split_points
8792a8c5
SunMarc fix case num_process=1
7ca4bccf
muellerzr
muellerzr commented on 2024-01-18
SunMarc
SunMarc approved these changes on 2024-01-24
SunMarc
SunMarc commented on 2024-01-24
muellerzr Allow for dynamic batch padding (#2352)
dac1daa9
muellerzr Rm literal
364c3b61
muellerzr Allow users to pass in max_memory
6a8479b2
muellerzr Note about recursion
303c9cc7
muellerzr Document, document, document
d497e8af
muellerzr Right import check
06bbc5b5
muellerzr Merge branch 'main' into pippy-integration-v2
5e047da8
muellerzr Fix bug, add tests to multigpu runners
a5059e62
muellerzr Change default to None
71346a19
kwen2501
kwen2501 approved these changes on 2024-01-31
SunMarc
SunMarc approved these changes on 2024-01-31
muellerzr Start of docs
fe66b937
muellerzr Try again?
d2af472b
muellerzr Try again x2
8dc6c6c8
muellerzr Trailing comma
4d0aeb2b
muellerzr Move import
309b71a6
muellerzr Clean
9f561f11
muellerzr typehint
d5a6fda3
muellerzr typo
954a668e
kwen2501
kwen2501 approved these changes on 2024-02-05
muellerzr From code review
853f5521
muellerzr Use num_chunks
1362e5c2
muellerzr Update tests/test_utils.py
68bd89b3
muellerzr muellerzr marked this pull request as ready for review 1 year ago
kwen2501
kwen2501 commented on 2024-02-05
muellerzr Bad copy/paste
181fbda9
muellerzr muellerzr changed the title Pippy integration v2 torch-native pipeline parallelism for big models 1 year ago
muellerzr muellerzr requested a review from MKhalusova MKhalusova 1 year ago
muellerzr
muellerzr hf_split_points
9157cf16
MKhalusova
MKhalusova commented on 2024-02-06
muellerzr Apply suggestions from code review
f2c6e088
muellerzr Year
9f204969
muellerzr Nit
e1961d6d
muellerzr better title
8c72a5e6
muellerzr Rephrase
3eaa9678
muellerzr Rephrase
31fcde4d
muellerzr
muellerzr Try spacing maybe?
7c3d1830
muellerzr muellerzr merged 0867c093 into main 1 year ago
muellerzr muellerzr deleted the pippy-integration-v2 branch 1 year ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum