Automatic Model Parallelism Through FX #1933
zhenglongjiepheonix
merged
32 commits into
huggingface:main
from
zhenglongjiepheonix:longjie/add_automatic_model_parallel_via_fx
WIP
5e39787d
add dist ops
7a5d3940
Merge remote-tracking branch 'upstream/main' into longjie/add_automat…
7e15d26a
add index propagation
98e58462
support tp for linears
2036dbb1
Merge remote-tracking branch 'upstream/main' into longjie/add_automat…
34fffe82
add embedding & weight tie
0876f5d6
Merge remote-tracking branch 'upstream/main' into longjie/add_automat…
87e66fb7
address comments
ae6d9d27
lint
455c0c7f
fix
27a9bb82
Merge remote-tracking branch 'upstream/main' into longjie/add_automat…
473388bd
fix
0512b239
debug
8ec67277
fix
5095f1ed
fix tests
f6ebfc0e
add experimental API
e71e5ead
Merge remote-tracking branch 'upstream/main' into longjie/add_automat…
eb2a7a64
nit
779c77da
fix api
e09df2a8
Merge remote-tracking branch 'upstream/main' into longjie/add_automat…
22fe1a3a
fix api
9fd29d1d
format
01cfc256
clean tests
8c162679
fix weight_map
8ef00e03
add weights loading
6ef2081e
format
2c561d3f
fix
fc96b6f7
fix
8d2cabbd
Merge remote-tracking branch 'upstream/main' into longjie/add_automat…
c9c75715
enable tests
97e6431a
address comments
efd5d28c
zhenglongjiepheonix
changed the title 
michaelbenayoun
approved these changes
on 2024-07-25
echarlaix
commented
on 2024-10-14
Reviewers
Assignees
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub