[Core] introduce _no_split_modules to `ModelMixin` #6396
introduce _no_split_modules.
0843c467
sayakpaul
marked this pull request as draft 2 years ago
unnecessary spaces.
e60abd3c
remove unnecessary kwargs and style
c3745125
fix: accelerate imports.
6f5ae67b
merge main and resolve conflicts.
6c401563
change to _determine_device_map
726df088
add the blocks that have residual connections.
f8d8afae
add: CrossAttnUpBlock2D
9215e357
add: testin
706d96e7
style
149ba913
line-spaces
4c88038b
quality
796ee054
Merge branch 'main' into feat/device-map-auto
6801c22e
Merge branch 'main' into feat/device-map-auto
7ecb597a
add disk offload test without safetensors.
e9290c9c
checking disk offloading percentages.
73a99dc5
change model split
b4e9f2f1
add: utility for checking multi-gpu requirement.
26fd4af2
model parallelism test
1055ba7d
splits.
6d336dca
splits.
8575ad6a
splits
92da3bb5
splits.
57bc6f71
splits.
945458aa
splits.
7e8f602f
offload folder to test_disk_offload_with_safetensors
a48d25cc
Merge branch 'main' into feat/device-map-auto
cd9c29eb
add _no_split_modules
fcd277c7
sayakpaul
marked this pull request as ready for review 2 years ago
sayakpaul
changed the title [WIP] introduce _no_split_modules to `ModelMixin` [Core] introduce _no_split_modules to `ModelMixin` 2 years ago
merge main and resolve conflicts.
9dff2c1d
fix-copies
9e5a5e94
SunMarc
approved these changes
on 2024-01-24
Merge branch 'main' into feat/device-map-auto
c9b81f6f
merge main and resolve conflicts
089b6bd5
merge main and resolve conflicts.
968e857c
Merge branch 'main' into feat/device-map-auto
2fd13938
Merge branch 'main' into feat/device-map-auto
99585706
Merge branch 'main' into feat/device-map-auto
4761b5cf
SunMarc
approved these changes
on 2024-04-29
Merge branch 'main' into feat/device-map-auto
2e79e566
yiyixuxu
approved these changes
on 2024-04-30
Merge branch 'main' into feat/device-map-auto
b870eb73
sayakpaul
merged
3fd31eef
into main 1 year ago
sayakpaul
deleted the feat/device-map-auto branch 1 year ago
Assignees
No one assigned
Login to write a write a comment.
Login via GitHub