accelerate
Avoid duplicating memory for tied weights in `dispatch_model`, and in forward with offloading
#2330
Merged
Merged
Avoid duplicating memory for tied weights in `dispatch_model`, and in forward with offloading #2330
fxmarty
merged
12 commits into
main
from
fix-dispatch-model-tied-params-memory
wip
982e6056
fix
373a6bea
add test
641a22f8
cleanup
ec2d94f0
style
ae573266
style & tests pass
829d33af
fxmarty
changed the title
fxmarty
commented
on 2024-01-12
fxmarty
commented
on 2024-01-12
SunMarc
commented
on 2024-01-12
fxmarty
commented
on 2024-01-15
fix offload, submodules
f199f6ba
cleanup
4b95a1d1
fxmarty
commented
on 2024-01-15
fxmarty
commented
on 2024-01-15
fxmarty
changed the title
Update tests/test_big_modeling.py
2ea8986d
Update tests/test_big_modeling.py
f9ecf75d
disk offloading do not reload tied parameters in memory
30631a65
fxmarty
commented
on 2024-01-16
SunMarc
approved these changes
on 2024-01-16
remove outdated comment
c1ea6f24
muellerzr
approved these changes
on 2024-01-16
Login to write a write a comment.
Login via GitHub