PR #415 support naive multi-card tuning

support naive multi-card tuning #415

wenhuach21 merged 11 commits into main from tuning_device_map

support device map in tuning

ff62e5ff

wenhuach21 changed the title ~~support for device mapping during tuning, primarily for extremely large models.~~ support device mapping during tuning, primarily for extremely large models. 1 year ago

update ut

6ae7a4ce

wenhuach21 marked this pull request as draft 1 year ago

Resolve issues and release GPU memory more frequently

25dfc3f1

update

1556a280

wenhuach21 marked this pull request as ready for review 1 year ago

tiny change

e7715aad

wenhuach21 requested a review from

WeiweiZhang1 1 year ago

wenhuach21 requested a review from

n1ck-guo 1 year ago

fix preci issue

0fab777f

wenhuach21 changed the title ~~support device mapping during tuning, primarily for extremely large models.~~ support multi-card tuning 1 year ago

wenhuach21 changed the title ~~support multi-card tuning~~ support naive multi-card tuning 1 year ago

try to fix ut

fd05b768

fix line too long issue

c5e11e8f

tiny change

957176dd

rename to device_map

0e6d8fa0

n1ck-guo approved these changes on 2025-01-17

fix issues

21717228

wenhuach21 merged 09f1ab49 into main 1 year ago

wenhuach21 deleted the tuning_device_map branch 1 year ago

Reviewers

n1ck-guo

WeiweiZhang1

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

auto-round support naive multi-card tuning #415 Merged

support naive multi-card tuning #415

auto-round
support naive multi-card tuning
#415

Merged