accelerate
Add `keep_torch_compile` param to `unwrap_model` and `extract_model_from_parallel` for distributed compiled model.
#3282

Merged

Add `keep_torch_compile` param to `unwrap_model` and `extract_model_from_parallel` for distributed compiled model. #3282

muellerzr merged 1 commit into huggingface:main from bugfix/check-compiled-model

SunMarc commented on 2024-12-09

ggoggam changed the title ~~Fix `extract_model_from_parallel` to fully unwrap compiled model.~~ Fix `unwrap_model` for distributed compiled model. 1 year ago

ggoggam commented on 2024-12-11

muellerzr commented on 2024-12-11

ggoggam requested a review from

muellerzr 1 year ago

SunMarc approved these changes on 2024-12-13

SunMarc commented on 2024-12-13

Adding `keep_torch_compile` argument to `unwrap_model` and `extract_m…

c2e9e5be

ggoggam requested a review from

SunMarc 1 year ago

ggoggam changed the title ~~Fix `unwrap_model` for distributed compiled model.~~ Add `keep_torch_compile` param to `unwrap_model` and `extract_model_from_parallel` for distributed compiled model. 1 year ago

SunMarc approved these changes on 2024-12-24

muellerzr approved these changes on 2025-01-08

muellerzr merged 54370d45 into main 1 year ago

Reviewers

SunMarc

muellerzr

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

accelerate Add `keep_torch_compile` param to `unwrap_model` and `extract_model_from_parallel` for distributed compiled model. #3282 Merged

Add `keep_torch_compile` param to `unwrap_model` and `extract_model_from_parallel` for distributed compiled model. #3282

accelerate
Add `keep_torch_compile` param to `unwrap_model` and `extract_model_from_parallel` for distributed compiled model.
#3282

Merged