transformers
[model loading] don't `gc.collect()` if only 1 shard is used
#36721

Merged

[model loading] don't `gc.collect()` if only 1 shard is used #36721

gante merged 3 commits into huggingface:main from gante:dont_gc_collect_on_single_shard

don't gc collect if 1 shard is used

f8834482

github-actions marked this pull request as draft 281 days ago

delete state dict anyways

9dac0a4b

gante marked this pull request as ready for review 281 days ago

Merge branch 'main' into dont_gc_collect_on_single_shard

5ca357f9

github-actions requested a review from

ArthurZucker 281 days ago

github-actions requested a review from

Rocketknight1 281 days ago

gante changed the title ~~[model loading] don't `gc.collect` if 1 shard is used~~ [model loading] don't `gc.collect` if only 1 shard is used 281 days ago

gante changed the title ~~[model loading] don't `gc.collect` if only 1 shard is used~~ [model loading] don't `gc.collect()` if only 1 shard is used 281 days ago

gante removed review request from

Rocketknight1 281 days ago

gante requested a review from

Cyrilvallez 281 days ago

Cyrilvallez approved these changes on 2025-03-14

gante merged 3bd1a0dd into main 281 days ago

gante deleted the dont_gc_collect_on_single_shard branch 281 days ago

Reviewers

Cyrilvallez

ArthurZucker

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

transformers [model loading] don't `gc.collect()` if only 1 shard is used #36721 Merged

[model loading] don't `gc.collect()` if only 1 shard is used #36721

transformers
[model loading] don't `gc.collect()` if only 1 shard is used
#36721

Merged