transformers
[core] reuse unused reserved cuda memory when loading models
#37920

Merged

[core] reuse unused reserved cuda memory when loading models #37920

gante merged 4 commits into huggingface:main from gante:cuda_reuse_reserved_memory

reuse cuda memory

0cf1c542

github-actions marked this pull request as draft 1 year ago

gante marked this pull request as ready for review 1 year ago

gante requested a review from

Cyrilvallez 1 year ago

better comment

16210d34

missing index

171d0942

Cyrilvallez commented on 2025-05-05

Cyrilvallez approved these changes on 2025-05-05

ArthurZucker approved these changes on 2025-05-05

PR review suggestion

0d471c37

ydshieh approved these changes on 2025-05-05

gante merged 3b067a15 into main 1 year ago

gante deleted the cuda_reuse_reserved_memory branch 1 year ago

Reviewers

ydshieh

ArthurZucker

Cyrilvallez

SunMarc

Assignees

No one assigned

Labels

None yet

Milestone

No milestone