Fix CPU Offloading Usage #8230
stevhliu
merged
4 commits into
huggingface:main
from
tolgacangoz:fix-typos
stevhliu
approved these changes
on 2024-05-22
stevhliu1 year ago
LGTM! Pinging @sayakpaul, @yiyixuxu @DN6 for a quick peek since the PR also touches the test scripts :)
sayakpaul
commented
on 2024-05-22
sayakpaul1 year ago
Just a single comment but rest looks good to me.
examples/kandinsky2_2/text_to_image/train_text_to_image_decoder.py
| 896 | 896 | images = [] | |
| 897 | 897 | if args.validation_prompts is not None: | |
| 898 | 898 | logger.info("Running inference for collecting generated images...") | |
| 899 | pipeline = pipeline.to(accelerator.device) |
sayakpaul1 year agoWhy is this going away?
yiyixuxu1 year agoit called enable_model_cpu_offload() right after
yiyixuxu
approved these changes
on 2024-05-23
yiyixuxu1 year ago
thanks!
Fix typos
d584157c
Fix `pipe.enable_model_cpu_offload()` usage
1b72d7eb
Fix cpu offloading
37320977
Update numbers
f83e5770
HuggingFaceDocBuilderDev1 year ago
The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.
stevhliu
approved these changes
on 2024-05-24
tolgacangoz1 year ago
Thanks for merging!
tolgacangoz
changed the title Login to write a write a comment.
Fixes CPU offloading usage.
@stevhliu