accelerate
feature: CpuOffload pre_forward don't attempt to move if already on device
#3695

Merged

Commits

feature: added optimisation to not attempt to move devices if allready on that the device. This is more noticiable in large step itterations on diffusion loops when the pre_froward can get called many times

JoeGaffney committed 250 days ago
fix: linting

JoeGaffney committed 250 days ago
Apply style fixes

github-actions[bot] committed 238 days ago