DeepSpeed
Route ZeRO/SuperOffload pin sites through accelerator pin_memory
#8256
Open
Open
Route ZeRO/SuperOffload pin sites through accelerator pin_memory #8256
sfc-gh-truwase
wants to merge
7 commits into
master
from
tjruwase/pin-memory-route-zero
Route ZeRO/SuperOffload pin sites through accelerator pin_memory
37a5bf18
Fix CPU CI skip for offload pin-route unit test
e6dc5f9d
delock
approved these changes
on 2026-08-20
xylian86
commented
on 2026-08-20
Keep pinned reload sources alive until ZeRO-1/2 synchronizes.
aebb2819
xylian86
commented
on 2026-08-24
Allocate pinned memory directly when pin_memory is not copying.
246c02e1
Merge branch 'master' into tjruwase/pin-memory-route-zero
598ad17a
xylian86
approved these changes
on 2026-08-24
Release offload_states pinned buffers in ZeRO destroy().
05ddc1a4
Honor offload_optimizer.pin_memory for the SuperOffload worker buffer.
658dc247
Login to write a write a comment.
Login via GitHub