DeepSpeed
37a5bf18 - Route ZeRO/SuperOffload pin sites through accelerator pin_memory

Commit
2 days ago
Route ZeRO/SuperOffload pin sites through accelerator pin_memory Honor DS_PIN_MEMORY_BACKEND for core CPU offload buffers and avoid an extra host copy on empty scratch pins via make_copy=False. Signed-off-by: Olatunji Ruwase <tunji.ruwase@snowflake.com> Co-authored-by: Cursor <cursoragent@cursor.com>
Parents
Loading