xla
Fix distributed checkpoint errors when PyTorch CUDA is enabled.
#6421

Merged

Fix distributed checkpoint errors when PyTorch CUDA is enabled. #6421

ysiraichi merged 1 commit into master from ysiraichi/fix-cuda-distributed-checkpoint

Pass `per_thread_copy_ahead=0` to avoid `_OverlappingCpuLoader`.

8bb5ada9

ysiraichi added xla:gpu

ysiraichi requested a review from

jonb377 1 year ago

ysiraichi requested a review from

JackCaoG 1 year ago

jonb377 approved these changes on 2024-01-31

ysiraichi merged 85c66f5f into master 1 year ago

Reviewers

jonb377

JackCaoG

Assignees

No one assigned

Labels

xla:gpu

Milestone

No milestone