accelerate
cdb001ca - Enhance multi-node notebook launching (#1913)

Commit
2 years ago
Enhance multi-node notebook launching (#1913) * Introduce new arguments: master_addr, node_rank, and num_nodes. Relocate these arguments to the end of the notebook_launcher function for compatibility. * Set defaults for NPROC and NODE_RANK environment variables in the PrepareForLaunch function to ensure compatibility. * Thoroughly document the process and usage guidelines for multi-node launching.
Parents
Loading