PR #2822 Optimize the megatron plugin

Optimize the megatron plugin #2822

muellerzr merged 6 commits into huggingface:main from zhangsheng377:nvidia_megatron_r0_5

Update megatron_lm.md

69b459ca

Update accelerator.py

f515a887

Update dataclasses.py

b7610423

Update imports.py

5c20e7cd

Update megatron_lm.py

b9f9affb

Update megatron_lm.py

5847e7de

muellerzr approved these changes on 2024-06-07

muellerzr merged 24d8b63f into main 2 years ago

Reviewers

muellerzr

Assignees

No one assigned

Labels

None yet

Milestone

No milestone