accelerate
Upgrade huggingface's megatron to nvidia's megatron when use MegatronLMPlugin
#2501

Merged

Upgrade huggingface's megatron to nvidia's megatron when use MegatronLMPlugin #2501

muellerzr merged 9 commits into huggingface:main from zhangsheng377:nvidia_megatron

nvidia-megatron

ddea8aec

muellerzr commented on 2024-02-28

Update megatron_lm.py

194bdde9

Update megatron_lm.py

22863b29

ruff fix

5867f15f

ruff format

295add0a

Update megatron_lm.py

ba6dae97

Update dataclasses.py

e0ca382d

Update megatron_lm.py

ff2c0214

直接使用megatron接口

b2991c5e

github-actions closed this 2 years ago

muellerzr reopened this 2 years ago

pacman100 approved these changes on 2024-05-23

muellerzr approved these changes on 2024-05-23

muellerzr merged e26065a2 into main 2 years ago

Reviewers

muellerzr

pacman100

Assignees

No one assigned

Labels

None yet

Milestone

No milestone