accelerate
e26065a2 - Upgrade huggingface's megatron to nvidia's megatron when use MegatronLMPlugin (#2501)

Commit
1 year ago
Upgrade huggingface's megatron to nvidia's megatron when use MegatronLMPlugin (#2501) * nvidia-megatron * Update megatron_lm.py * Update megatron_lm.py * ruff fix * ruff format * Update megatron_lm.py * Update dataclasses.py * Update megatron_lm.py * 直接使用megatron接口 --------- Co-authored-by: zhenwenqi <zhenwenqi_2022@qq.com>
Author
Parents
Loading