DeepSpeed
dc01cee5 - using container when loading inference checkpoints (#2875)

Comment changes are shownComment changes are hidden
Commit
2 years ago
using container when loading inference checkpoints (#2875) This PR updates the replace_fn function when loading inference checkpoints. The container will now be passed to the load_model_with_checkpoint() so we can call load_params() from there. load_params() is also updated to access the variables in the policy.
Author
Parents
  • deepspeed/module_inject
    • containers
      • File
        bloom.py
      • File
        gptj.py
      • File
        gptneo.py
      • File
        gptneox.py
      • File
        opt.py
    • File
      load_checkpoint.py
    • File
      replace_module.py