DeepSpeed
Fix quantized-inference & Add generic support of checkpoint loading
#2547
Merged

Fix quantized-inference & Add generic support of checkpoint loading #2547

RezaYazdaniAminabadi merged 13 commits into master from fix-ckpt-loading
RezaYazdaniAminabadi
fix checkpoint loading when it is a dictionary
4652e249
fix some issues with saving ckpt & int8 inference
89c64a92
Merge branch 'fix-ckpt-loading' of github.com:microsoft/DeepSpeed int…
2bc93a65
fix quantized-inference & add generic support of checkpoint loading
90c5297c
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from jeffra jeffra 3 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from mrwyattii mrwyattii 3 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from awan-10 awan-10 3 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from cmikeh2 cmikeh2 3 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from arashb arashb 3 years ago
remove int8 hard-coded flag
20f30ce2
fix mlp return tensors
eef04b39
RezaYazdaniAminabadi Merge branch 'master' into fix-ckpt-loading
4dd1d05c
fix several issue to load checkpoints of GPT-J, GPT-NEOX, and OPT wit…
40f10008
Merge branch 'fix-ckpt-loading' of github.com:microsoft/DeepSpeed int…
26c9e86d
mrwyattii
mrwyattii approved these changes on 2022-12-05
mrwyattii Merge branch 'master' into fix-ckpt-loading
ea5ee767
RezaYazdaniAminabadi
RezaYazdaniAminabadi Merge branch 'master' into fix-ckpt-loading
4121a669
add more comments & description for checkpoint-loading module
25e9bbff
mrwyattii Merge branch 'master' into fix-ckpt-loading
444dd77f
jeffra
jeffra approved these changes on 2022-12-06
RezaYazdaniAminabadi RezaYazdaniAminabadi merged 35b350b2 into master 3 years ago
mrwyattii mrwyattii deleted the fix-ckpt-loading branch 3 years ago
chenwuperth

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone