Inference PP changes for neox #1899
jeffra
merged
30 commits into
master
from
inference/pipechanges
Synchronize the GPUs for the text-generation inference test
64a58c7c
change pp to run inference
d153b096
support ckpt conversion between pp<->seq
ec0edd55
remove conversion code, its now moved to client side
a145129b
add the inference-api changes to support the GPT-Neox inference at de…
1aa51481
fix the accuracy issue on the GPTNeoX inference
00d3be68
fixing parameter copy
525e9e7b
add inference global
7e965811
Merge branch 'master' into inference/pipechanges
69b611e3
jeffra
commented
on 2022-04-19
jeffra
commented
on 2022-04-19
jeffra
commented
on 2022-04-19
jeffra
commented
on 2022-04-19
jeffra
commented
on 2022-04-19
jeffra
commented
on 2022-04-19
jeffra
commented
on 2022-04-19
jeffra
commented
on 2022-04-19
clean-up
c271cc7c
cleanup
586c93fa
more clean-up
676023e0
Merge branch 'master' into inference/pipechanges
da45d1a7
more clean-up/docs
73afc65d
formatting
a31a93d4
fix minor issue with injection
cecde181
Merge branch 'inference/pipechanges' of github.com:microsoft/DeepSpee…
e3e0a9a8
refine the pipe module to get a map of the fwd_funcs to be able to in…
9e5e1ce0
fix DSE
afdcac42
add final_linear to state dict factory ckpt split
a16adb93
Merge branch 'master' into inference/pipechanges
7b3a75e0
fix for circular import issue
a82ae859
Merge branch 'inference/pipechanges' of github.com:microsoft/DeepSpee…
9eff79c6
comment out sanity check for now
3a3109c6
Merge branch 'master' into inference/pipechanges
346186bb
fix layernorm-param issue & compilation on newer version of torch
3f490aec
change the default trainig_mp_size to 1
1891e300
Merge branch 'master' into inference/pipechanges
8bd754f4
fix for curand on amd
5afbee96
fix syntax error
8627db77
RezaYazdaniAminabadi
approved these changes
on 2022-04-26
Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub