Megatron-DeepSpeed
Followup PR for adding generation-server
#339
Merged

Followup PR for adding generation-server #339

mayank31398 merged 8 commits into main from mayank/generation-server
mayank31398
fix grpc
1b78ef04
mayank31398 mayank31398 marked this pull request as draft 3 years ago
stas00
mayank31398
stas00
mayank31398
stas00
use functools.partial
76e78bab
mayank31398
fix ds-inference server
55734281
add support for int8 in the future
e7e90bd6
bug fix
701aaca0
update README
93e81e76
fix
4b5205bd
mayank31398 mayank31398 marked this pull request as ready for review 3 years ago
mayank31398
Merge branch 'main' of https://github.com/bigscience-workshop/Megatro…
0f322369
stas00
stas00 approved these changes on 2022-09-11
mayank31398 mayank31398 merged cd597c8f into main 3 years ago
mayank31398 mayank31398 deleted the mayank/generation-server branch 3 years ago
stas00
mayank31398
mayank31398
mayank31398
stas00

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone