DeepSpeed
Allow multiple inference engines in single script
#4384

Merged

Allow multiple inference engines in single script #4384

mrwyattii merged 5 commits into master from mrwyattii/allow-multiple-inf-engines

add destroy method to InferenceEngine

ba131830

mrwyattii requested a review from

RezaYazdaniAminabadi 2 years ago

mrwyattii requested a review from

jeffra 2 years ago

mrwyattii requested a review from

awan-10 2 years ago

mrwyattii requested a review from

cmikeh2 2 years ago

mrwyattii requested a review from

arashb 2 years ago

mrwyattii requested a review from

tjruwase 2 years ago

remove accidentally aded submodule

3f9ad48b

RezaYazdaniAminabadi approved these changes on 2023-09-21

jeffra commented on 2023-09-22

Update deepspeed/inference/engine.py

ec7a2582

move imports to avoid error with global variable not updating

d890c52b

formatting

2e714305

mrwyattii enabled auto-merge 2 years ago

disabled auto-merge 2 years ago
Manually disabled by user

mrwyattii merged 4c35880b into master 2 years ago

mrwyattii deleted the mrwyattii/allow-multiple-inf-engines branch 2 years ago

Reviewers

jeffra

awan-10

cmikeh2

arashb

tjruwase

Assignees

No one assigned

Labels

None yet

Milestone

No milestone