text-generation-inference
f433f1f7 - implement Open Inference Protocol endpoints (#1942)

Commit
1 year ago
implement Open Inference Protocol endpoints (#1942) * feat: add kserve feature and basic routes * feat: implement infer endpoint wrapper around generate * fix: refactor and improve types * fix: improve infer and simplify * fix: cleanup and improve api docs * fix: refactor and encapsulate kserve feat in file * fix: remove typos after rebase
Author
Parents
Loading