PR #1427 feat: supports openai chat completions API

feat: supports openai chat completions API #1427

Narsil merged 10 commits into main from support-chat-completions-endpoint

OlivierDehaene commented on 2024-01-10

drbh force pushed from e7a6fb29 to 583e08b3 1 year ago

drbh requested a review from

OlivierDehaene 1 year ago

Narsil commented on 2024-01-11

Narsil dismissed these changes on 2024-01-11

drbh dismissed their stale review via db3e1527 1 year ago

feat: supports openai chat completions API

9fdf47f7

fix: remove trailing space for clippy

47ad7bfb

fix: initialize chat template single time, fix defaults and add seed …

55455a16

fix: re-add changes removed during rebase

d009aa3e

fix: clippy tweaks

62e66616

fix: prefer only intput_length over full ValidRequest in GenerateStre…

c63551fa

fix: remove duplicate input_length on Details

4555e872

drbh force pushed from db3e1527 to 4555e872 1 year ago

fix: add removed index from rebase and clippy

3513bc73

OlivierDehaene commented on 2024-01-12

feat: support local configs and prefer hf hub

fb6c220d

drbh requested a review from

Narsil 1 year ago

drbh requested a review from

OlivierDehaene 1 year ago

fix: avoid program exit on repo fetch failures

4a47f66d

Narsil approved these changes on 2024-01-16

Narsil merged 0eabc835 into main 1 year ago

Narsil deleted the support-chat-completions-endpoint branch 1 year ago

Reviewers

Narsil

OlivierDehaene

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

text-generation-inference feat: supports openai chat completions API #1427 Merged

feat: supports openai chat completions API #1427

text-generation-inference
feat: supports openai chat completions API
#1427

Merged