PR #5 Migrate to new model + proxy from server

Migrate to new model + proxy from server #5

Grsmto merged 27 commits into main from adrien-proxy-server

use fork of hf.js to support fully custom endpoints for testing purpose

e0063d60

proxy textGenerationStream call to the backend to hide token from client

300d3ac6

migrate to patch-package instead of pnpm

33fcc32a

fix issue after merge conflict

157bd495

Merge branch 'main' into adrien-proxy-server

495778bc

Grsmto requested a review from

gary149 2 years ago

gary149 requested a review from

julien-c 2 years ago

use env var instead of hardcoded value for endpoint

edc565ef

fix messages not being split between assistant/user

2e455f6c

fix stream response sometimes not split by token

dd24928e

Grsmto force pushed from b5260afe to dd24928e 2 years ago

julien-c commented on 2023-04-18

remove PUBLIC_ from private env variables + rename ENDPOINT to MODEL_…

334788cc

julien-c commented on 2023-04-18

only set hf token as private, model can stay public

7cb33c0d

julien-c commented on 2023-04-18

move HF_TOKEN to a dynamic env

915e0264

julien-c commented on 2023-04-18

fix env var import typo

cd6ec88f

remove @microsoft/fetch-event-source

717bc291

update parameters to be identical to Python demo

7fb0ce26

small refactor to avoid typing issue

ab5dec48

cleanup while loop

3e36610c

coyotte508 commented on 2023-04-18

make comment clearer on what is happening on stream chunks split

ff743d23

fix chunk spliting not being handled properly

7902b8c5

cleanup model tokens sometimes containing "<|endoftext|>" text

46013245

refactor how we proxy from the server to simplify logic

285f3261

use latest version of hf.js

3c5c3324

Grsmto force pushed from 4ab6e6fd to 3c5c3324 2 years ago

use .env + .env.local instead of .env.example

c436c299

rewrite logic to trim "<|endoftext|>" artifact properly

a74996d8

update to latest hf.js

cd5734b6

Merge branch 'main' into adrien-proxy-server

4abaed99

Grsmto requested a review from

julien-c 2 years ago

coyotte508 commented on 2023-04-18

coyotte508 approved these changes on 2023-04-18

expose env var to Docker during build time for deployment

19b9f82c

remove patch-package

db89a187

Grsmto merged c8d90f4a into main 2 years ago

Grsmto deleted the adrien-proxy-server branch 2 years ago

Reviewers

coyotte508

julien-c

gary149

Assignees

No one assigned

Labels

None yet

Milestone

No milestone

chat-ui Migrate to new model + proxy from server #5 Merged

Migrate to new model + proxy from server #5

chat-ui
Migrate to new model + proxy from server
#5

Merged