Restore session, Auto Settings UI
#7548

Merged

SimpleChat: Simple histogram/repeatMatching driven garbageTrimming, Settings UI, Streaming mode, OpenAi Compat (Model, Authorization Bearer), Save/Restore session, Auto Settings UI #7548

mofosyne merged 59 commits into ggml-org:master from hanishkvc:hkvc_webfrontend_simplechat_v3

github-actions added examples

github-actions added server

hanishkvc marked this pull request as draft 1 year ago

mofosyne added Review Complexity : Medium

hanishkvc changed the title ~~SimpleChat: Simple histogram/freq driven garbage trimming, Settings UI~~ SimpleChat: Simple histogram and repeat matching driven garbage trimming, Settings UI 1 year ago

mofosyne approved these changes on 2024-05-28

hanishkvc changed the title ~~SimpleChat: Simple histogram and repeat matching driven garbage trimming, Settings UI~~ SimpleChat: Simple histogram and repeat matching driven garbage trimming, Settings UI, Streaming mode support 1 year ago

hanishkvc changed the title ~~SimpleChat: Simple histogram and repeat matching driven garbage trimming, Settings UI, Streaming mode support~~ SimpleChat: Simple histogram and repeat matching driven garbage trimming, Settings UI, Streaming mode, OpenAi Compat (Model, Authorization Bearer) 1 year ago

hanishkvc changed the title ~~SimpleChat: Simple histogram and repeat matching driven garbage trimming, Settings UI, Streaming mode, OpenAi Compat (Model, Authorization Bearer)~~ SimpleChat: Simple histogram and repeat matching driven garbage trimming, Settings UI, Streaming mode, OpenAi Compat (Model, Authorization Bearer), Save/Restore session 1 year ago

hanishkvc marked this pull request as ready for review 1 year ago

hanishkvc force pushed 1 year ago

hanishkvc changed the title ~~SimpleChat: Simple histogram and repeat matching driven garbage trimming, Settings UI, Streaming mode, OpenAi Compat (Model, Authorization Bearer), Save/Restore session~~ SimpleChat: Simple histogram/repeatMatching driven garbageTrimming, Settings UI, Streaming mode, OpenAi Compat (Model, Authorization Bearer), Save/Restore session, Auto Settings UI 1 year ago

SimpleChat:DU:BringIn local helper js modules using importmap

c83c19ad

SimpleChat:DU: Add trim garbage at end in loop helper

54802dc1

SimpleChat:DU:TrimGarbage if unable try skip char and retry

6390f348

SimpleChat:DU: Try trim using histogram based info

f33aa281

SimpleChat:DU: Switch trim garbage hist based to maxUniq simple

d1e73d87

SimpleChat:DU: Bring in maxType to the mix along with maxUniq

ae9f6106

SimpleChat:DU: Cleanup debug log messages

15152af9

SimpleChat:UI: Move html ui base helpers into its own module

a41f7011

SimpleChat:DU:Avoid setting frequence/Presence penalty

ed345aba

SimpleChat:UI: Add and use a para-create-append helper

ae7e66d2

SimpleChat:UI: Helper to create bool button and use it wrt settings

e42249d8

SimpleChat:UI: Add Select helper and use it wrt ChatHistoryInCtxt

1e47a48b

SimpleChat:UI:Select: dict-name-value, value wrt default, change

94bc0b08

SimpleChat:UI: Add Div wrapped label+element helpers

e17f5e02

SimpleChat:UI:Add settings button and bring in settings ui

0dae12ba

SimpleChat:UI:Settings make boolean button text show meaning

452813f2

SimpleChat: Update a bit wrt readme and notes in du

1db965d0

SimpleChat: GarbageTrim enable/disable, show trimmed part ifany

42b4fe55

SimpleChat: highlight trim, garbage trimming bitmore aggressive

f9fc5431

SimpleChat: Cleanup a bit wrt Api end point related flow

b2c10b96

SimpleChat:Move extracting assistant response to SimpleChat class

269cf3f5

SimpleChat:DU: Bring in both trim garbage logics to try trim

f5f9a2b3

SimpleChat: Cleanup readme a bit, add one more chathistory length

060925cd

SimpleChat:Stream:Initial handshake skeleton

9d0e65d1

SimpleChat: Move handling oneshot mode server response

8f97c238

SimpleChat: Move multi part server response handling in

aecf0e23

SimpleChat: Add MultiPart Response handling, common trimming

08b117b4

SimpleChat: show streamed generative text as it becomes available

4d354556

SimpleChat:DU: Add NewLines helper class

b7a5424c

SimpleChat:DU: Make NewLines shift more robust and flexible

7251714b

SimpleChat:HandleResponseMultiPart using NewLines helper

07923745

SimpleChat: Disable console debug by default by making it dummy

fcd385c3

SimpleChat:MultiPart/Stream flow cleanup

ace37042

SimpleChat: Move baseUrl to Me and inturn gMe

104848b0

SimpleChat:UI: Add input element helper

ebf978d2

SimpleChat: Add support for changing the base url

f54e0000

SimpleChat: Move request headers into Me and gMe

dce4e6a6

SimpleChat: Rather need to use append to insert headers

c9559d2b

SimpleChat: Allow Authorization header to be set by end user

af342b3b

SimpleChat:UI+: Return div and element wrt creatediv helpers

7a0399e5

SimpleChat: readme wrt authorization, maybe minimal openai testing

85fd2d0d

SimpleChat: model request field for openai/equivalent compat

0e7880a6

SimpleChat: readme stream-utf-8 trim-english deps, exception2error

48f02e0b

Readme: Add a entry for simplechat in the http server section

009563d1

SimpleChat:WIP:Collate internally, Stream mode Trap exceptions

b75b3db7

SimpleChat:theResp-origMsg: Undo a prev change to fix non trim

cdb4f6d2

SimpleChat: Save message internally in handle_response itself

872ee2c7

SimpleChat:Cleanup: Add spacing wrt shown req-options

ec79b8d3

SimpleChat:UI: CreateDiv Divs map to GridX2 class

803ee72b

SimpleChat: Show Non SettingsUI config field by default

3d925cbd

SimpleChat: Allow for multiline system prompt

1d7739b7

SimpleChat: Add basic skeleton for saving and loading chat

e2efcb4f

SimpleChat:ODS: Add a prefix to chatid wrt ondiskstorage key

a15d4dc6

SimpleChat:ODS:WIP:TMP: Add UI to load previously saved chat

5d408660

SimpleChat:ODS:Move restore/load saved chat btn setup to Me

4abcfde4

SimpleChat:Readme updated wrt save and restore chat session info

6ef57cc1

SimpleChat:Show chat session restore button, only if saved session

bc688036

SimpleChat: AutoCreate ChatRequestOptions settings to an extent

bb0f0c8a

SimpleChat: Update main README wrt usage with server

c4141a59

hanishkvc force pushed to c4141a59 1 year ago

mofosyne merged 2ac95c9d into master 1 year ago

Reviewers

mofosyne

Assignees

No one assigned

Labels

examples Review Complexity : Medium server

Milestone

No milestone

llama.cpp SimpleChat: Simple histogram/repeatMatching driven garbageTrimming, Settings UI, Streaming mode, OpenAi Compat (Model, Authorization Bearer), Save/Restore session, Auto Settings UI #7548 Merged

SimpleChat: Simple histogram/repeatMatching driven garbageTrimming, Settings UI, Streaming mode, OpenAi Compat (Model, Authorization Bearer), Save/Restore session, Auto Settings UI #7548

llama.cpp
SimpleChat: Simple histogram/repeatMatching driven garbageTrimming, Settings UI, Streaming mode, OpenAi Compat (Model, Authorization Bearer), Save/Restore session, Auto Settings UI
#7548

Merged