server : display token probabilities in the UI #2489
jhen0409
merged
41 commits into
ggml-org:master
from
jhen0409:server-probs
server : add n_probs param in chat UI
78621188
server : keep message data array & show in probabilites component
6a8b9c27
server : add simple popover component
2a5bab4c
server : fix completion_probabilities undefined if not set n_probs
b9b6cd2f
server : implement Probabilites
d37be8dc
server : handle bytes
7f02fead
server : make n_probs max to 10 for easy scroll
368c41cb
server : adjust for dark/light mode
75029972
server : Fix regenerated prompt
cc1ae32d
server : update index.html.hpp
48bea64d
Merge branch 'master' into server-probs
3e1e86d8
server : convert prob to percentage + show original value as div title
04b6f2ce
server : fix Probabilites not used if included empty str
236c838d
server : skip byte pair in display probabilites
3409735c
server : remove array check of completion_probabilities in messages
bffd3cde
Merge branch 'master' into server-probs
c2c16905
Merge branch 'master' into server-probs
006e74a4
Merge branch 'master' into server-probs
5c6aee64
skip empty array or byte pair (> 1) in Probabilites
7ec9c222
Merge branch 'master' into server-probs
25e6747a
generate index.html.hpp
11e86365
slaren
approved these changes
on 2023-08-20
fix incorrect prob convert if the str is already a known token
e4c04c24
use final response to show probabilities on stop
54f9f3c1
revert unnecessary change
a7042c18
jhen0409
commented
on 2023-08-21
correct probabilites usage
b7ddf04a
remove unused function
371cc148
always send partial response for get correct probs of last to_send
1e9fe8a9
fix typo
1bef2dcf
jhen0409
commented
on 2023-08-21
fix content of format_final_response
af1ea58b
refactor probs render & make pColor transparent if not found
91b8be08
Merge branch 'master' into server-probs
aad8ef46
Merge branch 'master' into server-probs
de8cd113
send empty string when got stop_pos in partial
e1911ac4
jhen0409
commented
on 2023-08-22
Merge branch 'master' into server-probs
ec4a19c5
Merge branch 'master' into server-probs
3fc1127e
avoid unnecessary empty data event & send rest of partial tokens on stop
3f436ea3
Merge branch 'master' into server-probs
db29d68d
use <br /> for new line
343be7fa
skip -1 tok in loop to avoid send '' on end
8cec4409
trim last new lines on stop
607758ae
revert unnecessary change
8f86eb97
Login to write a write a comment.
Login via GitHub