llama.cpp
server: allow to specify tokens as strings in logit_bias
#5003
Merged

server: allow to specify tokens as strings in logit_bias #5003

z80maniac
cebtenzzre
cebtenzzre commented on 2024-01-17
z80maniac z80maniac force pushed 1 year ago
z80maniac z80maniac force pushed 1 year ago
z80maniac server: allow to specify tokens as strings in logit_bias
cfaa5258
z80maniac z80maniac force pushed to cfaa5258 1 year ago
ggerganov
ggerganov approved these changes on 2024-02-09
z80maniac Apply suggestions from code review
f6fd1a97
ggerganov ggerganov merged 68478014 into master 1 year ago
Solido
z80maniac

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone