llama.cpp
Add special token modification capability
#7166
Merged
Overview
Commits
18
Changes
View On GitHub

Add special token modification capability #7166

ggerganov merged 18 commits into ggml-org:master from CISC:modify-special-tokens-metadata
CISC
CISC Add special token modification capability
9e4968cf
CISC improve help text
8d36967a
CISC flake--
c4e6f6f4
CISC fix multiple tokens warning
a2410b6c
CISC make script executable
e5956f5b
CISC switch to namedtuple, no need to dataclass
ff5d21e6
CISC typing++
d39f2035
CISC add progress bar
158215c8
CISC Add special token modification capability
ed725336
CISC improve help text
27caf199
CISC flake--
8737ca16
CISC fix multiple tokens warning
3e3e7c37
CISC make script executable
bc92f65e
CISC switch to namedtuple, no need to dataclass
87e2d735
CISC typing++
981bd44e
CISC add progress bar
609df3c7
CISC Merge branch 'modify-special-tokens-metadata' of github.com:CISC/llam…
144d99a0
CISC
CISC
ggerganov
ggerganov approved these changes on 2024-05-09
CISC fail on invalid token id
efd70f3c
CISC
CISC CISC requested a review from ggerganov ggerganov 1 year ago
ggerganov ggerganov merged 22842164 into master 1 year ago
CISC CISC deleted the modify-special-tokens-metadata branch 1 year ago
mofosyne mofosyne added Review Complexity : Medium
mofosyne mofosyne added enhancement

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
enhancement Review Complexity : Medium
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum