Add Falcon3 support and Fix issue #10875 #10883
Add Falcon3 model support
d146334c
Add fix for adding bos to added special tokens
fc055407
Add comment explaining the logic behind the if statement
b3d022aa
Add a log message to better track the when the following line of codeā¦
d8d2f370
Update log to only print when input and output characters are different
92e41ec4
ggerganov
approved these changes
on 2024-12-18
ggerganov
approved these changes
on 2024-12-22
Fix handling pre-normalized tokens
a1f146db
compilade
approved these changes
on 2024-12-22
Refactoring
64d8687e
ggerganov
merged
7ae33a61
into master 1 year ago
Assignees
No one assigned
Login to write a write a comment.
Login via GitHub