llama.cpp
speculative: Ensure draft and target model vocab matches
#3812

Merged

speculative: Ensure draft and target model vocab matches #3812

ggerganov merged 2 commits into ggml-org:master from KerfuffleV2:fix-speculate-mismatched-models

speculative: Ensure draft and target model vocab matches

a0897651

ggerganov commented on 2023-10-27

Tolerate small differences when checking dft vs tgt vocab

41f5d2ac

ggerganov approved these changes on 2023-10-27

ggerganov merged 41aee4df into master 2 years ago

KerfuffleV2 deleted the fix-speculate-mismatched-models branch 2 years ago

Reviewers

ggerganov

Assignees

No one assigned

Labels

None yet

Milestone

No milestone