PR #10856 Roberta embeddings fixes

Roberta embeddings fixes #10856

ggerganov merged 5 commits into ggml-org:master from gabe-l-hart:RobertaTokenizer

fix: Use gpt2 tokenizer for roberta and add eos/bos tokens

a2e03b82

fixes to position embeddings

d5f69e8a

github-actions added python

Ssukriti commented on 2024-12-16

ggerganov approved these changes on 2024-12-17

map roberta-bpe to gpt-2

334ddfd9

Merge branch 'master' into RobertaTokenizer

be50c0c3

fix linting

0b2f0313

ggerganov merged 2fffc52b into master 363 days ago

Reviewers

ggerganov

Assignees

No one assigned

Labels

python

Milestone

No milestone