transformers
Fix missing spaces in system prompt of Llama2 tokenizer
#24930
Merged
Overview
Commits
6
Changes
View On GitHub

Fix missing spaces in system prompt of Llama2 tokenizer #24930

sgugger merged 6 commits into huggingface:main from main
chenjoya
chenjoya Update tokenization_llama.py
67c6733c
chenjoya Update tokenization_llama_fast.py
2c3f4907
chenjoya chenjoya changed the title Fix missing space in system prompt of Llama2 tokenizer Fix missing spaces in system prompt of Llama2 tokenizer 2 years ago
sgugger
ArthurZucker
ArthurZucker
ArthurZucker commented on 2023-07-20
chenjoya Update src/transformers/models/llama/tokenization_llama_fast.py
ea19f675
chenjoya Update src/transformers/models/llama/tokenization_llama.py
9f4a934f
chenjoya
ArthurZucker
ArthurZucker commented on 2023-07-20
chenjoya Update src/transformers/models/llama/tokenization_llama.py
9b83dcf3
chenjoya Update src/transformers/models/llama/tokenization_llama_fast.py
492022d2
ArthurZucker
ArthurZucker approved these changes on 2023-07-21
ArthurZucker ArthurZucker requested a review from sgugger sgugger 2 years ago
HuggingFaceDocBuilderDev
sgugger
sgugger approved these changes on 2023-07-21
sgugger sgugger merged f74560d0 into main 2 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum