transformers
add build_inputs_with_special_tokens to LlamaFast
#26297
Merged

add build_inputs_with_special_tokens to LlamaFast #26297

ArthurZucker
ArthurZucker add build_inputs_with_special_tokens to LlamaFast
290ddeab
HuggingFaceDocBuilderDev
ArthurZucker fixup
9a6329bf
ArthurZucker ArthurZucker marked this pull request as ready for review 2 years ago
ArthurZucker ArthurZucker requested a review from LysandreJik LysandreJik 2 years ago
ArthurZucker
ArthurZucker commented on 2023-10-02
ArthurZucker Update src/transformers/models/llama/tokenization_llama_fast.py
da0de7a6
LysandreJik
LysandreJik approved these changes on 2023-10-02
ArthurZucker
ArthurZucker ArthurZucker merged c20d90d5 into main 2 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone