huggingface/transformers

Pull Requests Commits
adding logic for updating normalizer
itazap committed 1 year ago
12940f6e
cleaning PR
itazap committed 1 year ago
d28bdde4
SPLITTING PR: moving bos/eos token logic to new PR
itazap committed 1 year ago
79507ad4
changes to _tokenizer updates in fast
itazap committed 1 year ago
5f9b5b16
SPLITTING PR: moving our user defined symbols issue #30824
itazap committed 1 year ago
874c3f69
reverting llama and t5 changes
itazap committed 1 year ago
7e42130a
updates from feedback, consider different pretokenizer types when updating
itazap committed 1 year ago
16eeb0cf
typo
itazap committed 1 year ago
27513731
rm change from unaffected file
itazap committed 1 year ago
7f3b798a
add eos and bos token arg support
itazap committed 1 year ago
a8694bca
t5 mod
itazap committed 1 year ago
b6de5698
moving cases around:
itazap committed 1 year ago
146e8f9e
fix
itazap committed 1 year ago
74e78f17
edit
itazap committed 1 year ago
d92822e0
draft
itazap committed 1 year ago
c416522a
readd cases
itazap committed 1 year ago
84143a2c
utils update
itazap committed 1 year ago
ff5974bb
t5
itazap committed 1 year ago
fdb63e21
add t5
itazap committed 1 year ago
79ce5bb6
draft pr
Ita Zaporozhets committed 1 year ago
896b7d15
more general approach
Ita Zaporozhets committed 1 year ago
7afb1592
add comment
Ita Zaporozhets committed 1 year ago
31fbe4f1
add user defined symbols to all tokenizers from SpmConverter
Ita Zaporozhets committed 1 year ago
d1ea757c
adding user defined tokens #30824
Ita Zaporozhets committed 1 year ago
24ea0cd7
[trainer] add sanity evaluation option (#31146)
SunMarc committed 1 year ago
Verified f8e6ba45
Quantization: Enhance bnb error message (#31160)
younesbelkada committed 1 year ago
Verified fc5d3e11
Update sam.md (#31130)
asifajrof committed 1 year ago
Verified bd9d1ddf
Fix quantized cache output (#31143)
SunMarc committed 1 year ago
Verified 48cada87
pytest -rsfE (#31140)
ydshieh committed 1 year ago
Verified d19566e8
helper (#31152)
ArthurZucker committed 1 year ago
Verified f3f640dc
Terms Of Use Privacy Policy Refund Policy Impressum