transformers
rm slow tokenizers
#40936
Merged
Overview
Commits
277
Changes
View On GitHub
Commits
  • fixes missed
    itazap committed 173 days ago
  • gemma test fix
    itazap committed 173 days ago
  • refactor
    itazap committed 169 days ago
  • rm legacy from llama
    itazap committed 169 days ago
  • added renaming
    itazap committed 169 days ago
  • add _model
    itazap committed 169 days ago
  • update legacy
    itazap committed 169 days ago
  • update legacy
    itazap committed 169 days ago
  • fix docstring
    itazap committed 169 days ago
  • always load blank, then set _tokenizer if we have it
    itazap committed 169 days ago
  • new toks
    itazap committed 168 days ago
  • update all berttokenizer based models
    itazap committed 168 days ago
  • apply feedback - delete bert duplicates
    itazap committed 167 days ago
  • more models --> fast only
    itazap committed 166 days ago
  • more convert_slow models
    itazap committed 164 days ago
  • fix common test refs
    itazap committed 163 days ago
  • updating fast only tokenizers
    itazap committed 163 days ago
  • openai and pegasus
    itazap committed 162 days ago
  • enable sentencepiecebackend
    itazap committed 161 days ago
  • more models
    itazap committed 161 days ago
  • code gen
    itazap committed 161 days ago
  • t5
    itazap committed 161 days ago
  • code gen tests
    itazap committed 161 days ago
  • speecht5
    itazap committed 161 days ago
  • mbart
    itazap committed 161 days ago
  • mbart50
    itazap committed 161 days ago
  • more models
    itazap committed 161 days ago
  • more models
    itazap committed 160 days ago
  • layouglmv2
    itazap committed 160 days ago
  • update tests
    itazap committed 159 days ago
  • update tests
    itazap committed 159 days ago
  • update tests
    itazap committed 159 days ago
  • pretrainedtokenizer
    itazap committed 156 days ago
  • whisper
    itazap committed 155 days ago
  • whisper
    itazap committed 155 days ago
  • layoutxlm and storing backends
    itazap committed 155 days ago
  • refactor sentencepiecebackend and additional_special_tokens
    itazap committed 154 days ago
  • renaming tokenization_utils --> tokenization_python
    itazap committed 154 days ago
  • udpate tests
    itazap committed 153 days ago
  • bert test
    itazap committed 153 days ago
  • blenderbot
    itazap committed 153 days ago
  • clip
    itazap committed 153 days ago
  • codegen
    itazap committed 153 days ago
  • code_llama
    itazap committed 153 days ago
  • cohere
    itazap committed 153 days ago
  • deberata, deberat v2, funnel
    itazap committed 153 days ago
  • gpt2
    itazap committed 153 days ago
  • batch update tests
    itazap committed 153 days ago
  • pegasus qwen2 roberta
    itazap committed 153 days ago
  • more models
    itazap committed 152 days ago
  • layout tests
    itazap committed 152 days ago
  • some renaming
    itazap committed 152 days ago
  • fix references to utils_fast
    itazap committed 152 days ago
  • fix refs
    itazap committed 152 days ago
  • fix refs
    itazap committed 152 days ago
  • fix refs
    itazap committed 152 days ago
  • fix refs
    itazap committed 152 days ago
  • fix refs
    itazap committed 152 days ago
  • fix refs
    itazap committed 152 days ago
  • fix refs
    itazap committed 152 days ago
  • fix some tests
    itazap committed 150 days ago
  • regression
    itazap committed 150 days ago
  • fix refs
    itazap committed 150 days ago
  • fix refs
    itazap committed 149 days ago
  • missed the most crucial file in my last commit
    itazap committed 149 days ago
  • fix refs
    itazap committed 149 days ago
  • fix refs
    itazap committed 148 days ago
  • fix refs
    itazap committed 148 days ago
  • batch encode fix
    itazap committed 148 days ago
  • fix some tests
    itazap committed 147 days ago
  • BC for batch_decode bc too many refs
    itazap committed 147 days ago
  • more tests
    itazap committed 146 days ago
  • fix more tests
    itazap committed 146 days ago
  • fix for processors
    itazap committed 146 days ago
  • fixing more models
    itazap committed 143 days ago
  • deleted mbart50 by accident
    itazap committed 142 days ago
  • seamless m4t
    itazap committed 142 days ago
  • albert fix
    itazap committed 142 days ago
  • whisper
    itazap committed 142 days ago
  • layout3
    itazap committed 141 days ago
  • attempt to fix cached tokenizers on CI
    itazap committed 141 days ago
  • trying another fix on CI
    itazap committed 141 days ago
  • again try to work around CI
    itazap committed 141 days ago
  • bertweet
    itazap committed 141 days ago
  • tapas
    itazap committed 141 days ago
  • mbart50
    itazap committed 141 days ago
  • luke
    itazap committed 140 days ago
  • mluke
    itazap committed 139 days ago
  • markuplm
    itazap committed 139 days ago
  • markuplm
    itazap committed 139 days ago
  • fix some more auto tests
    itazap committed 139 days ago
  • some random model failures
    itazap committed 139 days ago
  • mistralcommontestser
    itazap committed 139 days ago
  • more fixes
    itazap committed 139 days ago
  • ref fix
    itazap committed 139 days ago
  • siglip
    itazap committed 138 days ago
  • marian
    itazap committed 138 days ago
  • plbart
    itazap committed 138 days ago
  • update utils toks
    itazap committed 138 days ago
  • seamless m4t
    itazap committed 136 days ago
  • + more commits ...
FAQ Terms Privacy Refunds Impressum
Loading