transformers
[vllm + v5 fix] handle TokenizersBackend fallback properly for v5
#44255
Merged
Overview
Commits
48
Changes
View On GitHub
Commits
  • update deepseek v2 for tokenizers v5
    itazap committed 118 days ago
  • adding remote code fix
    itazap committed 118 days ago
  • fix deepseek name
    itazap committed 118 days ago
  • handle spm conversion from proto only when overriding bad_models
    itazap committed 118 days ago
  • add script to compare xlni and code_search_net output of 2 tokenizers
    itazap committed 118 days ago
  • tiktoken models support
    itazap committed 118 days ago
  • fix tests
    itazap committed 118 days ago
  • testssss
    itazap committed 118 days ago
  • fix gemma
    itazap committed 118 days ago
  • apply some feedback
    itazap committed 118 days ago
  • paligemma processor tests fix
    itazap committed 118 days ago
  • add relevant changes from #44298
    itazap committed 118 days ago
  • json serializable fix
    itazap committed 118 days ago
  • add more xlni cases
    itazap committed 118 days ago
  • t5 fix
    itazap committed 118 days ago
  • ruff check code quality
    itazap committed 118 days ago
  • missed file for t5 test fix
    itazap committed 118 days ago
  • modular failures
    itazap committed 118 days ago
  • other modular fixes
    itazap committed 118 days ago
  • tiktoken.model test
    itazap committed 118 days ago
  • more feedback updates!
    itazap committed 118 days ago
  • fixing models so AutoTokenizer == TokenizersBackend - aligning with converters
    itazap committed 118 days ago
  • seamless m4t
    itazap committed 118 days ago
  • missed the most important files
    itazap committed 118 days ago
  • Revert "missed the most important files"
    itazap committed 118 days ago
  • undo changes to big bird , bert, seamless
    itazap committed 118 days ago
  • setup and qual
    itazap committed 118 days ago
  • lasr
    itazap committed 118 days ago
  • t5
    itazap committed 118 days ago
  • dpr bert
    itazap committed 118 days ago
  • xlmroberta
    itazap committed 118 days ago
  • reformer
    itazap committed 118 days ago
  • nllb
    itazap committed 118 days ago
  • style and shit
    ArthurZucker committed 118 days ago
  • update
    ArthurZucker committed 118 days ago
  • fix
    ArthurZucker committed 118 days ago
  • extract the charsmap
    ArthurZucker committed 118 days ago
  • fix mbart?
    ArthurZucker committed 118 days ago
  • style
    ArthurZucker committed 118 days ago
  • nllb and test tok common read spm precompiled charsmap
    itazap committed 118 days ago
  • fix whisper?
    ArthurZucker committed 118 days ago
  • Merge branch 'bad_models_update' of github.com:huggingface/transformers into bad_models_update
    ArthurZucker committed 118 days ago
  • nllb
    itazap committed 118 days ago
  • checked on v4!
    ArthurZucker committed 118 days ago
  • Merge branch 'bad_models_update' of github.com:huggingface/transformers into bad_models_update
    ArthurZucker committed 118 days ago
  • fix repo
    ArthurZucker committed 118 days ago
  • fix lasr
    ArthurZucker committed 118 days ago
  • style
    ArthurZucker committed 118 days ago
FAQ Terms Privacy Refunds Impressum
Loading