llama.cpp
convert : fix nomic-bert-moe mask token
#13757
Merged

Commits
  • add missing mask token
    CISC committed 263 days ago
  • set mask token lstrip attribute
    CISC committed 263 days ago
  • str -> bytes
    CISC committed 263 days ago
  • Merge branch 'master' into cisc/fix-nomic-bert-moe-mask
    CISC committed 257 days ago
  • remove dead padding code that got readded in merge
    CISC committed 257 days ago
  • apply correct padding with AutoTokenizer as well
    CISC committed 255 days ago
  • spaces--
    CISC committed 255 days ago
  • Merge branch 'master' into cisc/fix-nomic-bert-moe-mask
    CISC committed 255 days ago
  • only add mask token when using sentencepiece
    CISC committed 255 days ago
Loading