language_modeling.py (#14077)

Commit

5 years ago

Fix assert in src/transformers/data/datasets/language_modeling.py (#14077) * replace assertion with ValueError * fix code style Co-authored-by: skpig <1900012999@pku.edu.cn>

References

#14077 - Fix assert in src/transformers/data/datasets/language_modeling.py

#29969 - [SigLIP] Add fast tokenizer

#59 - Fix attention mask handling in EoMT-DINOv3 converter

#62 - Add initial DEIMv2 model implementation

#65 - Fix RTDetrV2 sine position embedding ordering

#71 - Use Mask2Former ignore_value in mask matching and losses

#45110 - Add SAM 3.1

Author

skpig

Parents

0106826a

transformers 31560f63 - Fix assert in src/transformers/data/datasets/language_modeling.py (#14077)

transformers
31560f63 - Fix assert in src/transformers/data/datasets/language_modeling.py (#14077)