Fix Llama 3 TikToken conversion (#33538) - SemanticDiff

Commit

1 year ago

Fix Llama 3 TikToken conversion (#33538) * Fix Llama 3 TikToken conversion * No need to add tokens again

References

#29969 - [SigLIP] Add fast tokenizer

#33538 - Fix Llama 3 TikToken conversion

#59 - Fix attention mask handling in EoMT-DINOv3 converter

#62 - Add initial DEIMv2 model implementation

#65 - Fix RTDetrV2 sine position embedding ordering

#44285 - Add VidEoMT

#44320 - Add SAM3-LiteText

#44375 - Add RF-DETR

#71 - Use Mask2Former ignore_value in mask matching and losses

#44385 - Fix make check-repo

Author

pcuenca

pcuenca

Parents

Loading