transformers
8a4857c0 - Support save/load ckpt for XLA FSDP (#32311)

Commit

1 year ago

Support save/load ckpt for XLA FSDP (#32311) * Support save/load ckpt for XLA FSDP * Fix bug for save * Fix style * reserve sharded ckpt and better file naming * minor fix Co-authored-by: Zach Mueller <muellerzr@gmail.com> * add is_fsdp_xla_v1_enabled --------- Co-authored-by: Zach Mueller <muellerzr@gmail.com>

References

#29969 - [SigLIP] Add fast tokenizer

#32311 - Support save/load ckpt for XLA FSDP

#33111 - [Backbone] Remove out_features everywhere

#33174 - [Zero-shot image classification pipeline] Remove tokenizer_kwargs

#39821 - Support MetaCLIP 2

#58 - Add EoMT DINOv3 model

#59 - Fix attention mask handling in EoMT-DINOv3 converter

#41212 - Add EoMT with DINOv3 backbone

#62 - Add initial DEIMv2 model implementation

Author

yitongh

Parents

f1b720ed

transformers 8a4857c0 - Support save/load ckpt for XLA FSDP (#32311)

transformers
8a4857c0 - Support save/load ckpt for XLA FSDP (#32311)