transformers
4bb49d4e - Enable non-safetensor ser/deser for TorchAoConfig quantized model 🔴 (#33456)

Commit
1 year ago
Enable non-safetensor ser/deser for TorchAoConfig quantized model 🔴 (#33456) * Enable non-safetensor serialization and deserialization for TorchAoConfig quantized model Summary: After https://github.com/huggingface/huggingface_hub/pull/2440 we added non-safetensor serialization and deserialization in huggingface, with this we can now add the support in transformers Note that we don't plan to add safetensor serialization due to different goals of wrapper tensor subclass and safetensor see README for more details Test Plan: tested locally Reviewers: Subscribers: Tasks: Tags: * formatting * formatting * minor fix * formatting * address comments * comments * minor fix * update doc * refactor compressed tensor quantizer
Author
Parents
Loading