[core] Fix torchao (#42289)
* inital commit
* up
* update unexpected later on
* fix
* update
* simplify our lives
* isolate a bit more
* fixup
* small nits
* style
* nit
* fix common cases
* fix post merge
* bnb needs missing keys
* small fix
* bettrer documentation
* no veradict + base class
* rake review comments
* take all comments
* fix super init
* update doc to be more real
* up
* fix some tests
* weight convertor
* up
* mostly correct
* oups
* skip non linears
* only some tests to go
* need quantization
* fix tests
* rm comment
* revert
* revert 2
* style
* up
* up
* remove unsafe loading path
* fix
* fix
* fix
* up
* rm Dtensor import
* rm replicate import
* fix imports
* up
* minor modifications
* add quantizaton_operation
* delattr
* fix
* fix get_param_buffer
* better to just set module initialized
* rm tie_weights
* guard imports
* up
* rm offloading for now
* add license
* don't guard torch
* comment
* fix
* rm torch.grad
* revert
* fix
* add guard
* add second guard
---------
Co-authored-by: Arthur <arthur.zucker@gmail.com>
Co-authored-by: Marc Sun <marc@huggingface.co>
