transformers

ea41e18c - improve from_pretrained for zero3 multi gpus mode (#24964)

improve from_pretrained for zero3 multi gpus mode (#24964) * improve from_pretrained for zero3 multi gpus mode * Add check if torch.distributed.is_initialized * Revert torch.distributed --------- Co-authored-by: Stas Bekman <stas@stason.org>