pytorch

d3fbb41c - [PyTorch Edge] share tensors in mobile with new api (#58182)

[PyTorch Edge] share tensors in mobile with new api (#58182) Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/58182 As title, the v5 model format will be ``` (base) chenlai@chenlai-mp reuse_constant % zipinfo /Users/chenlai/Documents/pytorch/reuse_constant/tmp/zip/script_module_v5_unify.ptl Archive: /Users/chenlai/Documents/pytorch/reuse_constant/tmp/zip/script_module_v5_unify.ptl Zip file size: 3120 bytes, number of entries: 7 -rw---- 0.0 fat 77 bl stor 80-000-00 00:00 script_module_v4_unify/data.pkl -rw---- 0.0 fat 240 bl defN 80-000-00 00:00 script_module_v4_unify/code/__torch__/___torch_mangle_5.py -rw---- 0.0 fat 422 bl defN 80-000-00 00:00 script_module_v4_unify/code/__torch__/___torch_mangle_5.py.debug_pkl -rw---- 0.0 fat 64 bl stor 80-000-00 00:00 script_module_v4_unify/constants/140245072983168.storage -rw---- 0.0 fat 172 bl stor 80-000-00 00:00 script_module_v4_unify/constants.pkl -rw---- 0.0 fat 678 bl stor 80-000-00 00:00 script_module_v4_unify/bytecode.pkl -rw---- 0.0 fat 2 bl stor 80-000-00 00:00 script_module_v4_unify/version 7 files, 1655 bytes uncompressed, 1453 bytes compressed: 12.2% ``` bytecode.pkl is: ``` (5, ('__torch__.___torch_mangle_5.TestModule.forward', (('instructions', (('STOREN', 1, 2), ('DROPR', 1, 0), ('LOADC', 0, 0), ('LOADC', 1, 0), ('MOVE', 2, 0), ('OP', 0, 0), ('LOADC', 1, 0), ('OP', 1, 0), ('RET', 0, 0))), ('operators', (('aten::add', 'int'), ('aten::add', 'Scalar'))), ('constants', (torch._utils._rebuild_tensor_v2(pers.obj(('storage', torch.DoubleStorage, '140245072983168.storage', 'cpu', 8),), 0, (2, 4), (4, 1), False, collections.OrderedDict()), 1)), ('types', ()), ('register_size', 2)), (('arguments', ((('name', 'self'), ('type', '__torch__.___torch_mangle_5.TestModule'), ('default_value', None)), (('name', 'y'), ('type', 'int'), ('default_value', None)))), ('returns', ((('name', ''), ('type', 'Tensor'), ('default_value', None)),))))) ``` constants.pkl is: ``` (torch._utils._rebuild_tensor_v2(pers.obj(('storage', torch.DoubleStorage, '140245072983168.storage', 'cpu', 8),), 0, (2, 4), (4, 1), False, collections.OrderedDict()),) ``` Both tensors will refer to the tensor in at the path `script_module_v4_unify/constants/140245072983168.storage`. ## Note According to unify format, all tensors will be written to the folder `.data`, however, torch.jit.load() can't handle the unified format at this moment, so this change will write tensors at the `constants` folders, and mobile will write/read tensors from `constants` folder. such that the model can be interpreted by both jit and mobile. ghstack-source-id: 129010347 Test Plan: buck test mode/dev //caffe2/test/cpp/jit:jit Reviewed By: raziel, iseeyuan Differential Revision: D28375257 fbshipit-source-id: 6544472db4c957c5ea037e0bb5112b637dd15897