benchmark
fbfbe989 - Mark nn_module params and buffers as static in dynamo (#130391)

Commit
1 year ago
Mark nn_module params and buffers as static in dynamo (#130391) Summary: This PR marks all buffers and parameters of an NNModule as static using the `mark_static_address` API. As a result, when tensors are passed to AOT, the `tensor_dict` metadata of placeholder nodes will contain the `static_address_type` key, indicating which graph argument positions are static for cudagraphs. X-link: https://github.com/pytorch/pytorch/pull/130391 Approved by: https://github.com/anijain2305 Reviewed By: atalman Differential Revision: D59806591 Pulled By: mlazos fbshipit-source-id: fedc11e3321792bce1bc505b4f3209d431bb5a8c
Author
Parents
Loading