Produce constant variables in cases where a SymNode is created with a constant (#100144)
` AOT_DYNAMIC_SHAPES=1 TORCHDYNAMO_DYNAMIC_SHAPES=1 benchmarks/dynamo/huggingface.py --performance --training --amp --backend eager --disable-cudagraphs --device cuda --only AllenaiLongformerBase --explain`
Looks promising!
Goes from:
Dynamo produced 173 graphs covering 2760 ops with 160 graph breaks (14 unique)
To:
Dynamo produced 6 graphs covering 2298 ops with 15 graph breaks (7 unique)
Pull Request resolved: https://github.com/pytorch/pytorch/pull/100144
Approved by: https://github.com/ezyang
