Revert "parse pysymints to IValues (#80066)"
This reverts commit f532b3a619ae11bbe7f01226f2b6fc7623f63129.
Reverted https://github.com/pytorch/pytorch/pull/80066 on behalf of https://github.com/seemethere due to Uses relative includes which causes internal builds to fail