Fix test broken by D73809989 (#153413)
Summary:
I forgot to remove this unused field in D73809989.
X-link: https://github.com/pytorch/pytorch/pull/153413
Approved by: https://github.com/c00w
Reviewed By: jeanschmidt
Differential Revision: D74729288
fbshipit-source-id: d82727b485c8c187ac5ab9b91f6f62927c7511f7