Refactor and expose metadata of tum_history layer for online prediction
Summary: Pull Request resolved: https://github.com/pytorch/pytorch/pull/24290
Reviewed By: xianjiec
Differential Revision: D16570968
fbshipit-source-id: f68d42f3a8e1a6c8d30e00c2dd7f7efc1fb35d7c