Fix `test_finetune_bert2bert` (#25984)

Commit

2 years ago

Fix `test_finetune_bert2bert` (#25984) Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>