Fix Phi 3.5 MoE tests (#2684)

Commit

1 year ago

Fix Phi 3.5 MoE tests (#2684) PR #2682 also fixed in issue in Phi MoE, but it changes the test outputs a bit. Fix this.