Fix attention perf regression (#8682)

Commit

4 years ago

Fix attention perf regression (#8682) * undo change in attention cpu * fix perf regression * disable persistent softmax by default