transformers

f80b0485 - [XPU] Fix UT errors in the sam3 and lfm series model. (#42798)

[XPU] Fix UT errors in the sam3 and lfm series model. (#42798) * Make sam3 tests pass on XPU * Update flm2 tests GT for XPU * Remove the skip tests of local mask for XPU * Pass position_ids to varlen FA2 * Change modular also * Skip FA2 bwd tests * Make style * Increase rtol * Adapt to the main branch * fix cuda 1 --------- Co-authored-by: Yih-Dar <2521628+ydshieh@users.noreply.github.com> Co-authored-by: ydshieh <ydshieh@users.noreply.github.com>