:red_circle: :red_circle: :red_circle: supersede paligemma forward to shift pos id indexing (#36859)
* supersede paligemma forward to shift pos id indexing
* fix prepare_inputs_ as well
* fix modular error
---------
Co-authored-by: Arthur <48595927+ArthurZucker@users.noreply.github.com>