transformers

12f043ea - Fix `MarianTokenizer` to remove metaspace character in `decode` (#26091)

Fix `MarianTokenizer` to remove metaspace character in `decode` (#26091) * add: check to remove metaspace from marian tokenizer * fix: metaspace character being removed from everywhere * fix: remove redundant check at top * add: test for marian tokenizer decode fix * fix: simplified the test