simplify extra tokens logic in base (#43230)
* simplify extra tokens logic in base
* ignore additional_special_tokens in signature
* fix florence2
* fixes
* ruff
* nit
* nit
* comments
* _merge_kwargs changes expected values in tests - made tests more dynamic
* fix processing test
* guide v5
