Add transformers 4.36 tests (#2085)
* add transformers 4.36 tests
* add test depending on tranformers version
* add min transformers required version for gemma
* update macos
* fix whisper test
* add opt
* fix mpt
* add comment
* add granite testwhen supported by transformers
