Fix path generation in IP Adapter (#6564)
* Fix path generation on Windows
* Update set_default_attn_processors
* Use pathlib
* Fix quality
* Fix copy
* Revert changes in set_default_attn_processors
---------
Co-authored-by: Sayak Paul <spsayakpaul@gmail.com>