Improve load_ip_adapter RAM Usage (#10948)
* Update ip_adapter.py
* Update ip_adapter.py
* Update ip_adapter.py
* Update ip_adapter.py
* Update ip_adapter.py
* Apply style fixes
---------
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
Co-authored-by: hlky <hlky@hlky.ac>