onnxruntime
4f7d0f5b - Support LoRA adapters with plugin EP allocators (#32221)

Commit
52 days ago
Support LoRA adapters with plugin EP allocators (#32221) Allow LoRA adapters to work with plugin EP device allocators when a data transfer implementation is not available during adapter creation. Provider-bridge EPs continue to copy adapter parameters eagerly. For plugin EPs, adapter parameters remain CPU-backed and are copied by the session through its plugin-aware data transfer manager during inference.
Author
Parents
Loading