Release swap buffers for persisted params (#2089)
* Split parameter offload from z3
* Format fixes
* Bug fixes
* Cleanup
* Remove dead code
* Release swap buffers for persisted params
* Format fixes
* Format fixes
* Pass args correctly
* Use pinned memory for nvme offload
* Merge with masster
* Fix missing import
* model pesistence params
* Fix merge issues
* Handle none device
* Usse log_dist
