Optim: APOLLO optimizer integration (#36062)
* Added APOLLO optimizer integration
* fix comment
* Remove redundancy: Modularize low-rank optimizer construction
* Remove redundancy: Remove useless comment
* Fix comment: Add typing
* Fix comment: Rewrite apollo desc
