[core] parallel loading of shards (#12028)
* checking.
* checking
* checking
* up
* up
* up
* Apply suggestions from code review
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com>
* up
* up
* fix
* review feedback.
---------
Co-authored-by: Dhruv Nair <dhruv.nair@gmail.com>
