Add limit_all_gathers option to fsdp_config and fix forward_prefetch bug (#21489)
* Add limit_all_gathers option to fsdp_config and fix forward_prefetch bug
* Fix black issue
* Fix ruff failure
* Incorporate PR feedbacks
* Incorporate PR feedbacks
* Incorporate PR feedbacks