transformers

[Umbrella] FSDP2 + expert-parallel token dispatch, with sharded-loading prefetch

#48204

Open