transformers

165f6578 - Simplify the dispatch: torch's differentiable all-to-all, the grouped forward for the local experts, ids from the count exchange

Simplify the dispatch: torch's differentiable all-to-all, the grouped forward for the local experts, ids from the count exchange Also reject expert parallel plans that shard anything but the experts, since the ranks no longer see the same batch.