transformers
6eae29f4
- EP: inline the shared-batch check into EPImplementation
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
7 days ago
EP: inline the shared-batch check into EPImplementation `_same_ranks` had one caller; the comparison of the TP and EP groups' ranks now sits where `shares_batch` is set. Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
References
#49429 - Expert-parallel implementations for `ep_dispatch_experts`: all-reduce at inference, all-to-all in training
Author
IlyasMoutawwakil
Parents
d8763955
Loading