Megatron-DeepSpeed
a34ca7f2
- [BNB] integrate `StableEmbeding` into `VocabParallelEmbedding` logic (#182)
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
4 years ago
[BNB] integrate `StableEmbeding` into `VocabParallelEmbedding` logic (#182) * move checks into args; undo StableEmbedding * integrate StableEmedding into Embedding * cleanup * ensure tp>1 is first for bnb
References
#182 - [BNB] integrate `StableEmbeding` into `VocabParallelEmbedding` logic
Author
stas00
Parents
6d146b5f
Loading