Megatron-DeepSpeed
[BNB] integrate `StableEmbeding` into `VocabParallelEmbedding` logic
#182

Merged

[BNB] integrate `StableEmbeding` into `VocabParallelEmbedding` logic #182

stas00 merged 5 commits into main from bnb-stable-embed

move checks into args; undo StableEmbedding

2f034843

integrate StableEmedding into Embedding

dab20642

stas00 commented on 2021-11-07

cleanup

1bba3748

ensure tp>1 is first for bnb

6306e1d8

Merge remote-tracking branch 'origin/main' into bnb-stable-embed

1dfaf541

stas00 merged a34ca7f2 into main 4 years ago

stas00 deleted the bnb-stable-embed branch 4 years ago

Reviewers

TimDettmers

Assignees

No one assigned

Labels

None yet

Milestone

No milestone