DeepSpeed
Llama Tensor Parallel Accuracy Fix
#3788
Merged

Llama Tensor Parallel Accuracy Fix #3788

jeffra merged 6 commits into master from cholmes/fix-llama-tp
cmikeh2
cmikeh2 Missing strided copy for gated MLP
d0b3fc75
cmikeh2 cmikeh2 requested a review from RezaYazdaniAminabadi RezaYazdaniAminabadi 3 years ago
cmikeh2 cmikeh2 requested a review from jeffra jeffra 3 years ago
cmikeh2 cmikeh2 requested a review from mrwyattii mrwyattii 3 years ago
cmikeh2 cmikeh2 requested a review from awan-10 awan-10 3 years ago
cmikeh2 cmikeh2 requested a review from arashb arashb 3 years ago
cmikeh2 Merge branch 'master' into cholmes/fix-llama-tp
6bfa5b2d
awan-10
awan-10 approved these changes on 2023-06-22
awan-10 awan-10 enabled auto-merge (squash) 3 years ago
awan-10 Merge branch 'master' into cholmes/fix-llama-tp
f960eafb
awan-10 awan-10 added merge-queue
jeffra Merge branch 'master' into cholmes/fix-llama-tp
e45ea15d
loadams Merge branch 'master' into cholmes/fix-llama-tp
504b31f8
disabled auto-merge 3 years ago
Manually disabled by user
jeffra Merge branch 'master' into cholmes/fix-llama-tp
f533283d
jeffra
jeffra approved these changes on 2023-06-23
jeffra jeffra merged b7e1010b into master 3 years ago
jeffra jeffra deleted the cholmes/fix-llama-tp branch 3 years ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone