DeepSpeed
Fix fused qkv sizing for bloom
#4161
Merged

Fix fused qkv sizing for bloom #4161

tjruwase merged 4 commits into master from mosm/bloom7b-fused-qkvw
molly-smith
molly-smith Fix fused qkv sizing for bloom
b9798b48
molly-smith molly-smith requested a review from RezaYazdaniAminabadi RezaYazdaniAminabadi 2 years ago
molly-smith molly-smith requested a review from jeffra jeffra 2 years ago
molly-smith molly-smith requested a review from mrwyattii mrwyattii 2 years ago
molly-smith molly-smith requested a review from awan-10 awan-10 2 years ago
molly-smith molly-smith requested a review from cmikeh2 cmikeh2 2 years ago
molly-smith molly-smith requested a review from arashb arashb 2 years ago
loadams Merge branch 'master' into mosm/bloom7b-fused-qkvw
dfce31dd
molly-smith Merge branch 'master' into mosm/bloom7b-fused-qkvw
c4abb405
loadams Merge branch 'master' into mosm/bloom7b-fused-qkvw
942863a3
loadams
loadams approved these changes on 2023-08-24
dc3671
tjruwase tjruwase merged 042115c8 into master 2 years ago
loadams loadams deleted the mosm/bloom7b-fused-qkvw branch 2 years ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone