DeepSpeed
autoTP for fused qkv weight
#3844
Merged
Overview
Commits
12
Changes
View On GitHub

autoTP for fused qkv weight #3844

jeffra merged 12 commits into deepspeedai:master from inkcherry:fused_qkv_weight
inkcherry
inkcherry autoTP for fused qkv weight
311b1330
inkcherry fix format
1ae9467b
inkcherry inkcherry requested a review from RezaYazdaniAminabadi RezaYazdaniAminabadi 2 years ago
inkcherry inkcherry requested a review from jeffra jeffra 2 years ago
inkcherry inkcherry requested a review from mrwyattii mrwyattii 2 years ago
inkcherry inkcherry requested a review from awan-10 awan-10 2 years ago
inkcherry inkcherry requested a review from cmikeh2 cmikeh2 2 years ago
inkcherry inkcherry requested a review from arashb arashb 2 years ago
inkcherry clean up
41b3ccbb
inkcherry clean up
ba768ce4
inkcherry
inkcherry clean up
071d5385
inkcherry update
303ec9ef
inkcherry
abhilash1910
abhilash1910 commented on 2023-07-06
tjruwase Merge branch 'master' into fused_qkv_weight
1ccb2149
RezaYazdaniAminabadi
RezaYazdaniAminabadi commented on 2023-07-26
RezaYazdaniAminabadi
inkcherry make logic flow to util and move to file
8e21d7e6
inkcherry
inkcherry Merge branch 'master' into fused_qkv_weight
5a3cbdf9
molly-smith molly-smith requested a review from molly-smith molly-smith 2 years ago
RezaYazdaniAminabadi
RezaYazdaniAminabadi approved these changes on 2023-07-27
RezaYazdaniAminabadi Merge branch 'master' into fused_qkv_weight
26ade646
jeffra jeffra enabled auto-merge 2 years ago
molly-smith
molly-smith
molly-smith approved these changes on 2023-07-27
jeffra fix formatting
6c410b8e
disabled auto-merge 2 years ago
Manually disabled by user
jeffra remove empty line
c0710378
jeffra jeffra enabled auto-merge 2 years ago
jeffra jeffra merged 6b877d2d into master 2 years ago
inkcherry
andre-bauer

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum