DeepSpeed
support dynamic sequence length
#424
Merged

support dynamic sequence length #424

RezaYazdaniAminabadi
supporting dynamic sequence length for transformer kernel
a308637a
set sequence in more layers
0d3039be
fixing the strided-gemm bug
c896b5c0
precommit
aad95c40
conglongli fixing cublas error
dc3e0643
fixing parameters and naming
5963997b
fixing the dynamic sequence-length with any arbitrary 8-aligned seq-len
00439bd1
running precommit
643c33b1
supporting dynamic sequence length for transformer kernel
132cfa05
set sequence in more layers
4a7aae25
fixing the strided-gemm bug
af6f4dd8
precommit
6659240f
conglongli fixing cublas error
2d36279d
fixing parameters and naming
8cb24947
fixing the dynamic sequence-length with any arbitrary 8-aligned seq-len
e15eb8ec
running precommit
551da94f
Merge branch 'reyazda/support_dynamic_seqlength' of github.com:micros…
5f9a046e
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from arashashari arashashari 5 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from awan-10 awan-10 5 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from cli99 cli99 5 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from conglongli conglongli 5 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from eltonzheng eltonzheng 5 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from jeffra jeffra 5 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from minjiaz minjiaz 5 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from niumanar niumanar 5 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from samyam samyam 5 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from ShadenSmith ShadenSmith 5 years ago
RezaYazdaniAminabadi RezaYazdaniAminabadi requested a review from tjruwase tjruwase 5 years ago
eltonzheng
eltonzheng approved these changes on 2020-09-20
RezaYazdaniAminabadi Merge branch 'master' into reyazda/support_dynamic_seqlength
34d55f0c
add intermediate_size parameter when changing sequence_length
03e28fce
pre-commit
8b8f8705
Merge branch 'master' into reyazda/support_dynamic_seqlength
720df126
ShadenSmith
ShadenSmith approved these changes on 2020-09-21
ShadenSmith ShadenSmith merged f0f2a702 into master 5 years ago
ShadenSmith ShadenSmith added enhancement
ShadenSmith ShadenSmith deleted the reyazda/support_dynamic_seqlength branch 5 years ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone