PR #424 support dynamic sequence length

supporting dynamic sequence length for transformer kernel

Reza Yazdani committed 5 years ago

set sequence in more layers

Reza Yazdani committed 5 years ago

fixing the strided-gemm bug

Reza Yazdani committed 5 years ago

precommit

Reza Yazdani committed 5 years ago

fixing cublas error

conglongli committed 5 years ago

fixing parameters and naming

Reza Yazdani committed 5 years ago

fixing the dynamic sequence-length with any arbitrary 8-aligned seq-len

Reza Yazdani committed 5 years ago

running precommit

Reza Yazdani committed 5 years ago

supporting dynamic sequence length for transformer kernel

Reza Yazdani committed 5 years ago

set sequence in more layers

Reza Yazdani committed 5 years ago

fixing the strided-gemm bug

Reza Yazdani committed 5 years ago

precommit

Reza Yazdani committed 5 years ago

fixing cublas error

conglongli committed 5 years ago

fixing parameters and naming

Reza Yazdani committed 5 years ago

fixing the dynamic sequence-length with any arbitrary 8-aligned seq-len

Reza Yazdani committed 5 years ago

running precommit

Reza Yazdani committed 5 years ago

Merge branch 'reyazda/support_dynamic_seqlength' of github.com:microsoft/DeepSpeed into reyazda/support_dynamic_seqlength

Reza Yazdani committed 5 years ago

Merge branch 'master' into reyazda/support_dynamic_seqlength

RezaYazdaniAminabadi committed 5 years ago

add intermediate_size parameter when changing sequence_length

Reza Yazdani committed 5 years ago

pre-commit

Reza Yazdani committed 5 years ago

Merge branch 'master' into reyazda/support_dynamic_seqlength

GitHub committed 5 years ago

DeepSpeed support dynamic sequence length #424 Merged