microsoft/DeepSpeed

Pull Requests Commits

some fixes for the the new Falcon Architecture

Reza Yazdani committed 1 year ago

e1ba1077

add falcon test script

Reza Yazdani committed 1 year ago

dfa4784c

fix a few issues & add falcon-7b support with meta-tensor loading

Reza Yazdani committed 1 year ago

2108c701

more fixes on the ckpt loading

Reza Yazdani committed 1 year ago

fe4cd2ef

add the load-checkpoint support for falcon-40b (reducing loading time from over 10 minutes to about 15 sec)

Reza Yazdani committed 1 year ago

8c5967f4

Merge branch 'master' into ds-inference/add-falcon-support

RezaYazdaniAminabadi committed 1 year ago

Verified f512587f

fix ccl_backend and residual_add problems (#3642)

Dino Chen committed 1 year ago

Verified 3f5e4931

Account for expert parameters when calculating the total number of parameters in the model (#3720)

alito committed 1 year ago

Verified 9a8f6a1d

add Chinese Zhihu social account (#3755)

conglongli committed 1 year ago

Verified b692d236

remove UtilsBuilder load, use torch (un)flatten ops (#3728)

inkcherry committed 1 year ago

Verified 5a5340d0

Fix output transpose dimension bugs (#3747)

loadams committed 1 year ago

Verified cd911f9a

fix hybrid engine mlp module (#3736)

tensor-tang committed 1 year ago

Verified 45466afa

Include cublas error details when getting cublas handle fails (#3695)

jli committed 1 year ago

Verified 46bb08c2

Fix autotuner get_gas_from_user_config (#3664)

straywarrior committed 1 year ago

Verified 09332dbf

Fix apex install bugs (#3741)

loadams committed 1 year ago

Verified 1b401823

FP8 unittest for H100 (#3731)

jomayeri committed 1 year ago

Verified 6f4fc30b

Documentation for DeepSpeed Accelerator Abstraction Interface (#3184)

delock committed 1 year ago

Verified 5289d691

jeffra committed 1 year ago

54bd9e29

Update Dockerfile with newer cuda and torch. (#3716)

loadams committed 1 year ago

Verified a65f6b9e

single node pdsh sigkill (#3730)

abhilash1910 committed 1 year ago

Verified 26b3e732

[Bugfix][CPU] Remove C++ version in CPU OpBuilder (#3643)

delock committed 1 year ago

Verified 8bfbb0e3

Increase tensor creator coverage (#3684)

tjruwase committed 1 year ago

Verified 046afced

Merge branch 'master' into ds-inference/add-falcon-support

RezaYazdaniAminabadi committed 1 year ago

Verified 38b611de

Fix typo in name of hybrid engine function (#3704)

loadams committed 1 year ago

Verified fc8e5c88

zero3 performance optimizations (#3622)

BacharL committed 1 year ago

Verified 0977106a

Merge branch 'master' into ds-inference/add-falcon-support

RezaYazdaniAminabadi committed 1 year ago

Verified 468c68ec

DeepSpeed overview in Japanese (#3709)

conglongli committed 1 year ago

Verified df425097

Small tweak on cuda version mismatch documentation (#3706)

jli committed 1 year ago

Verified d414678d

Fix unit test typo in tests/unit/ops/transformer/inference (#3697)

mrwyattii committed 1 year ago

Verified fb2b4ab1

change partititon_name to partition_name (#3700)

digger-yu committed 1 year ago

Verified c5edc91e

Older