microsoft/DeepSpeed

Pull Requests Commits

Update README.md

mrwyattii committed 1 year ago

Verified b7f7ae5a

Update version.txt

mrwyattii committed 1 year ago

Verified f64343a7

Update README.md

mrwyattii committed 1 year ago

Verified 1ac843a3

FastGen Jan 2024 blog (#4980)

mrwyattii committed 1 year ago

Verified 79564203

Fix T5 and mistral model meta data error (#4958)

Yejing-Lai committed 1 year ago

Verified e62a47e2

Add API to set a module as a leaf node when recursively setting Z3 hooks (#4966)

tohtana committed 1 year ago

Verified 96c5a873

Enhance query APIs for text generation (#4965)

tohtana committed 1 year ago

Verified 5dea776a

params partition for skip_init (#4722)

inkcherry committed 1 year ago

Verified 3110c388

Fixes for training models with bf16 + freshly initialized optimizer via `load_module_only` (#4141)

haileyschoelkopf committed 1 year ago

Verified 870ae041

Prevent infinite recursion when DS_ACCELERATOR is set to cuda (#4962)

ShukantPal committed 1 year ago

Verified 740080c0

Update the DeepSpeed Phi-2 impl. to work with the HF latest changes (#4950)

arashb committed 1 year ago

Verified 1b34a4d3

[MiCS]Add the path to support sequence_data_parallel on MiCS (#4926)

ys950902 committed 1 year ago

Verified 752a50ac

Stage_1_and_2.py: fix assert for reduce_scatter configurations combinations (#4964)

nelyahu committed 1 year ago

Verified 69a45988

Add missing op_builder.hpu component for HPU accelerator (#4963)

nelyahu committed 1 year ago

Verified e2780764

[docs] Add new autotp supported model in tutorial (#4960)

delock committed 1 year ago

Verified 7739c0ac

Fix bug where ZeRO2 never uses the reduce method. (#4946)

CurryRice233 committed 1 year ago

Verified a85b6e47

Optimize preprocess for ragged batching (#4942)

tohtana committed 1 year ago

Verified d0b238a3

fix uneven issue & add balance autotp (#4697)

Yejing-Lai committed 1 year ago

Verified 29417ab5

Fix bug in CI model caching (#4951)

mrwyattii committed 1 year ago

Verified 43daf413

Fix docs inconsistency on default value for `ignore_unused_parameters` (#4949)

loadams committed 1 year ago

Verified 05cc3462

Cache HF model list for inference tests (#4940)

mrwyattii committed 1 year ago

Verified 13d84b49

InfV2 - remove generation config requirement (#4938)

mrwyattii committed 1 year ago

Verified 62004e0d

Only run MII CI for inference changes (#4939)

mrwyattii committed 1 year ago

Verified c6b975b8

Allow specifying mii branch for nv-a6000 workflow (#4936)

mrwyattii committed 1 year ago

Verified 47389852

autoTP for Qwen (#4902)

inkcherry committed 1 year ago

Verified ee7db483

Enable quantizer op on ROCm (#4114)

rraminen committed 1 year ago

Verified f2d4845f

Specify permissions for secrets.GITHUB_TOKEN (#4927)

mrwyattii committed 1 year ago

Verified 6112d08c

Fix confusing width in simd_load (#4714)

yzhblind committed 1 year ago

Verified f5179031

DeepSpeedZeroOptimizer: refactor bit16 flattening to support more accelerators (#4833)

nelyahu committed 1 year ago

Verified ade98365

Add support of Qwen models (7b, 14b, 72b) to DeepSpeed-FastGen (#4913)

ZonePG committed 1 year ago

Verified ed10cc73

Newer Older