microsoft/DeepSpeed

Pull Requests Commits

update to new cpu accelerator

mrwyattii committed 1 year ago

790cf54c

Update accelerator names

loadams committed 1 year ago

f395f839

Rename accelelerators

loadams committed 1 year ago

0b0fd442

Merge branch 'master' into loadams/x86-accelerator

loadams committed 1 year ago

Verified ee914c10

disable compile tests for torch<2.1 (#5121)

mrwyattii committed 1 year ago

Verified d67d4e5b

removed if condition in `if collate_fn is None` (#5107)

bm-synth committed 1 year ago

Verified 9aaead55

BF16 optimizer: Improve device utilization by immediate grad update (#4975)

deepcharm committed 1 year ago

Verified 3c0bd312

[NPU]ZeRO-Infinity feature compatibility (#5077)

misstek committed 1 year ago

Verified 0d9cfa01

Stop tracking backward chain of broadcast (ZeRO3) (#5113)

tohtana committed 1 year ago

Verified f295aea0

Update version.txt after 0.13.2 release (#5119)

mrwyattii committed 1 year ago

Verified 41bc9fee

Remove optimizer step on initialization (#5104)

tohtana committed 1 year ago

Verified 18179807

Add HIP conversion file outputs to .gitignore (#5111)

lekurile committed 1 year ago

Verified 25a02047

Skip Triton import for AMD (#5110)

lekurile committed 1 year ago

Verified d04a8386

Fix alignment of optimizer states when loading (#5105)

tohtana committed 1 year ago

Verified 0a10bd42

Support `exclude_frozen_parameters` for `zero_to_fp32.py` script (#4979)

andstor committed 1 year ago

Verified 2518cc42

47% FastGen speedup for low workload - refactor allocator (#5090)

HeyangQin committed 1 year ago

Verified 3c811c96

Split is_synchronized_device api to multiple apis (#5026)

BacharL committed 1 year ago

Verified 697f945a

Switch hasattr check from compile to compiler (#5096)

loadams committed 1 year ago

Verified 3255569b

[xs] fix ZEROPP convergence test (#5061)

yundai424 committed 1 year ago

Verified 688239e3

optimize clip_grad_norm_ function (#4915)

mmhab committed 1 year ago

Verified 961bc856

[NPU] replace 'cuda' with get_accelerator().device_name() (#5095)

minchao-sun committed 1 year ago

Verified 4f477328

HPU Accelerator: fix supported_dtypes API (#5094)

nelyahu committed 1 year ago

Verified b42a4706

Merge branch 'master' into loadams/x86-accelerator

loadams committed 1 year ago

Verified a169d5af

Add check to exempt 'torch.cuda' from pre-commit formatting checks - this is needed to determine which torch accelerator, cpu or cuda we are using

loadams committed 1 year ago

8c477624

Forgot to import psutil

loadams committed 1 year ago

e41e8b5c

Merge branch 'master' into loadams/x86-accelerator

loadams committed 1 year ago

Verified 75cbcaf5

Update x86 memory management and remove last of cuda references, update default

loadams committed 1 year ago

2d1a0c10

Update nv-accelerate to latest torch (#5040)

loadams committed 1 year ago

Verified ec49222c

Enable torch.compile with ZeRO (Experimental) (#4878)

tohtana committed 1 year ago

Verified c3cfe96b

Add backwards compatibility w/ older versions of diffusers (<0.25.0) (#5083)

lekurile committed 1 year ago

Verified e212845e

Older