huggingface/accelerate

Pull Requests Commits

Update modeling.py by adding try-catch section to skip the unavailable devices (#2681)

MeVeryHandsome committed 1 year ago

Verified 11a36328

Add feature to allow redirecting std streams into log files when using torchrun as the launcher. (#2740)

lyuwen committed 1 year ago

Verified 5cfe4094

Update setup.py + test falures found during release

muellerzr committed 1 year ago

5b3a7f38

Fix tests on main (#2739)

muellerzr committed 1 year ago

Verified 060361fc

FEAT: Add LOMO optimizer (#2695)

younesbelkada committed 1 year ago

Verified 6ac27e23

Fix offload device type (#2717)

yhna940 committed 1 year ago

Verified ba5f4921

Fix Documentation in FSDP and DeepSpeed Concept Guide (#2725)

fabianlim committed 1 year ago

Verified 2c767338

Docs: Fix build main documentation (#2729)

SunMarc committed 1 year ago

Verified 234a8550

Fix sampler (#2728)

SunMarc committed 1 year ago

Verified 232ebd15

fix sampler serialization (#2723)

SunMarc committed 1 year ago

Verified 4d3d4bc8

Fixup `free_memory` to deal with garbage collection (#2716)

muellerzr committed 1 year ago

Verified 2b1e7bd4

Segment out a deepspeed docker image (#2707)

muellerzr committed 1 year ago

Verified c7e5e41b

Add Upcasting for FSDP in Mixed Precision. Add Concept Guide for FSPD and DeepSpeed. (#2674)

fabianlim committed 1 year ago

Verified 9557598c

allow gather_for_metrics to be more flexible (#2710)

SunMarc committed 1 year ago

Verified 156331ae

fix bnb multi gpu training (#2714)

SunMarc committed 1 year ago

Verified cd7df411

Add diffusers to req (#2711)

muellerzr committed 1 year ago

Verified 6af157ea

add distributed examples (#2672)

SunMarc committed 1 year ago

Verified 83317b30

Change dataloader send_to_device calls to non-blocking (#2685)

drhead committed 1 year ago

Verified e831bcb3

Add version checks for the import of DeepSpeed moe utils (#2705)

pacman100 committed 1 year ago

Verified 092c3af0

add cann version info to command accelerate env (#2689)

ji-huazhong committed 1 year ago

Verified 3e944c55

Do a pip freeze during workflows (#2704)

muellerzr committed 1 year ago

Verified f6773736

fix support (#2699)

SunMarc committed 1 year ago

Verified f7daaaa3

Add source code for DataLoader Animation (#2696)

muellerzr committed 1 year ago

Verified 3dc131cd

Simplify test logic (#2697)

pacman100 committed 1 year ago

Verified ef0f62c1

Fix the rng states of sampler's generator to be synchronized for correct sharding of dataset across GPUs (#2694)

pacman100 committed 1 year ago

Verified baafaf4a

Enable BF16 autocast to everything during FP8 + some tweaks to enable FSDP (#2655)

muellerzr committed 1 year ago

Verified abc86c0e

Deprecate tqdm args + slight logic tweaks (#2673)

muellerzr committed 1 year ago

Verified 4450cb31

fix backend check (#2670)

jiqing-feng committed 1 year ago

Verified fd0dcd1c

Pin DS...again.. (#2679)

muellerzr committed 1 year ago

Verified f478201c

Fix deepspeed moe test with version check (#2677)

pacman100 committed 1 year ago

Verified c7046845

Newer Older