huggingface/accelerate

Pull Requests Commits

fix bnb multi gpu training (#2714)

SunMarc committed 1 year ago

Verified cd7df411

Add diffusers to req (#2711)

muellerzr committed 1 year ago

Verified 6af157ea

add distributed examples (#2672)

SunMarc committed 1 year ago

Verified 83317b30

Change dataloader send_to_device calls to non-blocking (#2685)

drhead committed 1 year ago

Verified e831bcb3

Add version checks for the import of DeepSpeed moe utils (#2705)

pacman100 committed 1 year ago

Verified 092c3af0

add cann version info to command accelerate env (#2689)

ji-huazhong committed 1 year ago

Verified 3e944c55

Do a pip freeze during workflows (#2704)

muellerzr committed 1 year ago

Verified f6773736

fix support (#2699)

SunMarc committed 1 year ago

Verified f7daaaa3

Add source code for DataLoader Animation (#2696)

muellerzr committed 1 year ago

Verified 3dc131cd

Simplify test logic (#2697)

pacman100 committed 1 year ago

Verified ef0f62c1

Fix the rng states of sampler's generator to be synchronized for correct sharding of dataset across GPUs (#2694)

pacman100 committed 1 year ago

Verified baafaf4a

Enable BF16 autocast to everything during FP8 + some tweaks to enable FSDP (#2655)

muellerzr committed 1 year ago

Verified abc86c0e

Deprecate tqdm args + slight logic tweaks (#2673)

muellerzr committed 1 year ago

Verified 4450cb31

fix backend check (#2670)

jiqing-feng committed 1 year ago

Verified fd0dcd1c

Pin DS...again.. (#2679)

muellerzr committed 1 year ago

Verified f478201c

Fix deepspeed moe test with version check (#2677)

pacman100 committed 1 year ago

Verified c7046845

Handle MoE models with DeepSpeed (#2662)

pacman100 committed 1 year ago

Verified 701e24c5

`tqdm`: `*args` should come ahead of `main_process_only` (#2654)

rb-synth committed 1 year ago

Verified 37da848e

Revert "fix backend check (#2652)" (#2669)

muellerzr committed 1 year ago

Verified c470a133

Megatron plugin can support NPU (#2667)

zhangsheng377 committed 1 year ago

Verified 581a390e

fix backend check (#2652)

jiqing-feng committed 1 year ago

Verified 2fc48c7e

Add MLU rng state setter (#2664)

ArthurinRUC committed 1 year ago

Verified 10242311

Fix test_from_pretrained_low_cpu_mem_usage_measured failure (#2644)

yuanwu2017 committed 1 year ago

Verified 5ca095a3

Don't use deprecated `Repository` anymore (#2658)

Wauplin committed 1 year ago

Verified b77c6539

Fix deepspeed plugin attr type (#2646)

yhna940 committed 1 year ago

Verified a9169146

Allow "auto" for gradient clipping in YAML (#2649)

regisss committed 1 year ago

Verified 5056d327

Typo fix in tracking.md (#2650)

brentyi committed 1 year ago

Verified c0a37015

device agnostic testing for hooks&utils&big_modeling (#2602)

ji-huazhong committed 1 year ago

Verified e9b9c7d0

add strict arg to load_checkpoint_and_dispatch (#2641)

SunMarc committed 1 year ago

Verified 6c09584f

add third-party device prefix to `execution_device` (#2612)

faaany committed 1 year ago

Verified b8c85839

Newer Older