huggingface/accelerate

Pull Requests Commits

muellerzr committed 1 year ago

59641834

Let's test this out

muellerzr committed 1 year ago

a8e823c8

Optimize docker build speed + space

muellerzr committed 1 year ago

2b718f04

Segment out a deepspeed docker image (#2707)

muellerzr committed 1 year ago

Verified c7e5e41b

Add Upcasting for FSDP in Mixed Precision. Add Concept Guide for FSPD and DeepSpeed. (#2674)

fabianlim committed 1 year ago

Verified 9557598c

allow gather_for_metrics to be more flexible (#2710)

SunMarc committed 1 year ago

Verified 156331ae

fix bnb multi gpu training (#2714)

SunMarc committed 1 year ago

Verified cd7df411

Add diffusers to req (#2711)

muellerzr committed 1 year ago

Verified 6af157ea

add distributed examples (#2672)

SunMarc committed 1 year ago

Verified 83317b30

Change dataloader send_to_device calls to non-blocking (#2685)

drhead committed 1 year ago

Verified e831bcb3

Add version checks for the import of DeepSpeed moe utils (#2705)

pacman100 committed 1 year ago

Verified 092c3af0

add cann version info to command accelerate env (#2689)

ji-huazhong committed 1 year ago

Verified 3e944c55

Do a pip freeze during workflows (#2704)

muellerzr committed 1 year ago

Verified f6773736

fix support (#2699)

SunMarc committed 1 year ago

Verified f7daaaa3

Add source code for DataLoader Animation (#2696)

muellerzr committed 1 year ago

Verified 3dc131cd

Simplify test logic (#2697)

pacman100 committed 1 year ago

Verified ef0f62c1

Fix the rng states of sampler's generator to be synchronized for correct sharding of dataset across GPUs (#2694)

pacman100 committed 1 year ago

Verified baafaf4a

Enable BF16 autocast to everything during FP8 + some tweaks to enable FSDP (#2655)

muellerzr committed 1 year ago

Verified abc86c0e

Deprecate tqdm args + slight logic tweaks (#2673)

muellerzr committed 1 year ago

Verified 4450cb31

fix backend check (#2670)

jiqing-feng committed 1 year ago

Verified fd0dcd1c

Pin DS...again.. (#2679)

muellerzr committed 1 year ago

Verified f478201c

Fix deepspeed moe test with version check (#2677)

pacman100 committed 1 year ago

Verified c7046845

Handle MoE models with DeepSpeed (#2662)

pacman100 committed 1 year ago

Verified 701e24c5

`tqdm`: `*args` should come ahead of `main_process_only` (#2654)

rb-synth committed 1 year ago

Verified 37da848e

Revert "fix backend check (#2652)" (#2669)

muellerzr committed 1 year ago

Verified c470a133

Megatron plugin can support NPU (#2667)

zhangsheng377 committed 1 year ago

Verified 581a390e

fix backend check (#2652)

jiqing-feng committed 1 year ago

Verified 2fc48c7e

Add MLU rng state setter (#2664)

ArthurinRUC committed 1 year ago

Verified 10242311

Fix test_from_pretrained_low_cpu_mem_usage_measured failure (#2644)

yuanwu2017 committed 1 year ago

Verified 5ca095a3

Don't use deprecated `Repository` anymore (#2658)

Wauplin committed 1 year ago

Verified b77c6539

Older