huggingface/accelerate

Pull Requests Commits

Working version

muellerzr committed 1 year ago

d9a74599

muellerzr committed 1 year ago

70d31ba5

New template (#2808)

muellerzr committed 1 year ago

Verified b24a0ef5

fix comet test (#2804)

SunMarc committed 1 year ago

Verified e061edc6

Fix type in accelerator.py (#2800)

qgallouedec committed 1 year ago

Verified c3f42269

Fix Wrong use of sync_gradients used to implement sync_each_batch (#2790)

fabianlim committed 1 year ago

Verified 05534836

Add Elastic Launch Support to `notebook_launcher` (#2788)

yhna940 committed 1 year ago

Verified 415789d0

fix duplicate elements in split_between_processes (#2781)

hkunzhe committed 1 year ago

Verified ae472bac

Fixup CLI test (#2796)

muellerzr committed 1 year ago

Verified 4f2c2ba4

Upgrade huggingface's megatron to nvidia's megatron when use MegatronLMPlugin (#2501)

zhangsheng377 committed 1 year ago

Verified e26065a2

FIX / FSDP : Guard fsdp utils for earlier PyTorch versions (#2794)

younesbelkada committed 1 year ago

Verified 1cb6fdcf

Introduce shard-merging util for FSDP (#2772)

muellerzr committed 1 year ago

Verified 4ba436ec

Skip tied weights disk offload test (#2782)

SunMarc committed 1 year ago

Verified 91e8a3ce

Add arg from CLI to fix failing test (#2783)

muellerzr committed 1 year ago

Verified 4ad4d28c

Enable config for fsdp activation checkpointing (#2779)

helloworld1 committed 1 year ago

Verified befd87f0

Skip deepspeed test (#2776)

SunMarc committed 1 year ago

Verified abce3604

Fix small edge case in get_module_leaves (#2774)

SunMarc committed 1 year ago

Verified 27a607ea

fix minor typo (#2767)

TemryL committed 1 year ago

Verified aa21174d

optimize get_module_leaves speed (#2756)

BBuf committed 1 year ago

Verified 6cf1cc0a

Sets default to PyTorch defaults based on backend (#2758)

muellerzr committed 1 year ago

Verified bb465a9c

Enable sharded cpu resume (#2762)

muellerzr committed 1 year ago

Verified 67308ca6

Revert "Simplify CLI args validation and ensure CLI args take precedence over config file." (#2763)

muellerzr committed 1 year ago

Verified 63772f6a

fix cpu omp num threads set (#2755)

jiqing-feng committed 1 year ago

Verified 8798cf06

Fix sagemaker config (#2753)

muellerzr committed 1 year ago

Verified 47bb2dd5

Simplify CLI args validation and ensure CLI args take precedence over config file. (#2757)

Iain-S committed 1 year ago

Verified 724824ab

Fix duplicate environment variable check in multi-cpu condition (#2752)

yhna940 committed 1 year ago

Verified afc2c99e

Fix max_memory assignment (#2751)

SunMarc committed 1 year ago

Verified 0fb95a2d

LOMO / FIX: Support multiple optimizers (#2745)

younesbelkada committed 1 year ago

Verified 7ac153f4

Fix stacklevel in `logging` to log the actual user call site (instead of the call site inside the logger wrapper) of log functions (#2730)

luowyang committed 1 year ago

Verified 0f1b91bb

Fixed the problem of incorrect conditional judgment statement when configuring enable_cpu_affinity (#2748)

ji-huazhong committed 1 year ago

Verified d1eb44c8

Older