huggingface/accelerate

Pull Requests Commits

Update accelerator

muellerzr committed 2 years ago

72e214f5

Use partial state for fsdp saving/loading

muellerzr committed 2 years ago

ab14a5e6

Fix small edge case in get_module_leaves (#2774)

SunMarc committed 2 years ago

Verified 27a607ea

fix minor typo (#2767)

TemryL committed 2 years ago

Verified aa21174d

optimize get_module_leaves speed (#2756)

BBuf committed 2 years ago

Verified 6cf1cc0a

Sets default to PyTorch defaults based on backend (#2758)

muellerzr committed 2 years ago

Verified bb465a9c

Enable sharded cpu resume (#2762)

muellerzr committed 2 years ago

Verified 67308ca6

Revert "Simplify CLI args validation and ensure CLI args take precedence over config file." (#2763)

muellerzr committed 2 years ago

Verified 63772f6a

fix cpu omp num threads set (#2755)

jiqing-feng committed 2 years ago

Verified 8798cf06

Fix sagemaker config (#2753)

muellerzr committed 2 years ago

Verified 47bb2dd5

Simplify CLI args validation and ensure CLI args take precedence over config file. (#2757)

Iain-S committed 2 years ago

Verified 724824ab

Fix duplicate environment variable check in multi-cpu condition (#2752)

yhna940 committed 2 years ago

Verified afc2c99e

Fix max_memory assignment (#2751)

SunMarc committed 2 years ago

Verified 0fb95a2d

LOMO / FIX: Support multiple optimizers (#2745)

younesbelkada committed 2 years ago

Verified 7ac153f4

Fix stacklevel in `logging` to log the actual user call site (instead of the call site inside the logger wrapper) of log functions (#2730)

luowyang committed 2 years ago

Verified 0f1b91bb

Fixed the problem of incorrect conditional judgment statement when configuring enable_cpu_affinity (#2748)

ji-huazhong committed 2 years ago

Verified d1eb44c8

Update modeling.py by adding try-catch section to skip the unavailable devices (#2681)

MeVeryHandsome committed 2 years ago

Verified 11a36328

Add feature to allow redirecting std streams into log files when using torchrun as the launcher. (#2740)

lyuwen committed 2 years ago

Verified 5cfe4094

Update setup.py + test falures found during release

muellerzr committed 2 years ago

5b3a7f38

Fix tests on main (#2739)

muellerzr committed 2 years ago

Verified 060361fc

FEAT: Add LOMO optimizer (#2695)

younesbelkada committed 2 years ago

Verified 6ac27e23

Fix offload device type (#2717)

yhna940 committed 2 years ago

Verified ba5f4921

Fix Documentation in FSDP and DeepSpeed Concept Guide (#2725)

fabianlim committed 2 years ago

Verified 2c767338

Docs: Fix build main documentation (#2729)

SunMarc committed 2 years ago

Verified 234a8550

Fix sampler (#2728)

SunMarc committed 2 years ago

Verified 232ebd15

fix sampler serialization (#2723)

SunMarc committed 2 years ago

Verified 4d3d4bc8

Fixup `free_memory` to deal with garbage collection (#2716)

muellerzr committed 2 years ago

Verified 2b1e7bd4

Segment out a deepspeed docker image (#2707)

muellerzr committed 2 years ago

Verified c7e5e41b

Add Upcasting for FSDP in Mixed Precision. Add Concept Guide for FSPD and DeepSpeed. (#2674)

fabianlim committed 2 years ago

Verified 9557598c

allow gather_for_metrics to be more flexible (#2710)

SunMarc committed 2 years ago

Verified 156331ae

Older