huggingface/accelerate

Pull Requests Commits

Release: v1.7.0

SunMarc committed 1 year ago

9cb1a6b6

enable test_dispatch_model_tied_weights_memory_with_nested_offload_cpu on xpu (#3569)

yao-matrix committed 1 year ago

Verified 97c93c48

set backend correctly for CUDA+FSDP2+cpu-offload (#3574)

SunMarc committed 1 year ago

Verified cd37bbb6

Fix prevent duplicate GPU usage in distributed processing (#3526)

ved1beta committed 1 year ago

Verified 7aa3b56c

reenable FSDP2+qlora support (#3546)

winglian committed 1 year ago

Verified 14f4306c

Add regional compilation to cli tools and env vars (#3572)

IlyasMoutawwakil committed 1 year ago

Verified e6e71758

tune env command output (#3570)

yao-matrix committed 1 year ago

Verified 1f6efcea

simplify model.to logic (#3562)

yao-matrix committed 1 year ago

Verified 9fa97f96

add xpu synchronize (#3563)

faaany committed 1 year ago

Verified 764eee4a

Update dynamic env handling to preserve None when USE_DYNAMIC is unset (#3567)

yafshar committed 1 year ago

Verified 202e6c17

Add Gaudi doc (#3537)

regisss committed 1 year ago

Verified 32874257

preserve parameter keys when removing prefix (#3564)

mjkvaak-amd committed 1 year ago

Verified 281314b4

update path (#3561)

faaany committed 1 year ago

Verified 3524a504

canonicalize fsdp2 names when fixing optimizer (#3560)

pstjohn committed 1 year ago

Verified f48d95c4

make env var and dataclass flag consistent (#3307)

SumanthRH committed 1 year ago

Verified f76208f5

cast if dtype is not None (#3559)

dlvp committed 1 year ago

Verified ae0499ea

Fix the issue where `set_epoch` does not take effect. (#3556)

hongjx175 committed 1 year ago

Verified ddc49f1e

add support for port 0 auto-selection in multi-GPU environments (#3501)

hellobiondi committed 1 year ago

Verified 9b2d6eaf

Dynamo regional compilation (#3529)

IlyasMoutawwakil committed 1 year ago

Verified 7b5774ac

fix typos (#3549)

omahs committed 1 year ago

Verified 70133657

fix notebook_launcher for Colab TPU compatibility. (#3541)

BogdanDidenko committed 1 year ago

Verified 8d8fd836

Fix: param is not a parameter or buffer (#3545)

S1ro1 committed 1 year ago

Verified 3a941d4b

Update big_modeling.md for layerwise casting (#3548)

sayakpaul committed 1 year ago

Verified d02e51cc

Fix CI due to missing package (#3535)

SunMarc committed 1 year ago

Verified c5caa11e

Update Docker builds to align with CI requirements (#3532)

matthewdouglas committed 1 year ago

Verified 39e2bebb

Fix logic in `accelerator.prepare` + IPEX for 2+ `nn.Models` and/or `optim.Optimizers` (#3517)

mariusarvinte committed 1 year ago

Verified 0af45bf1

[FSDP2] Issues in Wrap Policy and Mixed Precision (#3528)

jhliu17 committed 1 year ago

Verified 806ac848

[FSDP2] Fix memory spike with `cpu_ram_efficient_loading=True` (#3482)

S1ro1 committed 1 year ago

Verified 23b09250

[FSDP2] Enable FULL_STATE_DICT (#3527)

S1ro1 committed 1 year ago

Verified 8fb07353

Solve link error in internal_mechanism documentation (#3506) (#3507)

alvaro-mazcu committed 1 year ago

Verified 4f35cf71

Older