huggingface/accelerate

Pull Requests Commits

muellerzr committed 2 years ago

83617de6

Wait for everyone

muellerzr committed 2 years ago

3310c53f

Wait for everyone

muellerzr committed 2 years ago

b56a2583

muellerzr committed 2 years ago

634e84f5

muellerzr committed 2 years ago

2581a2e3

fix bnb slow test (#1355)

younesbelkada committed 2 years ago

Verified 78bf8bcb

using deepspeed.comm for distrbiuted init (#1352)

pacman100 committed 2 years ago

Verified 57f2cf5f

Support FP8 mixed precision training for Ada Lovelace GPUs (#1348)

Dango233 committed 2 years ago

Verified e06e7b35

Pop more backend options (#1342)

muellerzr committed 2 years ago

Verified 56515218

only update progress bar when done with tensor (#1341)

xloem committed 2 years ago

Verified ba0ee8a5

Fix nested context manager for main_process_first() (#1304)

flukeskywalker committed 2 years ago

Verified c2a16293

Rm unused amp check (#1340)

muellerzr committed 2 years ago

Verified c29c3c5e

Temp skip test (#1339)

muellerzr committed 2 years ago

Verified 945085ed

Verbosity, Progress Bar for Loading (#1329)

xloem committed 2 years ago

Verified 70388fa4

sgugger committed 2 years ago

Verified 2fee0c15

Fix clearning of memory (#1332)

muellerzr committed 2 years ago

Verified c05ed13f

Remove repetitive devices in load_state_dict() (#1321)

xloem committed 2 years ago

Verified 5e635150

ensure module prefixes only match that module (#1319)

xloem committed 2 years ago

Verified ee0c5871

Add test flag and import check for dynamo (#1322)

muellerzr committed 2 years ago

Verified 43e7229a

Upgrade torch version on main tests (#1323)

muellerzr committed 2 years ago

Verified 8b96515e

Ensure that dynamo is compatible with mixed precision (#1318)

muellerzr committed 2 years ago

Verified 9d9ea627

offload the previous model hook before the current module is moved to the execution device (#1315)

williamberman committed 2 years ago

Verified 2106e87d

Default to nccl (#1314)

muellerzr committed 2 years ago

Verified 40980e8f

Allow xpu backend (#1313)

muellerzr committed 2 years ago

Verified f2f810c5

Bug fix in setattr (#1312)

aashiqmuhamed committed 2 years ago

Verified 0a9403f3

Simplify MPS implementation (#1308)

sgugger committed 2 years ago

Verified 75a693c9

add usage guide for ipex plugin (#1270)

sywangyi committed 2 years ago

Verified 55691b14

Set the state device dependant to Accelerator on multigpu (#1220)

muellerzr committed 2 years ago

Verified b757b623

fix for load_checkpoint_and_dispatch(device_map=None) (#1297)

anentropic committed 2 years ago

Verified 15dbf972

Make note about grad accum and prec (#1296)

muellerzr committed 2 years ago

Verified 419ecf38

Older