huggingface/accelerate

Pull Requests Commits

Expound docs w/ FP8

muellerzr committed 1 year ago

6dca1484

muellerzr committed 1 year ago

9f86ae37

Finish adding to config yaml

muellerzr committed 1 year ago

a10864e0

Add test config for 0_34

muellerzr committed 1 year ago

2f71e28a

Update CLI to now include fp8 args

muellerzr committed 1 year ago

80791ad7

Add README to benchmarks folder

muellerzr committed 1 year ago

3d807827

muellerzr committed 1 year ago

e6a5f4f4

Migrate all to benchmarks folder and make TE import check work

muellerzr committed 1 year ago

8cbe9614

Add import check

muellerzr committed 1 year ago

eaf018dc

Let the wrapper come off during unwrap_model

muellerzr committed 1 year ago

cece1e9e

muellerzr committed 1 year ago

ad3d6693

muellerzr committed 1 year ago

3fbec3bd

muellerzr committed 1 year ago

9f8f3069

muellerzr committed 1 year ago

59af9994

Enable FP8 autocast during eval only if specified

muellerzr committed 1 year ago

72a25fa3

Delay autocast flag

muellerzr committed 1 year ago

1d837b52

muellerzr committed 1 year ago

b5becfb0

muellerzr committed 1 year ago

71c42207

muellerzr committed 1 year ago

463da1a1

muellerzr committed 1 year ago

58877a42

Working version rebased from main

muellerzr committed 1 year ago

dd174117

update version to 0.34.dev0 (#3007)

SunMarc committed 1 year ago

Verified cd5698bb

Add small util to enable FSDP offloading quickly (#3006)

muellerzr committed 1 year ago

Verified 90d50239

Make env variables optional for FSDP (#2998)

muellerzr committed 1 year ago

Verified 3bde6156

Fix deepspeed tests (#3003)

muellerzr committed 1 year ago

Verified dc3b5ad8

clear memory after offload (#2994)

SunMarc committed 1 year ago

Verified 12a5befd

Support skip_first_batches for XLA (#2966)

yitongh committed 1 year ago

Verified 79ca85c2

Fix typo on warning str: "meta device device" -> "meta device" (#2997)

HeAndres committed 1 year ago

Verified 13d93c4f

Explicit check for `step` when loading the state (#2992)

muellerzr committed 1 year ago

Verified d982751a

Fix gated test (#2993)

muellerzr committed 1 year ago

Verified 95edc68c

Older