huggingface/accelerate

Pull Requests Commits

Fix three typos in src/accelerate/data_loader.py (#3082)

xiabingquan committed 2 years ago

Verified 52b3421d

Allow DataLoaderAdapter subclasses to be pickled by implementing `__reduce__` (#3074)

byi8220 committed 2 years ago

Verified f1ca8ac7

Fix FSDP auto_wrap using characters instead of full str for layers (#3075)

muellerzr committed 2 years ago

Verified ab89fc7e

muellerzr committed 2 years ago

b5235f21

Remove `skip_first_batches` support for StatefulDataloader and fix all the tests (#3068)

muellerzr committed 2 years ago

Verified 8931e5e4

Speed up tests by shaving off subprocess when not needed (#3042)

muellerzr committed 2 years ago

Verified a8485924

add set_epoch for MpDeviceLoaderWrapper (#3053)

append-only committed 2 years ago

Verified 758d6243

Fix typo in comment (#3045)

mokizzz committed 2 years ago

Verified b07ad2ad

use duck-typing to ensure underlying optimizer supports schedulefree hooks (#3055)

tmm1 committed 2 years ago

Verified 1d09a20f

Do not import `transformer_engine` on import (#3056)

oraluben committed 2 years ago

Verified 3fcc9461

Update torchpippy (#2938)

muellerzr committed 2 years ago

Verified 939ce400

Add FP8 docker images (#3048)

muellerzr committed 2 years ago

Verified c2120927

Add a SLURM example with minimal config (#2950)

muellerzr committed 2 years ago

Verified 654e1d99

Update CONTRIBUTING.md Setup Instructions (#3046)

siddk committed 2 years ago

Verified 8c3aded2

Decouple `prepare_data_loader()` from Accelerator (#3047)

siddk committed 2 years ago

Verified 27899339

Fixup dataloader state dict bugs + incorporate load/save_state API (#3034)

muellerzr committed 2 years ago

Verified 726140ca

Fix batch_sampler maybe None error (#3025)

candlewill committed 2 years ago

Verified 2d4f1dda

Fix fp8 benchmark on single GPU (#3032)

muellerzr committed 2 years ago

Verified c0cf860d

Add early support for `torchdata.stateful_dataloader.StatefulDataLoader` within the `Accelerator` (#2895)

byi8220 committed 2 years ago

Verified ad3f574a

Improve config handling and add a zoo (#3029)

muellerzr committed 2 years ago

Verified 1a6af0bd

Add end_training/destroy_pg to everything and unpin numpy (#3030)

muellerzr committed 2 years ago

Verified 52fae096

Fix torch version check (#3024)

muellerzr committed 2 years ago

Verified 7ffe7662

Set correct NPU backend and distributed_type when using transfer_to_npu (#3021)

ArthurinRUC committed 2 years ago

Verified 5536a3a8

Tweak defaults for quantized-typed FP8 TE weights (#3018)

muellerzr committed 2 years ago

Verified 7ec8eab9

destroy process group in `end_training` (#3012)

SunMarc committed 2 years ago

Verified 589fddd3

Wrong import check for TE (#3016)

muellerzr committed 2 years ago

Verified 99c69aaf

fix default value for rank size in cpu threads_per_process assignment logic (#3009)

rbrugaro committed 2 years ago

Verified 00785cd9

Enable FSDP & Deepspeed + FP8 (#2983)

muellerzr committed 2 years ago

Verified a452327e

Fix `find_tied_params` for models with shared layers (#2986)

qubvel committed 2 years ago

Verified 851cf343

update version to 0.34.dev0 (#3007)

SunMarc committed 2 years ago

Verified cd5698bb

Newer Older