[WIP] Add bfloat16 support #243 (#247)
* Add bfloat16 support (#243)
* Compatibility with previous config files
* Fix non-default argument 'num_processes' follows default argument
* Compatibility with previous config files
* Fix user input config
* Add use_fp16 compatibility
* Show dtype
* Verbosity
* Remove dtype verbosity
* Update src/accelerate/accelerator.py
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
* Update src/accelerate/commands/launch.py
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
* Add version checks and fix "no"/None issues
* Update src/accelerate/accelerator.py
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
* Update src/accelerate/commands/launch.py
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
* Update src/accelerate/commands/launch.py
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
* Update src/accelerate/commands/launch.py
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
* Update src/accelerate/commands/launch.py
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
* Update src/accelerate/notebook_launcher.py
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
* Update src/accelerate/commands/launch.py
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
* Raise error if required PyTorch version is not available
* Style
* Make style
* Update src/accelerate/accelerator.py
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
* Delete unused import
* Raise error if requited Pytorch is not available (Fix previous commit)
Co-authored-by: Sylvain Gugger <35901082+sgugger@users.noreply.github.com>
