Efficiently skip batches in a dataloader (#1002)
* Efficiently skip batches in a dataloader
* Add method in Accelerator and example
* Apply suggestions from code review
Co-authored-by: Zachary Mueller <muellerzr@gmail.com>
* Rename point of access
* Add point of access to init
* Add tests
* Don't forget to include fixes silly!
* Adapt examples
* Fix quality
* Forgot one
* fix method name
* Fix DataLoaderShard reinstantation
* Fix for epoch checkpointing
---------
Co-authored-by: Zachary Mueller <muellerzr@gmail.com>
