accelerate
55a52848 - Fix scheduler incorrect steps when gradient accumulation enabled (#999)

Commit

3 years ago

Fix scheduler incorrect steps when gradient accumulation enabled (#999) * add additional check for optimizer step * rewrite scheduler w/ grad accumulation test

References

#999 - Fix scheduler incorrect steps when gradient accumulation enabled

Author

Alexander Markov

Parents

bd1d5fad

accelerate 55a52848 - Fix scheduler incorrect steps when gradient accumulation enabled (#999)

accelerate
55a52848 - Fix scheduler incorrect steps when gradient accumulation enabled (#999)