flax
7a0e1df8
- Add offset argument to Adafactor optimizer for fine-tuning schedules.
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
5 years ago
Add offset argument to Adafactor optimizer for fine-tuning schedules. This argument can adjust the Adafactor mixing-rate schedule, which can be useful during finetuning of a pretrained model. PiperOrigin-RevId: 341521827
References
#605 - Add offset argument to Adafactor optimizer for fine-tuning schedules.
Author
levskaya
Committer
a-googler
Parents
52b7f197
Loading