DeepSpeed
a149a5a4
- fix the max_out_tokens to use a dynamic range based on available memory
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Commit
View On
GitHub
Commit
3 years ago
fix the max_out_tokens to use a dynamic range based on available memory
References
#2280 - Increasing the token-length based on available memory for GPT models
Author
Reza Yazdani
Parents
53ed3cc8
Loading