DeepSpeed
supporting different intermediate sizes other than 4 * hidden_dim
#389
Merged
Merged