DeepSpeed
62004e0d - InfV2 - remove generation config requirement (#4938)

Commit
1 year ago
InfV2 - remove generation config requirement (#4938) Fix for https://github.com/microsoft/DeepSpeed-MII/issues/287 Some HF models do not have a generation config. We should only try to load it if the `max_seq_length` is not present in the model config. Also fix bug introduced in #4936
Author
Parents
Loading