DeepSpeed
Check inference input_id tokens length
#4349
Merged

Commits
  • added check to avoid undefined behavior when the input_id length is greater than max_tokens
    mrwyattii committed 2 years ago
Loading