DeepSpeed
Fix for inference gpt-j test
#2430
Merged

Commits
  • fix for gpt-j failing due to tokenizer error
    mrwyattii committed 3 years ago
  • limit number of gpt-j tokens generated due to low memory
    mrwyattii committed 3 years ago
Loading