Megatron-DeepSpeed
Fix preprocessing scripts
#253
Merged
Overview
Commits
1
Changes
View On GitHub

Fix preprocessing scripts #253

thomasw21 merged 1 commit into main from thomas/fix_preprocessing_script
thomasw21
thomasw21 Use padded vocab size
442e6a07
thomasw21 thomasw21 merged 99c8fe07 into main 4 years ago
thomasw21 thomasw21 deleted the thomas/fix_preprocessing_script branch 4 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum