DeepSpeed
Fix broadcast deadlock for incomplete batches in data sample for data analysis
#5117
Merged

Commits
  • flush file before continuing. added assert
    bm-synth committed 2 years ago
  • removed if condition. collate_fn is by default None
    bm-synth committed 2 years ago
  • added assert of torch vs numpy types
    bm-synth committed 2 years ago
  • removed 'data' key in favour or a global index
    bm-synth committed 2 years ago
  • removed self.start_idx and self.end_idx
    bm-synth committed 2 years ago
  • metric_function as it was
    bm-synth committed 2 years ago
  • removed assert
    bm-synth committed 2 years ago
  • removed dtypes
    bm-synth committed 2 years ago
  • Merge branch 'bug_fix_flush_curriculum_reduce_file_concatenation'
    bm-synth committed 2 years ago
  • Merge branch 'remove_unnecessary_if_condition'
    bm-synth committed 2 years ago
  • fixed broadcast deadlock
    bm-synth committed 2 years ago
  • reverted 2 files that belong to a different PR
    bm-synth committed 2 years ago
  • removed breakline
    bm-synth committed 2 years ago
  • Merge branch 'master' into fix_broadcast_deadlock_for_incomplete_batches
    bm-synth committed 2 years ago
  • format
    bm-synth committed 2 years ago
  • Merge branch 'master' into fix_broadcast_deadlock_for_incomplete_batches
    bm-synth committed 2 years ago
  • Merge branch 'master' into fix_broadcast_deadlock_for_incomplete_batches
    bm-synth committed 2 years ago
Loading