DeepSpeed
9aaead55 - removed if condition in `if collate_fn is None` (#5107)

Commit

1 year ago

removed if condition in `if collate_fn is None` (#5107) remove the if condition for value of `collate_fn`, because `collate_fn` is `None` by default in `DataLoader` Co-authored-by: Michael Wyatt <michaelwyatt@microsoft.com> Co-authored-by: Logan Adams <114770087+loadams@users.noreply.github.com>

References

#5107 - removed if condition in `if collate_fn is None`

Author

bm-synth

Parents

3c0bd312

Files1

deepspeed/runtime/data_pipeline/data_sampling
- data_analyzer.py

DeepSpeed 9aaead55 - removed if condition in `if collate_fn is None` (#5107)

DeepSpeed
9aaead55 - removed if condition in `if collate_fn is None` (#5107)