DeepSpeed
remove mandatory `index` key from output of `metric_function` in `DataAnalysis` map operation
#5112
Merged
Overview
Commits
14
Changes
View On GitHub

remove mandatory `index` key from output of `metric_function` in `DataAnalysis` map operation #5112

conglongli merged 14 commits into deepspeedai:master from data_analysis_remove_key_index
bm-synth
bm-synth added assert of torch vs numpy types
14f2bbe1
bm-synth removed 'data' key in favour or a global index
84d4398b
bm-synth removed self.start_idx and self.end_idx
9a4cf512
bm-synth metric_function as it was
7951289a
bm-synth removed assert
8e6e556f
bm-synth bm-synth changed the title remove 'index' key from output of metric_function in `DataAnalysis` remove mandatory `index` key from output of metric_function in `DataAnalysis` map operation 2 years ago
bm-synth bm-synth changed the title remove mandatory `index` key from output of metric_function in `DataAnalysis` map operation remove mandatory `index` key from output of `metric_function` in `DataAnalysis` map operation 2 years ago
bm-synth removed dtypes
00a9fed3
bm-synth bm-synth changed the title remove mandatory `index` key from output of `metric_function` in `DataAnalysis` map operation remove mandatory `index` key from output of `metric_function` in `DataAnalysis` map operation [ONGOING TESTING] 2 years ago
bm-synth Merge branch 'master' into data_analysis_remove_key_index
9bad499b
bm-synth bm-synth marked this pull request as ready for review 2 years ago
bm-synth bm-synth requested a review from conglongli conglongli 2 years ago
bm-synth
bm-synth bm-synth changed the title remove mandatory `index` key from output of `metric_function` in `DataAnalysis` map operation [ONGOING TESTING] remove mandatory `index` key from output of `metric_function` in `DataAnalysis` map operation 2 years ago
bm-synth Merge branch 'master' into data_analysis_remove_key_index
496b147f
bm-synth format
847e462b
bm-synth Merge branch 'master' into data_analysis_remove_key_index
7f4a2b50
conglongli
bm-synth Merge branch 'master' into data_analysis_remove_key_index
15864bce
bm-synth
conglongli
bm-synth formatting
200056b0
conglongli
conglongli
bm-synth support megatron and user-defined use case
ea1d23d1
bm-synth
bm-synth Merge branch 'master' into data_analysis_remove_key_index
bab5e416
conglongli
conglongli approved these changes on 2024-02-15
conglongli conglongli enabled auto-merge 2 years ago
conglongli conglongli merged 2d0a6bc2 into master 2 years ago
bm-synth bm-synth deleted the data_analysis_remove_key_index branch 2 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum