Megatron-DeepSpeed
Add multiple evaluation compat
#336
Open

Add multiple evaluation compat #336

Muennighoff wants to merge 13 commits into t0loading from mtf-multival
Muennighoff
Muennighoff Tmp lossseq
462efd99
Muennighoff Efficient loss normalization
992446c8
Muennighoff Reuse variable
616cfe86
Muennighoff Simplify division
900c8356
Muennighoff Add norm_target_loss arg
7bc1dd20
Muennighoff Clarify loss on targets & remove kwarg
fce1a98e
Muennighoff Loss mask is already float
2e7554d7
Muennighoff Move norm to batch pipe
a6b26240
Muennighoff Reshape loss mask
549f4993
Muennighoff Move view
d9a91feb
Muennighoff Merge branch 't0loading' into lossseq
456327c1
Muennighoff Add multiple evaluation compat
6c1018f6
Muennighoff Set iteration to args by default
477cda6d
Base automatically changed from lossseq to t0loading 3 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
No reviews
Assignees
No one assigned
Labels
Milestone