Megatron-DeepSpeed
Add multiple evaluation compat
#336
Open
Go
Login via GitHub
Home
Pricing
FAQ
Install
Login
via GitHub
Overview
Commits
13
Changes
View On
GitHub
Add multiple evaluation compat
#336
Muennighoff
wants to merge 13 commits into
t0loading
from
mtf-multival
Tmp lossseq
462efd99
Efficient loss normalization
992446c8
Reuse variable
616cfe86
Simplify division
900c8356
Add norm_target_loss arg
7bc1dd20
Clarify loss on targets & remove kwarg
fce1a98e
Loss mask is already float
2e7554d7
Move norm to batch pipe
a6b26240
Reshape loss mask
549f4993
Move view
d9a91feb
Merge branch 't0loading' into lossseq
456327c1
Add multiple evaluation compat
6c1018f6
Set iteration to args by default
477cda6d
Base automatically changed from
lossseq
to
t0loading
3 years ago
Login to write a write a comment.
Login via GitHub
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub