Megatron-DeepSpeed
Add Bitfit
#311
Open
Overview
Commits
19
Changes
View On GitHub

Add Bitfit #311

Muennighoff wants to merge 19 commits into main from bitfit
Muennighoff
Muennighoff Enable loading ckpt for t0 finetuning
90b8f46d
Muennighoff Add BitFit
9e72b325
Muennighoff Enhance docstring
3f613bea
Muennighoff Muennighoff requested a review from thomasw21 thomasw21 3 years ago
Muennighoff Muennighoff requested a review from TevenLeScao TevenLeScao 3 years ago
Muennighoff Swap decoder_is_inputs & segment_ids
abdd7030
Muennighoff Add prepend-space arg
0fcb19c1
Muennighoff Update tools/preprocess_data.py
63daa46f
Muennighoff Add helpers & set is_causal to true
89460c0a
Muennighoff Merge remote
fb8ecb8c
Muennighoff JSON helper scripts
a55d2fb5
Muennighoff Remove unnec imports
2dfe5d11
Muennighoff Remove helper scripts
ca740f1e
Muennighoff Avoid loading module when not loading optim
cb0313ba
Muennighoff Allow not using torch distributed
b62dcafc
Muennighoff Add prefixlm arg
b15ca2d5
Muennighoff Add bos option
dc8d0abb
Muennighoff Merge branch 'main' into t0loading
0a324592
Muennighoff Add reset-progress key
26997216
Muennighoff Merge branch 'main' into bitfit
1ed00bdd
Muennighoff Merge branch 't0loading' into bitfit
60672130

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum