llm-foundry
Gauntlet v0.1
#674
Merged
Overview
Commits
104
Changes
View On GitHub

Gauntlet v0.1 #674

bmosaicml merged 104 commits into main from execution_prediction
bmosaicml
bmosaicml update yaml
a4c83d31
bmosaicml adding datasets
fbf43b02
bmosaicml adding datasets
7d9c367b
bmosaicml Merge branch 'model_gauntlet_v0.1' of github.com:mosaicml/llm-foundry…
50546675
bmosaicml added agi eval
b32224a7
bmosaicml test CoT eval
46b27a39
bmosaicml fix broken eval yaml
4d821808
bmosaicml fix broken eval yaml
b1bbff1e
bmosaicml Merge branch 'model_gauntlet_v0.1' of github.com:mosaicml/llm-foundry…
7554b01f
bmosaicml merge main
1845ffa4
bmosaicml debugging
1508a9fe
bmosaicml debugging
b10c16c2
bmosaicml commit
85f081eb
bmosaicml commit
de28be4c
bmosaicml commit
193b4e04
bmosaicml commit
e896c092
bmosaicml commit
a16aea1b
bmosaicml restore mcli
6f5fc2cf
adding simple tasks
7968ca44
bmosaicml Merge branch 'main' into human_eval_simple
0f8b160c
bmosaicml add simple human_eval
a84dda03
bmosaicml fix yaml
90a2dca4
bmosaicml Merge branch 'main' into mike/human-eval-simple
4c54e3dd
bmosaicml Merge branch 'main' into mike/human-eval-simple
bcda9ef7
bmosaicml fix yaml
48060e1d
bmosaicml Merge branch 'mike/human-eval-simple' of github.com:mcarbin/llm-found…
4eee5c1b
bmosaicml remove breakpoint
9534d73b
bmosaicml remove breakpoint
51d1b72c
bmosaicml change bsz
e11bb34d
bmosaicml Merge branch 'main' into human_eval_simple
fb750f3c
bmosaicml merge main
b50da7d6
bmosaicml Merge branch 'main' into mike/human-eval-simple
4b29f926
bmosaicml Merge branch 'main' into change_gauntlet_avging
07c2c070
bmosaicml eval gauntlet cb
841eac0c
bmosaicml Merge branch 'main' into change_gauntlet_avging
94100fb6
bmosaicml Merge branch 'main' into mike/human-eval-simple
211def8f
dakinggg Merge branch 'main' into change_gauntlet_avging
5cf9b898
dakinggg Merge branch 'main' into change_gauntlet_avging
9159dc8d
dakinggg Merge branch 'main' into mike/human-eval-simple
043f4736
dakinggg Merge branch 'main' into change_gauntlet_avging
d1744fe7
bmosaicml add udpated readme
cdc20655
bmosaicml Merge branch 'main' into mike/human-eval-simple
eb096681
bmosaicml Merge branch 'mike/human-eval-simple' of github.com:mcarbin/llm-found…
cdbd3d17
bmosaicml Merge branch 'main' into change_gauntlet_avging
adeb7907
bmosaicml merge
26107e80
bmosaicml Merge branch 'main' into mike/human-eval-simple
2fd5c16b
bmosaicml merge2
c8a21c67
bmosaicml fix precommit
71cd4200
bmosaicml Merge branch 'mike/human-eval-simple' of github.com:mcarbin/llm-found…
ff68b532
bmosaicml Merge branch 'main' into change_gauntlet_avging
bd8a9f83
bmosaicml add pii
47ebdfc3
bmosaicml restor line
2d172930
bmosaicml restor line
8b7abf1b
bmosaicml finish non gen safety
ed3f52ac
bmosaicml add execution predicrtion
f96bbce9
bmosaicml add execution prediction
6ff91337
bmosaicml add execution prediction
bb7a8475
bmosaicml Merge branch 'execution_prediction' of github.com:mosaicml/llm-foundr…
6ee0f489
bmosaicml change mosaicml reqs
f332091b
bmosaicml change mosaicml reqs
bb89c974
bmosaicml fix error
966b1bb9
bmosaicml Merge branch 'execution_prediction' of github.com:mosaicml/llm-foundr…
977b48f5
bmosaicml comment
e15246e8
bmosaicml test smaller beams
e40463b1
bmosaicml tesT
4a4d021f
bmosaicml tesT
c5e30ec3
bmosaicml tesT
19c8b2b2
bmosaicml Merge branch 'change_gauntlet_avging' into execution_prediction
441b004f
bmosaicml add coding task
30255177
bmosaicml tesT
5e444e30
bmosaicml finish eval
b55bddaa
bmosaicml finish data
2d77a0e7
bmosaicml fix
c025ac4a
bmosaicml fix
2702e15d
bmosaicml Merge branch 'execution_prediction' of github.com:mosaicml/llm-foundr…
d3936036
bmosaicml remove strategyqa cot
03509508
bmosaicml merge
27754e8f
bmosaicml remove
b00a806f
bmosaicml remove
7b68b550
bmosaicml Merge branch 'execution_prediction' of github.com:mosaicml/llm-foundr…
57e35cd2
bmosaicml foo
814a8c95
bmosaicml edit
b142b57f
bmosaicml Merge branch 'main' into execution_prediction
a56b30e6
bmosaicml Merge branch 'execution_prediction' of github.com:mosaicml/llm-foundr…
368d232f
bmosaicml bmosaicml changed the title [WIP] Execution prediction [WIP] Gauntlet v0.1 2 years ago
bmosaicml fix
d86ece11
bmosaicml rm breakpoint
04777739
bmosaicml rm breakpoint
7fed6a2c
bmosaicml bmosaicml requested a review from mcarbin mcarbin 2 years ago
bmosaicml remove execution prediction; make coding optional
48bf32b7
bmosaicml remove execution prediction; make coding optional
f2f59dfb
bmosaicml merge
01b31035
bmosaicml remove import
20aeafd3
bmosaicml remove import
46b7d72d
bmosaicml restore files
93fa5564
bmosaicml restore
f17f8c4c
bmosaicml restore
a9606b45
bmosaicml Merge branch 'main' into execution_prediction
cd080242
bmosaicml update readm; rename gauntlet yamls
f0c0b9df
bmosaicml edit yamls
45720562
bmosaicml Merge branch 'main' into execution_prediction
297bfa28
bmosaicml bmosaicml changed the title [WIP] Gauntlet v0.1 Gauntlet v0.1 2 years ago
bmosaicml fix yamllint
e6b696f9
bmosaicml Merge branch 'execution_prediction' of github.com:mosaicml/llm-foundr…
a1f8ffbe
bmosaicml restore mpt eval
6014dd4f
bmosaicml bmosaicml requested a review from samhavens samhavens 2 years ago
bmosaicml bmosaicml requested a review from tbarton16 tbarton16 2 years ago
bmosaicml bmosaicml requested a review from codestar12 codestar12 2 years ago
bmosaicml bmosaicml requested a review from maxisawesome maxisawesome 2 years ago
bmosaicml bmosaicml requested a review from dakinggg dakinggg 2 years ago
bmosaicml bmosaicml requested a review from abhi-mosaic abhi-mosaic 2 years ago
maxisawesome
maxisawesome commented on 2023-11-15
maxisawesome
maxisawesome commented on 2023-11-15
maxisawesome
maxisawesome
maxisawesome commented on 2023-11-15
maxisawesome
dakinggg
dakinggg commented on 2023-11-15
bmosaicml
bmosaicml commented on 2023-11-15
bmosaicml bmosaicml requested a review from maxisawesome maxisawesome 2 years ago
maxisawesome
maxisawesome
maxisawesome approved these changes on 2023-11-17
bmosaicml Merge branch 'main' into execution_prediction
90ef3880
bmosaicml bmosaicml enabled auto-merge (squash) 2 years ago
bmosaicml Merge branch 'main' into execution_prediction
1357cb8f
bmosaicml bmosaicml merged ab5577b2 into main 2 years ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum