Validation #844
XiaohanZhangCMU
wants to merge
126 commits into
mosaicml:main
from
XiaohanZhangCMU:validation
add validation script
8cb65225
update
c59c11fd
change token count function
66f34ebd
reorganize cells
2cd387b5
Add unit tests
3eac3bf1
Add a printout for CPT
d2d97677
update question
be255917
Add questions
4651be7d
Fix lints
5cd6a94d
Merge branch 'main' into validation
8e2c1f4b
update format
e6e4a81f
Merge branch 'validation' of github.com:XiaohanZhangCMU/llm-foundryX …
34c56904
update
1668b9a4
nb source
22191350
add validation script
86c6e87a
update
678b3766
change token count function
297e057d
reorganize cells
09d0ebbd
Add unit tests
460df65c
Add a printout for CPT
3ffd2003
update question
9362886a
Add questions
898e5acf
Fix lints
a4bef711
update format
4ca9cc6c
update
d636a0f8
nb source
827d1551
Remove license insert for validation notebook
6bbf3fce
Merge branch 'validation' of github.com:XiaohanZhangCMU/llm-foundryX …
4f6a4fb3
Add validation utils
5966b68b
Merge branch 'main' into validation
da178136
Validation (#856)
89fb9093
update utils/__init__.py to include extra validation functions
55e46265
update notebook
45544a1e
update
d2797b35
Merge branch 'validation' of github.com:XiaohanZhangCMU/llm-foundryX …
019da779
update
756fdae2
Add download remote function to util
93b5a9f9
update
b47c878a
update
13fd34c7
update
610f6694
update
9f2e51b3
update
ec68f10f
update
1e76068e
update
7a5c164f
Merge branch 'main' into validation
e76038fc
update
5b413f55
update
a1aa31f1
update
d24fd5ce
Add dask and dataframe_to_mds
55fce374
update
86e2412e
update
bbfec65d
update
b2e880de
update
596443af
Add notebook
ea651873
update
378a4e09
update
af6e9aa9
remove script and tests, keep notebook
4e286ecd
update
09c4892c
update
c82da6cc
update
e5f83cc5
update
17d2b9fd
Merge branch 'main' into validation
6579d552
Merge branch 'byod/data_validation' into validation
56308ffa
Validation (#862)
00a51b53
updated notebook
4daa3248
Merge branch 'main' into validation
b809691f
remove scripts keep notebook
8b75f946
merge with byod/data_validation
99bf2cd5
Validation (#866)
9b37063f
update notebook. rephrase.
22014d67
irenedea
commented
on 2024-01-12
merged
d9f28aac
Validation (#867)
f1fa63c5
update
43c8ac9d
Add response tokens
b8ac771e
update
1b9681c0
merge
16883c22
Validation (#875)
a9218d6c
update
c7567f13
Disable MDSWrite, return token counts
1764b722
Change plot settings
808ced53
Fix conflict
26ae516b
update notebook
a212ee89
update
d2798172
Validation (#898)
f1cfe9e4
update notebook
dbe3f4ef
update
3005718d
Validation (#900)
8498662f
update
f5b900cc
Merge branch 'byod/data_validation' of https://github.com/mosaicml/ll…
02d0979d
Validation (#901)
205e405c
update notebook
2f883a7c
update
0315cafa
update pip install link
1a510ff4
Change done file location
530a55a0
Validation (#902)
54932953
Create the dest folder
81c37573
Validation (#1025)
5090e137
update notebook
f88917d5
update
4c86f74d
Merge branch 'byod/data_validation' into validation
962974bf
Validation (#1027)
9fd91cf6
Merge pull request #1 from mosaicml/byod/data_validation
67f7b4ce
update notebook
28cd2e6d
Validation (#1028)
944b260c
fix conflict
9a19d8ac
Validation (#1031)
a6b2ae0d
update token_counts
de909346
Validation (#1032)
5dfd30c7
update pip install list
61adb438
Validation (#1033)
c404dc7e
fix
c77bdf65
update
ad71cc09
fix token counts
9bc3a39d
Expose validate chat
9ec582ee
Expose more
734008e7
update
51f2eef4
expose
7b6956d7
add collate
60ed7de5
Fix
fba1dcba
Fix conflict
58185ba2
Validation (#1034)
8e8f4316
update notebook
24f3d9e9
Fix conflict
714002d2
Validation (#1035)
1640f30d
Merge branch 'byod/data_validation' of https://github.com/mosaicml/ll…
b0533635
update notebook
7e1d5671
Login to write a write a comment.
Login via GitHub