mosaicml/llm-foundry

Pull Requests Commits

angel-ruiz7 committed 1 year ago

9fbfccc8

angel-ruiz7 committed 1 year ago

34829ea2

angel-ruiz7 committed 1 year ago

1ed85594

don't use `Optional`

angel-ruiz7 committed 1 year ago

684766ab

angel-ruiz7 committed 1 year ago

6586c8ca

angel-ruiz7 committed 1 year ago

b8492b74

angel-ruiz7 committed 1 year ago

0aec206b

add to export list

angel-ruiz7 committed 1 year ago

d80c7356

get rid of circular imports

angel-ruiz7 committed 1 year ago

feb6bad3

angel-ruiz7 committed 1 year ago

23856e1a

more formatting?

angel-ruiz7 committed 1 year ago

af1a836c

make custom exceptions for `FileNotFound` in dataloader and `convert_text_to_mds`

angel-ruiz7 committed 1 year ago

200693d7

Add logging to convert_text_to_mds.py script (#1243)

irenedea committed 1 year ago

Verified fb9a2259

Make HF conversion automatically add missing imports (#1241)

dakinggg committed 1 year ago

Verified b82a82bd

Chunk file reads and tokenization for text to mds conversion (#1240)

irenedea committed 1 year ago

Verified 43d149b0

removing rich install (#1198)

jjanezhang committed 1 year ago

Verified c9257b56

Make the exceptions serializable (#1239)

dakinggg committed 1 year ago

Verified 867e58fe

add error when chat template fails (#1222)

milocress committed 1 year ago

Verified 2e10d953

Move MLFlow dataset outside of log_config (#1234)

KuuCi committed 1 year ago

Verified 1e4bd372

Add retries to downloads in convert_text_to_mds.py (#1238)

irenedea committed 1 year ago

Verified fdaa58be

configurable submesh (#1236)

dakinggg committed 1 year ago

Verified ff92f3c7

Add example eval scripts for dbrx PT sizes (#1218)

aspfohl committed 1 year ago

Verified ef530bfb

fix typing (#1235)

dakinggg committed 1 year ago

Verified 09d88921

fix attr error for attention_classes (#1230)

cli99 committed 1 year ago

Verified b4bb34c9

Fixing the state.timestamp.batch.value issue in loss v len callback (#1232)

ShashankMosaicML committed 1 year ago

Verified 6fa6026e

Loss v len callback (#1226)

ShashankMosaicML committed 1 year ago

Verified c213ea86

Modularize backbone class and block creation (#1229)

dakinggg committed 1 year ago

Verified 9120c27e

Quick patch to check that Dataset Keys contain non-None Values (#1228)

KuuCi committed 1 year ago

Verified 9cc945c6

Make config/class properties on ComposerMPTForCausalLM (#1227)

dakinggg committed 1 year ago

Verified c891bed3

Add user error superclass (#1225)

milocress committed 1 year ago

Verified 8e296988

Older