mosaicml/llm-foundry

Pull Requests Commits

jjanezhang committed 1 year ago

61a36a5f

Make the exceptions serializable (#1239)

dakinggg committed 1 year ago

Verified 867e58fe

add error when chat template fails (#1222)

milocress committed 1 year ago

Verified 2e10d953

Move MLFlow dataset outside of log_config (#1234)

KuuCi committed 1 year ago

Verified 1e4bd372

Add retries to downloads in convert_text_to_mds.py (#1238)

irenedea committed 1 year ago

Verified fdaa58be

configurable submesh (#1236)

dakinggg committed 1 year ago

Verified ff92f3c7

Add example eval scripts for dbrx PT sizes (#1218)

aspfohl committed 1 year ago

Verified ef530bfb

fix typing (#1235)

dakinggg committed 1 year ago

Verified 09d88921

fix attr error for attention_classes (#1230)

cli99 committed 1 year ago

Verified b4bb34c9

Fixing the state.timestamp.batch.value issue in loss v len callback (#1232)

ShashankMosaicML committed 1 year ago

Verified 6fa6026e

Loss v len callback (#1226)

ShashankMosaicML committed 1 year ago

Verified c213ea86

Modularize backbone class and block creation (#1229)

dakinggg committed 1 year ago

Verified 9120c27e

Quick patch to check that Dataset Keys contain non-None Values (#1228)

KuuCi committed 1 year ago

Verified 9cc945c6

Make config/class properties on ComposerMPTForCausalLM (#1227)

dakinggg committed 1 year ago

Verified c891bed3

Add user error superclass (#1225)

milocress committed 1 year ago

Verified 8e296988

Modularize components of megablocks layer builder (#1224)

dakinggg committed 1 year ago

Verified 001e7c34

that mod (#1219)

snarayan21 committed 1 year ago

Verified 77f9ab18

torch dmoe tests gpu oom (#1216)

snarayan21 committed 1 year ago

Verified 3a150821

Make `fc_type` a dict to pass fc kwargs through (#1201)

snarayan21 committed 1 year ago

Verified 38ae65b6

remove dead code (#1213)

dakinggg committed 1 year ago

Verified 3fe7f093

TransformerEngine Image Build (#1204)

mvpatel2000 committed 1 year ago

Verified e70891b9

Add fc to HF export (#1209)

dakinggg committed 1 year ago

Verified dc3212e3

using self.shift_labels instead of self.model.transformer.shift_labels in loss (#1211)

ShashankMosaicML committed 1 year ago

Verified 8cd23d57

log eval dataset misconfiguration (#1179)

milocress committed 1 year ago

Verified cfee4e4e

Added torch_dmoe defaults, bug fixes for 2D inputs (#1210)

snarayan21 committed 1 year ago

Verified b4146269

Clearer error message for unknown example type (#1202)

milocress committed 1 year ago

Verified 8274c6cf

streaming version bump (#1195)

snarayan21 committed 1 year ago

Verified 0449b604

removing rich install

jjanezhang committed 1 year ago

7fba3212

Pass FC type along for all FFN types (#1196)

dakinggg committed 1 year ago

Verified eef4872d

Log exception on inactivity callback (#1194)

jjanezhang committed 1 year ago

Verified 994209cf

Older