mosaicml/llm-foundry

Pull Requests Commits

KuuCi committed 1 year ago

158784c9

KuuCi committed 1 year ago

89dfdbdd

KuuCi committed 1 year ago

6a178a94

Make config/class properties on ComposerMPTForCausalLM (#1227)

dakinggg committed 1 year ago

Verified c891bed3

Add user error superclass (#1225)

milocress committed 1 year ago

Verified 8e296988

Modularize components of megablocks layer builder (#1224)

dakinggg committed 1 year ago

Verified 001e7c34

that mod (#1219)

snarayan21 committed 1 year ago

Verified 77f9ab18

torch dmoe tests gpu oom (#1216)

snarayan21 committed 1 year ago

Verified 3a150821

Make `fc_type` a dict to pass fc kwargs through (#1201)

snarayan21 committed 1 year ago

Verified 38ae65b6

remove dead code (#1213)

dakinggg committed 1 year ago

Verified 3fe7f093

TransformerEngine Image Build (#1204)

mvpatel2000 committed 1 year ago

Verified e70891b9

Add fc to HF export (#1209)

dakinggg committed 1 year ago

Verified dc3212e3

using self.shift_labels instead of self.model.transformer.shift_labels in loss (#1211)

ShashankMosaicML committed 1 year ago

Verified 8cd23d57

log eval dataset misconfiguration (#1179)

milocress committed 1 year ago

Verified cfee4e4e

Added torch_dmoe defaults, bug fixes for 2D inputs (#1210)

snarayan21 committed 1 year ago

Verified b4146269

Clearer error message for unknown example type (#1202)

milocress committed 1 year ago

Verified 8274c6cf

streaming version bump (#1195)

snarayan21 committed 1 year ago

Verified 0449b604

Pass FC type along for all FFN types (#1196)

dakinggg committed 1 year ago

Verified eef4872d

Log exception on inactivity callback (#1194)

jjanezhang committed 1 year ago

Verified 994209cf

fix eval (#1193)

milocress committed 1 year ago

Verified 983234da

Fix to_container call (#1190)

dakinggg committed 1 year ago

Verified 1dd37c5b

Set ft dataloader name explicitly (#1187)

milocress committed 1 year ago

Verified 51d0d096

Docstring fix for curriculum learning callback (#1186)

snarayan21 committed 1 year ago

Verified 139abab7

Remove python 3.8 and add python 3.11 (#1189)

j316chuck committed 1 year ago

Verified c6679d3c

checking if attention mask present for ignoring pad tokens in ffn (#1188)

ShashankMosaicML committed 1 year ago

Verified 0c7bc2a3

Refactoring attention (#1182)

ShashankMosaicML committed 1 year ago

Verified ac563e6d

update version names (#1185)

milocress committed 1 year ago

Verified 46b8bee8

structuredconfig for train.py and eval.py (#1051)

milocress committed 1 year ago

Verified cc8351c4

Bump version v0.9.0.dev0 (#1181)

milocress committed 1 year ago

Verified a7770148

Fix config access for DBRX (#1177)

dakinggg committed 1 year ago

Verified ab9dde73

Older