mosaicml/llm-foundry

Pull Requests Commits

Merge branch 'main' into eitan-patch-json

eitanturok committed 1 year ago

Verified e72b8a2a

Bump transformers to 4.40 (#1118)

dakinggg committed 1 year ago

Verified 4bb4d4a2

Merge branch 'main' into eitan-patch-json

eitanturok committed 1 year ago

Verified 7da976c8

Update tests to not rely on mistral (#1117)

dakinggg committed 1 year ago

Verified 84b64102

add `.json` to SUPPORTED_EXTENSIONS

eitanturok committed 1 year ago

Verified 60aad4c9

Add missing init file (#1113)

dakinggg committed 1 year ago

Verified f01f6256

Param init registry (#1096)

dakinggg committed 1 year ago

Verified 676ad7f9

FFN layer registry (#1095)

dakinggg committed 1 year ago

Verified cb0de4f7

Migrate ICL classes to foundry (#936)

bmosaicml committed 1 year ago

Verified 3729ba3e

Update config_moe_args.py (#1112)

vchiley committed 1 year ago

Verified 6257e5b9

Revert "Update config_moe_args.py (#1104)" (#1111)

vchiley committed 1 year ago

Verified b58d68c1

Dbrx finetune yaml requires save folder specified to enable autoresume (#1108)

mvpatel2000 committed 1 year ago

Verified e9b1c6e6

Attention layer registry (#1094)

dakinggg committed 1 year ago

Verified 560012b6

FC layer registry (#1093)

dakinggg committed 1 year ago

Verified ed3daef0

Support ShareGPT chat format (#1098)

samhavens committed 1 year ago

Verified 4cd2324e

GRT-2819 fix overwritting in script (#1107)

cli99 committed 1 year ago

Verified b5fc0fad

Add remote code option to allow execution of DBRX tokenizer (#1106)

b-chu committed 1 year ago

Verified 7337429d

Update config_moe_args.py (#1104)

vchiley committed 1 year ago

Verified 17f8aeb0

Remove torch compile (#1101)

josejg committed 1 year ago

Verified f12bc8aa

MegaBlocks release (#1102)

mvpatel2000 committed 1 year ago

Verified 53160f40

Updating the streaming version in setup.py (#1103)

ShashankMosaicML committed 1 year ago

Verified 2939cc98

fixing evaluator microbatch size (#1100)

ShashankMosaicML committed 1 year ago

Verified d0d94342

Norms registry (#1080)

dakinggg committed 1 year ago

Verified b81897ac

dakinggg committed 1 year ago

Verified 60a1ab4c

cleaned up HF/MPT conversion test (#1048)

milocress committed 1 year ago

Verified 94301cd1

Allow overrides for nested PretrainedConfig (#1089)

dakinggg committed 1 year ago

Verified 96b27c59

fix yamls typo (#1092)

dakinggg committed 1 year ago

Verified f18768b4

Bump transformers to 4.39.3 (#1086)

dakinggg committed 1 year ago

Verified 607b982d

fix typo in expandable_segments (#1088)

mammothb committed 1 year ago

Verified 06ff95f6

Bump HF version (#1091)

b-chu committed 1 year ago

Verified 26f0619d

Older