mosaicml/llm-foundry

Pull Requests Commits

Change gauntlet avging (#640)

bmosaicml committed 2 years ago

Verified 9027f491

remove logs (#698)

mvpatel2000 committed 2 years ago

Verified 7009d4d1

Pad tiktoken vocab so that additional_special_tokens works (#695)

dakinggg committed 2 years ago

Verified 6f597384

Update README.md (#693)

j316chuck committed 2 years ago

Verified c60657b2

Make default for cuda_load_lazy false (#694)

irenedea committed 2 years ago

Verified 08611b0d

Add fixtures (#673)

irenedea committed 2 years ago

Verified ea3279ac

Fix mlflow model logging bug (#692)

dakinggg committed 2 years ago

Verified bc687b75

Allow flash attention 2 and upgrade to transformers 4.34.1 (#672)

dakinggg committed 2 years ago

Verified d72902ae

Attempt to fix flaky test (#688)

dakinggg committed 2 years ago

Verified 091ddca0

Tiktoken wrapper add_eos_token option (#681)

rajammanabrolu committed 2 years ago

Verified f65b07e8

Adding Mosaic logger + logging data validated event (#670)

jjanezhang committed 2 years ago

Verified 459947c7

add |---| to render tables (#686)

crinard committed 2 years ago

Verified 3e5b9604

Update_pretrain_benchmarks (#543)

crinard committed 2 years ago

Verified b2a43a14

Add profiler support in llm foundry (#678)

j316chuck committed 2 years ago

Verified 92bd673c

Small changes to HF repo update script (#680)

dakinggg committed 2 years ago

Verified f11483f4

add `load_strict_model_weights` as an optional config parameter (#655)

AllenHW committed 2 years ago

Verified 2c5965e5

Add support for automatically registering models to UC at the end of training (#618)

dakinggg committed 2 years ago

Verified cc238a3e

Convert to DataSpec and add token counts that include padding (#676)

dakinggg committed 2 years ago

Verified 4fa2dd88

small typos in eval readme (#671)

maxisawesome committed 2 years ago

Verified aecadc90

Do not update past_key_values in place (#652)

irenedea committed 2 years ago

Verified 3c7421c0

Point to composer.callback.Generate (#631)

aspfohl committed 2 years ago

Verified db2233e5

Fix typo in image name (#669)

dakinggg committed 2 years ago

Verified 8e4c30a9

Adding Simplified Coding Tasks (#645)

Michael Carbin committed 2 years ago

Verified cdb1c284

Add test suite for flash attention 2 (#666)

dakinggg committed 2 years ago

Verified 0045ae60

Inverse Square Root LR Schedule (#657)

Mansheej Paul committed 2 years ago

Verified 6c982767

put target back (#668)

dakinggg committed 2 years ago

Verified bdac4c71

dakinggg committed 2 years ago

Verified a1283403

Add images with flash attention 2 (#651)

dakinggg committed 2 years ago

Verified ba6b8803

chang bsz to 1 (#654)

bmosaicml committed 2 years ago

Verified 1bf0a939

Switch ordering of foundry gpu tests (#665)

j316chuck committed 2 years ago

Verified b0bc6640

Older