mosaicml/llm-foundry

Pull Requests Commits

v-chen_data committed 1 year ago

2bbb30de

v-chen_data committed 1 year ago

93913c2b

v-chen_data committed 1 year ago

9d0c9fce

v-chen_data committed 1 year ago

2640b299

Data prep on multiple GPUs (#1576)

eitanturok committed 1 year ago

Verified 8e78eb53

Remove TE from dockerfile and instead add as optional dependency (#1605)

snarayan21 committed 1 year ago

Verified 6448e4ef

Bump onnx from 1.16.2 to 1.17.0 (#1604)

dependabot[bot] committed 1 year ago

Verified 783d4569

Finetuning dataloader validation tweaks (#1600)

mvpatel2000 committed 1 year ago

Verified e63a9d34

Loosen MegaBlocks to <1.0 (#1598)

mvpatel2000 committed 1 year ago

Verified 706a20ac

Add configurability for hf checkpointer register timeout (#1599)

dakinggg committed 1 year ago

Verified 96f6419f

Loosen MegaBlocks version pin (#1597)

mvpatel2000 committed 1 year ago

Verified 10f25aea

Pass accmulate_train_batch_on_tokens through to composer (#1595)

dakinggg committed 1 year ago

Verified fe5890e8

Update mcli examples to use 0.13.0 (#1594)

irenedea committed 1 year ago

Verified 13e0a6d4

Fix typo in eval code by using 'fsdp' instead of 'fsdp_config' (#1593)

irenedea committed 1 year ago

Verified de8de10a

Bump version to 0.14.0.dev0 (#1587)

irenedea committed 1 year ago

Verified 18a28f63

Add build callback tests (#1577)

irenedea committed 1 year ago

Verified 9b765324

Make FinetuningStreamingDataset parameters more flexible (#1580)

XiaohanZhangCMU committed 1 year ago

Verified 4a47b5d5

Bump onnxruntime from 1.19.0 to 1.19.2 (#1590)

dependabot[bot] committed 1 year ago

Verified 6a748e92

Do not autoresume if a default name is set, only on user defined ones (#1588)

irenedea committed 1 year ago

Verified c6b74538

Change cluster errors from NetworkError to UserError (#1586)

irenedea committed 1 year ago

Verified aad13c47

Error if filtered dataset contains 0 examples (#1585)

irenedea committed 1 year ago

Verified e6e74a24

Fix pytorch checkpointing for CL callback (#1583)

b-chu committed 1 year ago

Verified 85b251ff

Fix pytorch checkpointing for CL callback (#1581)

b-chu committed 1 year ago

Verified 16548272

Set streaming log level (#1582)

mvpatel2000 committed 1 year ago

Verified 5b0a53ef

Handle long file names in convert text to mds (#1579)

irenedea committed 1 year ago

Verified 813d50e7

Add extensions to FinetuningFileNotFoundError (#1578)

b-chu committed 1 year ago

Verified 237886cc

Bump tiktoken from 0.4.0 to 0.8.0 (#1572)

dependabot[bot] committed 1 year ago

Verified 23caea75

Allow parameters with requires_grad=False in meta init (#1567)

sashaDoubov committed 1 year ago

Verified 7c6c9f1f

Do not consider run_name when auto-detecting autoresume (#1571)

irenedea committed 1 year ago

Verified f87c9da9

Changes for dataset swap callback (#1569)

gupta-abhay committed 1 year ago

Verified 788c1f59

Older