mosaicml/llm-foundry

Pull Requests Commits

snarayan21 committed 1 year ago

b244d5ef

snarayan21 committed 1 year ago

65a3873e

snarayan21 committed 1 year ago

aba03d13

Merge branch 'main' of https://github.com/mosaicml/llm-foundry

snarayan21 committed 1 year ago

f7cfa580

Updated error message for cluster check (#1602)

Nancy Hung committed 1 year ago

Verified 21c7ec88

Add env var for configuring the maximum number of processes to use for dataset processing (#1606)

irenedea committed 1 year ago

Verified 97d7f6bd

Data prep on multiple GPUs (#1576)

eitanturok committed 1 year ago

Verified 8e78eb53

Remove TE from dockerfile and instead add as optional dependency (#1605)

snarayan21 committed 1 year ago

Verified 6448e4ef

Merge branch 'main' of https://github.com/mosaicml/llm-foundry

snarayan21 committed 1 year ago

70b46f6e

Bump onnx from 1.16.2 to 1.17.0 (#1604)

dependabot[bot] committed 1 year ago

Verified 783d4569

Finetuning dataloader validation tweaks (#1600)

mvpatel2000 committed 1 year ago

Verified e63a9d34

Loosen MegaBlocks to <1.0 (#1598)

mvpatel2000 committed 1 year ago

Verified 706a20ac

Add configurability for hf checkpointer register timeout (#1599)

dakinggg committed 1 year ago

Verified 96f6419f

Loosen MegaBlocks version pin (#1597)

mvpatel2000 committed 1 year ago

Verified 10f25aea

Pass accmulate_train_batch_on_tokens through to composer (#1595)

dakinggg committed 1 year ago

Verified fe5890e8

Update mcli examples to use 0.13.0 (#1594)

irenedea committed 1 year ago

Verified 13e0a6d4

Fix typo in eval code by using 'fsdp' instead of 'fsdp_config' (#1593)

irenedea committed 1 year ago

Verified de8de10a

Bump version to 0.14.0.dev0 (#1587)

irenedea committed 1 year ago

Verified 18a28f63

Add build callback tests (#1577)

irenedea committed 1 year ago

Verified 9b765324

Make FinetuningStreamingDataset parameters more flexible (#1580)

XiaohanZhangCMU committed 1 year ago

Verified 4a47b5d5

Bump onnxruntime from 1.19.0 to 1.19.2 (#1590)

dependabot[bot] committed 1 year ago

Verified 6a748e92

Do not autoresume if a default name is set, only on user defined ones (#1588)

irenedea committed 1 year ago

Verified c6b74538

Change cluster errors from NetworkError to UserError (#1586)

irenedea committed 1 year ago

Verified aad13c47

Error if filtered dataset contains 0 examples (#1585)

irenedea committed 1 year ago

Verified e6e74a24

Fix pytorch checkpointing for CL callback (#1583)

b-chu committed 1 year ago

Verified 85b251ff

Fix pytorch checkpointing for CL callback (#1581)

b-chu committed 1 year ago

Verified 16548272

Set streaming log level (#1582)

mvpatel2000 committed 1 year ago

Verified 5b0a53ef

Handle long file names in convert text to mds (#1579)

irenedea committed 1 year ago

Verified 813d50e7

Add extensions to FinetuningFileNotFoundError (#1578)

b-chu committed 1 year ago

Verified 237886cc

Bump tiktoken from 0.4.0 to 0.8.0 (#1572)

dependabot[bot] committed 1 year ago

Verified 23caea75

Older