mosaicml/llm-foundry

Pull Requests Commits

Change accumulate_train_batch_on_tokens default to True (#1618)

dakinggg committed 1 year ago

Verified 8b2a88bd

Add loss generating token counts (#1610)

dakinggg committed 1 year ago

Verified 874c30aa

Bump composer version to 0.26.0 (#1616)

irenedea committed 1 year ago

Verified e11a43c2

Use a temporary directory for downloading finetuning dataset files (#1608)

irenedea committed 1 year ago

Verified ed6b72bf

Add UC not enabled error for delta to json conversion (#1613)

irenedea committed 1 year ago

Verified c0019632

Ensure log messages are properly formatted again (#1614)

snarayan21 committed 1 year ago

Verified 08702d2a

Use fun default composer run names (#1611)

irenedea committed 1 year ago

Verified b05c4ef4

Updated error message for cluster check (#1602)

Nancy Hung committed 1 year ago

Verified 21c7ec88

Add env var for configuring the maximum number of processes to use for dataset processing (#1606)

irenedea committed 1 year ago

Verified 97d7f6bd

Data prep on multiple GPUs (#1576)

eitanturok committed 1 year ago

Verified 8e78eb53

Remove TE from dockerfile and instead add as optional dependency (#1605)

snarayan21 committed 1 year ago

Verified 6448e4ef

Bump onnx from 1.16.2 to 1.17.0 (#1604)

dependabot[bot] committed 1 year ago

Verified 783d4569

Finetuning dataloader validation tweaks (#1600)

mvpatel2000 committed 1 year ago

Verified e63a9d34

Loosen MegaBlocks to <1.0 (#1598)

mvpatel2000 committed 1 year ago

Verified 706a20ac

Add configurability for hf checkpointer register timeout (#1599)

dakinggg committed 1 year ago

Verified 96f6419f

Loosen MegaBlocks version pin (#1597)

mvpatel2000 committed 1 year ago

Verified 10f25aea

Pass accmulate_train_batch_on_tokens through to composer (#1595)

dakinggg committed 1 year ago

Verified fe5890e8

Update mcli examples to use 0.13.0 (#1594)

irenedea committed 1 year ago

Verified 13e0a6d4

Fix typo in eval code by using 'fsdp' instead of 'fsdp_config' (#1593)

irenedea committed 1 year ago

Verified de8de10a

Bump version to 0.14.0.dev0 (#1587)

irenedea committed 1 year ago

Verified 18a28f63

Add build callback tests (#1577)

irenedea committed 1 year ago

Verified 9b765324

Make FinetuningStreamingDataset parameters more flexible (#1580)

XiaohanZhangCMU committed 1 year ago

Verified 4a47b5d5

Bump onnxruntime from 1.19.0 to 1.19.2 (#1590)

dependabot[bot] committed 1 year ago

Verified 6a748e92

Do not autoresume if a default name is set, only on user defined ones (#1588)

irenedea committed 1 year ago

Verified c6b74538

Change cluster errors from NetworkError to UserError (#1586)

irenedea committed 1 year ago

Verified aad13c47

Error if filtered dataset contains 0 examples (#1585)

irenedea committed 1 year ago

Verified e6e74a24

Fix pytorch checkpointing for CL callback (#1583)

b-chu committed 1 year ago

Verified 85b251ff

Fix pytorch checkpointing for CL callback (#1581)

b-chu committed 1 year ago

Verified 16548272

Set streaming log level (#1582)

mvpatel2000 committed 1 year ago

Verified 5b0a53ef

Handle long file names in convert text to mds (#1579)

irenedea committed 1 year ago

Verified 813d50e7

Newer Older