mosaicml/llm-foundry

Pull Requests Commits

v-chen_data committed 1 year ago

e77a26ab

play with config

v-chen_data committed 1 year ago

57068a96

v-chen_data committed 1 year ago

9a226e7e

set default task to none when task is unrecognized

v-chen_data committed 1 year ago

eadc920e

Pass accmulate_train_batch_on_tokens through to composer (#1595)

dakinggg committed 1 year ago

Verified fe5890e8

Update mcli examples to use 0.13.0 (#1594)

irenedea committed 1 year ago

Verified 13e0a6d4

Fix typo in eval code by using 'fsdp' instead of 'fsdp_config' (#1593)

irenedea committed 1 year ago

Verified de8de10a

Bump version to 0.14.0.dev0 (#1587)

irenedea committed 1 year ago

Verified 18a28f63

Add build callback tests (#1577)

irenedea committed 1 year ago

Verified 9b765324

Make FinetuningStreamingDataset parameters more flexible (#1580)

XiaohanZhangCMU committed 1 year ago

Verified 4a47b5d5

Bump onnxruntime from 1.19.0 to 1.19.2 (#1590)

dependabot[bot] committed 1 year ago

Verified 6a748e92

Do not autoresume if a default name is set, only on user defined ones (#1588)

irenedea committed 1 year ago

Verified c6b74538

Change cluster errors from NetworkError to UserError (#1586)

irenedea committed 1 year ago

Verified aad13c47

Error if filtered dataset contains 0 examples (#1585)

irenedea committed 1 year ago

Verified e6e74a24

Fix pytorch checkpointing for CL callback (#1583)

b-chu committed 1 year ago

Verified 85b251ff

Fix pytorch checkpointing for CL callback (#1581)

b-chu committed 1 year ago

Verified 16548272

Set streaming log level (#1582)

mvpatel2000 committed 1 year ago

Verified 5b0a53ef

Handle long file names in convert text to mds (#1579)

irenedea committed 1 year ago

Verified 813d50e7

Add extensions to FinetuningFileNotFoundError (#1578)

b-chu committed 1 year ago

Verified 237886cc

Bump tiktoken from 0.4.0 to 0.8.0 (#1572)

dependabot[bot] committed 1 year ago

Verified 23caea75

Allow parameters with requires_grad=False in meta init (#1567)

sashaDoubov committed 1 year ago

Verified 7c6c9f1f

Do not consider run_name when auto-detecting autoresume (#1571)

irenedea committed 1 year ago

Verified f87c9da9

Changes for dataset swap callback (#1569)

gupta-abhay committed 1 year ago

Verified 788c1f59

Cleanup TP (#1556)

eitanturok committed 1 year ago

Verified 4bbb4a5c

Revert FT dataloader changes from #1561, keep #1564 (#1566)

snarayan21 committed 1 year ago

Verified 214305fb

Release docker img (#1547)

KuuCi committed 1 year ago

Verified 24fec790

Add InvalidConversationError (#1565)

b-chu committed 1 year ago

Verified a462f037

Add FileExtensionNotFoundError (#1564)

b-chu committed 1 year ago

Verified 8cf3d871

Add error to catch more unknown example types (#1562)

milocress committed 1 year ago

Verified b5172970

Add dataset swap callback (#1536)

b-chu committed 1 year ago

Verified ec4cafd4

Older