mosaicml/llm-foundry

Pull Requests Commits

pass parallelism config directly

irenedea committed 1 year ago

c5c6c753

pass fsdp config through via parallelism_config

irenedea committed 1 year ago

e08d25cd

Merge branch 'main' into bump_version_0.14.0.dev0

irenedea committed 1 year ago

Verified 553f3c17

Add build callback tests (#1577)

irenedea committed 1 year ago

Verified 9b765324

irenedea committed 1 year ago

0f278509

Merge branch 'main' into bump_version_0.14.0.dev0

irenedea committed 1 year ago

Verified fe008639

Make FinetuningStreamingDataset parameters more flexible (#1580)

XiaohanZhangCMU committed 1 year ago

Verified 4a47b5d5

Bump onnxruntime from 1.19.0 to 1.19.2 (#1590)

dependabot[bot] committed 1 year ago

Verified 6a748e92

Merge branch 'main' into bump_version_0.14.0.dev0

irenedea committed 1 year ago

Verified 9cab8804

irenedea committed 1 year ago

d384b106

Do not autoresume if a default name is set, only on user defined ones (#1588)

irenedea committed 1 year ago

Verified c6b74538

irenedea committed 1 year ago

df8f451f

irenedea committed 1 year ago

a4f6a8ed

irenedea committed 1 year ago

3849957c

Remove deprecated HuggingFaceModelWithFSDP

irenedea committed 1 year ago

f6f1c57c

Remove deprecated fsdp_config

irenedea committed 1 year ago

4f29dd8d

Bump version to 0.14.0.dev0.

irenedea committed 1 year ago

0890d243

Change cluster errors from NetworkError to UserError (#1586)

irenedea committed 1 year ago

Verified aad13c47

Error if filtered dataset contains 0 examples (#1585)

irenedea committed 1 year ago

Verified e6e74a24

Fix pytorch checkpointing for CL callback (#1583)

b-chu committed 1 year ago

Verified 85b251ff

Fix pytorch checkpointing for CL callback (#1581)

b-chu committed 1 year ago

Verified 16548272

Set streaming log level (#1582)

mvpatel2000 committed 1 year ago

Verified 5b0a53ef

Handle long file names in convert text to mds (#1579)

irenedea committed 1 year ago

Verified 813d50e7

Add extensions to FinetuningFileNotFoundError (#1578)

b-chu committed 1 year ago

Verified 237886cc

Bump tiktoken from 0.4.0 to 0.8.0 (#1572)

dependabot[bot] committed 1 year ago

Verified 23caea75

Allow parameters with requires_grad=False in meta init (#1567)

sashaDoubov committed 1 year ago

Verified 7c6c9f1f

Do not consider run_name when auto-detecting autoresume (#1571)

irenedea committed 1 year ago

Verified f87c9da9

Changes for dataset swap callback (#1569)

gupta-abhay committed 1 year ago

Verified 788c1f59

Cleanup TP (#1556)

eitanturok committed 1 year ago

Verified 4bbb4a5c

Revert FT dataloader changes from #1561, keep #1564 (#1566)

snarayan21 committed 1 year ago

Verified 214305fb

Older