mosaicml/llm-foundry

Pull Requests Commits

josejg committed 1 year ago

5cdc63fc

Adds a decorator for experimental features (#1038)

dakinggg committed 1 year ago

Verified c88169da

Fix llama attention patch (#1036)

dakinggg committed 1 year ago

Verified cffd75e9

Allow code-quality workflow to be callable (#1026)

b-chu committed 1 year ago

Verified 14e2dec8

Fix typo in monolithic chkpt callback docs (#1024)

sashaDoubov committed 1 year ago

Verified 4e8a875b

Bump version to 0.6.0 (#1023)

dakinggg committed 1 year ago

Verified 257c25d5

bmosaicml committed 1 year ago

Verified 4e437922

Add code import to train/eval scripts (#1002)

dakinggg committed 1 year ago

Verified d61c53d2

Update readme with pytorch 2.2.1 (#1021)

irenedea committed 1 year ago

Verified 2fc5d332

that kwargs (#1020)

snarayan21 committed 1 year ago

Verified 36ab1bae

Bump transformers to 4.38.2 (#1018)

dakinggg committed 1 year ago

Verified 2b17497d

Fix profiling packing ratio to explicitly say 1 (#1019)

irenedea committed 1 year ago

Verified c2aec307

Add deeper support for multi-turn chats and loss-generating tokens in finetuning (#985)

alextrott16 committed 1 year ago

Verified 64212cba

Add support for olmo (#1016)

dakinggg committed 1 year ago

Verified 93d7a051

add default for eval interval (#987)

irenedea committed 1 year ago

Verified 5261a55d

Bump min composer pin (#1015)

dakinggg committed 1 year ago

Verified 86c87461

Fix extra BOS token in front of response for some tokenizers (#1003)

dakinggg committed 1 year ago

Verified cf0f5e51

Bump min torch pin (#1013)

dakinggg committed 1 year ago

Verified f4f64140

add 2.2.1 tests (#1011)

dakinggg committed 1 year ago

Verified 57289699

Build torch 2.2.1 images (#1010)

dakinggg committed 1 year ago

Verified fd8cbaf6

Fix evaluators actually pulling eval metrics (#1006)

mvpatel2000 committed 1 year ago

Verified 09ff5505

mvpatel2000 committed 1 year ago

Verified cbdddf0f

add magic filename for sharded state dicts (#1001)

milocress committed 1 year ago

Verified 96c8218b

Deprecate triton, prefix lm, llama attention patch, and text denoising; Make ComposerHFT5 experimental (#1007)

irenedea committed 1 year ago

Verified 3880d045

Remove try except around imports (#1004)

dakinggg committed 1 year ago

Verified 2dea7373

Make CodeEval respect device_eval_batch_size (#956)

josejg committed 1 year ago

Verified d104d16a

Use ci-testing repo (#1000)

b-chu committed 1 year ago

Verified 2436c00b

Revert "Change ci/cd to use ci-testing repo"

b-chu committed 1 year ago

5abbca06

Change ci/cd to use ci-testing repo

b-chu committed 1 year ago

e3f214e7

add oom observer callback (#932)

cli99 committed 1 year ago

Verified b0825114

Older