mosaicml/llm-foundry

Pull Requests Commits

bmosaicml committed 2 years ago

335e0879

added math dataset

bmosaicml committed 2 years ago

0ff65983

bump version (#758)

dakinggg committed 2 years ago

Verified f8ee9146

Small test fix to have right padding (#757)

sashaDoubov committed 2 years ago

Verified 1eecd4cb

Fix flash attention GQA bug to use the dynamic size of the key/value tensors - used for eval/inference (#756)

sashaDoubov committed 2 years ago

Verified 1793c366

Gauntlet v0.1.0 yaml fixes (#748)

bmosaicml committed 2 years ago

Verified e7943e3f

Catch exception raised in hf prep properly (#749)

j316chuck committed 2 years ago

Verified 7f5d70c4

Pin Chat format to TiktokenTokenizerWrapper (#752)

rajammanabrolu committed 2 years ago

Verified e191b050

Fix 1.13 tests (#751)

dakinggg committed 2 years ago

Verified 6dc94a24

Fix typo in workflow file (#750)

dakinggg committed 2 years ago

Verified 9bf21f2b

Remove extra test suite (#743)

dakinggg committed 2 years ago

Verified 437fc55f

Gauntlet v0.1 (#674)

bmosaicml committed 2 years ago

Verified ab5577b2

Reenable tests that were accidentally disabled (#746)

dakinggg committed 2 years ago

Verified 269ded6d

Patch os cpu count to avoid extra multiprocessing inside pytest which sometimes hangs (#745)

dakinggg committed 2 years ago

Verified 25bb63f1

Bump to composer 0.17 (#736)

dakinggg committed 2 years ago

Verified e730995c

fix script (#741)

mvpatel2000 committed 2 years ago

Verified e7962187

Fix passed metadata to mlflow logging (#713)

wenfeiy-db committed 2 years ago

Verified db279d09

Fix pairwise attention comparison in test (#737)

sashaDoubov committed 2 years ago

Verified f114dad5

remove tokenizer_name field (#735)

dakinggg committed 2 years ago

Verified 45113ebf

Rename log message (#734)

b-chu committed 2 years ago

Verified 753feff9

Better defaults for StreamingDataset subclasses (#723)

snarayan21 committed 2 years ago

Verified d1960f2c

add act checkpoint at sub layer level (#720)

cli99 committed 2 years ago

Verified 8ba697ce

Enable `tie_word_embeddings` config setting to enable / disable weight tied embeddings (#728)

vchiley committed 2 years ago

Verified 78991788

Make TiktokenTokenizerWrapper compatible with convert_composer_to_hf.py (#730)

irenedea committed 2 years ago

Verified d11ba820

Create AWS docker image for fine tuning (#731)

j316chuck committed 2 years ago

Verified e7223dad

Gate the dist calls in build_tokenizer (#732)

dakinggg committed 2 years ago

Verified c3f0cf97

Fix logging verbosity in HF model download script and repair symlinks (#727)

jerrychen109 committed 2 years ago

Verified 7c4d24a8

Combine filters into one, to avoid datasets error (#729)

dakinggg committed 2 years ago

Verified 2f91a64a

Add Unity Catalog support to HF checkpointer (#721)

dakinggg committed 2 years ago

Verified d2ddb834

Attempt to fix a very occasional hang in datasets map/filter (#725)

dakinggg committed 2 years ago

Verified efaa5454

Older