mosaicml/llm-foundry

Pull Requests Commits

tbarton16 committed 2 years ago

a1ad79ee

tbarton16 committed 2 years ago

f228ae20

Merge branch 'main' into output_eval_logging

bmosaicml committed 2 years ago

29c297a5

bmosaicml committed 2 years ago

af328242

Fix logging verbosity in HF model download script and repair symlinks (#727)

jerrychen109 committed 2 years ago

Verified 7c4d24a8

Combine filters into one, to avoid datasets error (#729)

dakinggg committed 2 years ago

Verified 2f91a64a

Add Unity Catalog support to HF checkpointer (#721)

dakinggg committed 2 years ago

Verified d2ddb834

Attempt to fix a very occasional hang in datasets map/filter (#725)

dakinggg committed 2 years ago

Verified efaa5454

change default overwrite to True (#724)

dakinggg committed 2 years ago

Verified ab9b9385

raise timeout (#719)

mvpatel2000 committed 2 years ago

Verified 84c86e3b

Set persistent_workers = False for packing profiling (#718)

dakinggg committed 2 years ago

Verified dd157918

Add databricks dependency (#717)

irenedea committed 2 years ago

Verified 2b74cb25

Adding support for Rotary Position Embeddings (#675)

ShashankMosaicML committed 2 years ago

Verified 1d504c85

Add Hugging Face model download script (#708)

jerrychen109 committed 2 years ago

Verified 58d7cf3e

Run HF dataset processing on local rank 0 first (#716)

dakinggg committed 2 years ago

Verified c2f5742d

Allow logging metadata (#714)

dakinggg committed 2 years ago

Verified ffb58f18

Remove HumanEval tasks from ICL eval (#715)

tbarton16 committed 2 years ago

Verified be467aee

Add support for auto packing ratio (#683)

irenedea committed 2 years ago

Verified ca8e6b5c

Fix HF local module copy contention with a meta init on local rank 0 (#710)

dakinggg committed 2 years ago

Verified 6c412412

Add num_proc to map and filter calls (#706)

dakinggg committed 2 years ago

Verified ac8e023d

Make TiktokenTokenizerWrapper picklable (#700)

irenedea committed 2 years ago

Verified 51a174fe

Improvement in README.md and TUTORIAL.md (#699)

tmsagarofficial committed 2 years ago

Verified 3eb9717c

add test coverage for lion and lion8b checkpoint interop (#679)

dblalock committed 2 years ago

Verified 08f377bc

Fix attention patch compatibility for llama2 (#705)

irenedea committed 2 years ago

Verified e40689f4

Remove prefixlm support for OPT and Bloom (#704)

dakinggg committed 2 years ago

Verified db9227aa

Change gauntlet avging (#640)

bmosaicml committed 2 years ago

Verified 9027f491

remove logs (#698)

mvpatel2000 committed 2 years ago

Verified 7009d4d1

Pad tiktoken vocab so that additional_special_tokens works (#695)

dakinggg committed 2 years ago

Verified 6f597384

Update README.md (#693)

j316chuck committed 2 years ago

Verified c60657b2

Make default for cuda_load_lazy false (#694)

irenedea committed 2 years ago

Verified 08611b0d

Older