mosaicml/llm-foundry

Pull Requests Commits

tbarton16 committed 2 years ago

a1762be6

Set persistent_workers = False for packing profiling (#718)

dakinggg committed 2 years ago

Verified dd157918

Add databricks dependency (#717)

irenedea committed 2 years ago

Verified 2b74cb25

Adding support for Rotary Position Embeddings (#675)

ShashankMosaicML committed 2 years ago

Verified 1d504c85

Add Hugging Face model download script (#708)

jerrychen109 committed 2 years ago

Verified 58d7cf3e

Run HF dataset processing on local rank 0 first (#716)

dakinggg committed 2 years ago

Verified c2f5742d

Allow logging metadata (#714)

dakinggg committed 2 years ago

Verified ffb58f18

Remove HumanEval tasks from ICL eval (#715)

tbarton16 committed 2 years ago

Verified be467aee

Add support for auto packing ratio (#683)

irenedea committed 2 years ago

Verified ca8e6b5c

Fix HF local module copy contention with a meta init on local rank 0 (#710)

dakinggg committed 2 years ago

Verified 6c412412

Add num_proc to map and filter calls (#706)

dakinggg committed 2 years ago

Verified ac8e023d

Make TiktokenTokenizerWrapper picklable (#700)

irenedea committed 2 years ago

Verified 51a174fe

Improvement in README.md and TUTORIAL.md (#699)

tmsagarofficial committed 2 years ago

Verified 3eb9717c

add test coverage for lion and lion8b checkpoint interop (#679)

dblalock committed 2 years ago

Verified 08f377bc

Fix attention patch compatibility for llama2 (#705)

irenedea committed 2 years ago

Verified e40689f4

Remove prefixlm support for OPT and Bloom (#704)

dakinggg committed 2 years ago

Verified db9227aa

Change gauntlet avging (#640)

bmosaicml committed 2 years ago

Verified 9027f491

remove logs (#698)

mvpatel2000 committed 2 years ago

Verified 7009d4d1

Pad tiktoken vocab so that additional_special_tokens works (#695)

dakinggg committed 2 years ago

Verified 6f597384

Update README.md (#693)

j316chuck committed 2 years ago

Verified c60657b2

Make default for cuda_load_lazy false (#694)

irenedea committed 2 years ago

Verified 08611b0d

Add fixtures (#673)

irenedea committed 2 years ago

Verified ea3279ac

Fix mlflow model logging bug (#692)

dakinggg committed 2 years ago

Verified bc687b75

Allow flash attention 2 and upgrade to transformers 4.34.1 (#672)

dakinggg committed 2 years ago

Verified d72902ae

Attempt to fix flaky test (#688)

dakinggg committed 2 years ago

Verified 091ddca0

Tiktoken wrapper add_eos_token option (#681)

rajammanabrolu committed 2 years ago

Verified f65b07e8

Adding Mosaic logger + logging data validated event (#670)

jjanezhang committed 2 years ago

Verified 459947c7

add |---| to render tables (#686)

crinard committed 2 years ago

Verified 3e5b9604

Update_pretrain_benchmarks (#543)

crinard committed 2 years ago

Verified b2a43a14

Add profiler support in llm foundry (#678)

j316chuck committed 2 years ago

Verified 92bd673c

Older