mosaicml/llm-foundry

Pull Requests Commits
Patch os cpu count to avoid extra multiprocessing inside pytest which sometimes hangs (#745)
dakinggg committed 2 years ago
Verified 25bb63f1
Bump to composer 0.17 (#736)
dakinggg committed 2 years ago
Verified e730995c
fix script (#741)
mvpatel2000 committed 2 years ago
Verified e7962187
Fix passed metadata to mlflow logging (#713)
wenfeiy-db committed 2 years ago
Verified db279d09
Fix pairwise attention comparison in test (#737)
sashaDoubov committed 2 years ago
Verified f114dad5
remove tokenizer_name field (#735)
dakinggg committed 2 years ago
Verified 45113ebf
Rename log message (#734)
b-chu committed 2 years ago
Verified 753feff9
Better defaults for StreamingDataset subclasses (#723)
snarayan21 committed 2 years ago
Verified d1960f2c
add act checkpoint at sub layer level (#720)
cli99 committed 2 years ago
Verified 8ba697ce
Enable `tie_word_embeddings` config setting to enable / disable weight tied embeddings (#728)
vchiley committed 2 years ago
Verified 78991788
Make TiktokenTokenizerWrapper compatible with convert_composer_to_hf.py (#730)
irenedea committed 2 years ago
Verified d11ba820
Create AWS docker image for fine tuning (#731)
j316chuck committed 2 years ago
Verified e7223dad
Gate the dist calls in build_tokenizer (#732)
dakinggg committed 2 years ago
Verified c3f0cf97
Fix logging verbosity in HF model download script and repair symlinks (#727)
jerrychen109 committed 2 years ago
Verified 7c4d24a8
Combine filters into one, to avoid datasets error (#729)
dakinggg committed 2 years ago
Verified 2f91a64a
Add Unity Catalog support to HF checkpointer (#721)
dakinggg committed 2 years ago
Verified d2ddb834
Attempt to fix a very occasional hang in datasets map/filter (#725)
dakinggg committed 2 years ago
Verified efaa5454
change default overwrite to True (#724)
dakinggg committed 2 years ago
Verified ab9b9385
raise timeout (#719)
mvpatel2000 committed 2 years ago
Verified 84c86e3b
Set persistent_workers = False for packing profiling (#718)
dakinggg committed 2 years ago
Verified dd157918
Add databricks dependency (#717)
irenedea committed 2 years ago
Verified 2b74cb25
Adding support for Rotary Position Embeddings (#675)
ShashankMosaicML committed 2 years ago
Verified 1d504c85
Add Hugging Face model download script (#708)
jerrychen109 committed 2 years ago
Verified 58d7cf3e
Run HF dataset processing on local rank 0 first (#716)
dakinggg committed 2 years ago
Verified c2f5742d
Allow logging metadata (#714)
dakinggg committed 2 years ago
Verified ffb58f18
Remove HumanEval tasks from ICL eval (#715)
tbarton16 committed 2 years ago
Verified be467aee
Add support for auto packing ratio (#683)
irenedea committed 2 years ago
Verified ca8e6b5c
Fix HF local module copy contention with a meta init on local rank 0 (#710)
dakinggg committed 2 years ago
Verified 6c412412
Add num_proc to map and filter calls (#706)
dakinggg committed 2 years ago
Verified ac8e023d
Make TiktokenTokenizerWrapper picklable (#700)
irenedea committed 2 years ago
Verified 51a174fe
Terms Of Use Privacy Policy Refund Policy Impressum