mosaicml/llm-foundry

Pull Requests Commits

nik-mosaic committed 2 years ago

03df0b32

Add secrets check as part of pre-commit (#360)

karan6181 committed 2 years ago

Verified 7abae0d0

Codeql on PRs (#352)

mvpatel2000 committed 2 years ago

Verified 38361a6f

Add MPT-30B to README (#356)

abhi-mosaic committed 2 years ago

Verified 77311067

Remote JSONL IFT data (#275)

samhavens committed 2 years ago

Verified af209b38

Revert "Filter out sequences where prompt is longer than max length, rather than dropping them on the fly later (#348)" (#354)

Cody Blakeney committed 2 years ago

Verified 2f1bf410

Filter out sequences where prompt is longer than max length, rather than dropping them on the fly later (#348)

dakinggg committed 2 years ago

Verified 2167c0e6

Add step to free up some disk space on the worker (#350)

bandish-shah committed 2 years ago

Verified d848d3da

Fix bug with saving optimizer states with MonolithicCheckpointSaver Callback (#310)

eracah committed 2 years ago

Verified 619400a2

updt yml (#349)

vchiley committed 2 years ago

Verified da7fa6b9

updt composer to 0.15.0 (#347)

vchiley committed 2 years ago

Verified 55da3258

Upgrade to `mosaicml-streaming==0.5.x` (#292)

abhi-mosaic committed 2 years ago

Verified 1ec21846

Add script to update hub code from foundry (#338)

dakinggg committed 2 years ago

Verified 525e8295

Better error messages for Composer to HF conversion (#320)

dskhudia committed 2 years ago

Verified f5fc645a

add mixed device (#342)

mvpatel2000 committed 2 years ago

Verified 40342770

Load on rank 0 only flag (#334)

mvpatel2000 committed 2 years ago

Verified 42fc81f0

Attn amp (#337)

vchiley committed 2 years ago

Verified 8c3c0c60

Create tasks_light.yaml (#335)

jfrankle committed 2 years ago

Verified fa925758

hard set bias(alibi) precision (#329)

vchiley committed 2 years ago

Verified 688cc526

Refresh Mosaicml platform yamls (#208)

aspfohl committed 2 years ago

Verified a7d6a447

Allow MPT past the tied word embeddings error (#323)

dakinggg committed 2 years ago

Verified 91d259ea

Fix generate callback to work with precision context (#322)

dakinggg committed 2 years ago

Verified 32b36c8b

Added new community tutorial on MPT-7B-Instruct Fine Tuning (#311)

VRSEN committed 2 years ago

Verified 3c7cb3f8

Huggingface Mixed Initialization (#303)

bcui19 committed 2 years ago

Verified 38efa7e0

Set eval shuffle to False (#297)

eldarkurtic committed 2 years ago

Verified 0ba87f79

fix autocast dtype (#302)

abhi-mosaic committed 2 years ago

Verified e39baed6

Update README.md (#300)

jacobfulano committed 2 years ago

Verified 0e55625c

Fix convert_dataset_hf.py hanging with excessive num_workers (#270)

casper-hansen committed 2 years ago

Verified 2733446b

Adding Custom Embedding, Enabling us to initialize on Heterogeneous Devices (#298)

bcui19 committed 2 years ago

Verified b1ac9daa

Update train.py (#301)

dakinggg committed 2 years ago

Verified e19ea3e8

Older