mosaicml/llm-foundry

Pull Requests Commits

add llama benchmarking script

nik-mosaic committed 2 years ago

9dd4f2c6

Fix ambiguous `throughput` in README (#476)

abhi-mosaic committed 2 years ago

Verified c6cfb428

Support eval loader when finetuning from JSONL files in object stores (#469)

samhavens committed 2 years ago

Verified 66b84bb4

Autoresume default on (#467)

mvpatel2000 committed 2 years ago

Verified ef8d4143

Fix missing import (#470)

bcui19 committed 2 years ago

Verified ca0bf0fc

Adding different device intialization to eval (#466)

bcui19 committed 2 years ago

Verified bb0ad428

Update inference benchmark with HF changes (#461)

sashaDoubov committed 2 years ago

Verified 3e292334

Update mpt-30b-instruct.yaml (#448)

samhavens committed 2 years ago

Verified 3b0b678a

Add linear layer and ffn config to enable TransformerEngine layers (with FP8) (#432)

vchiley committed 2 years ago

Verified 340a5665

setup.py: replace composer with mosaicml (#458)

guoyejun committed 2 years ago

Verified 275fa56d

Add trust remote code for tokenizer in inference conversion script (#446)

margaretqian committed 2 years ago

Verified 496b50bd

Update mcli-hf-generate.yaml (#456)

vchiley committed 2 years ago

Verified 2f49eb7f

Use torch.repeat instead of expand on key & value in Triton MQA to prevent NaNs with certain h_dims (#442)

sashaDoubov committed 2 years ago

Verified 86a99e2a

Remove try catch in eval.py; make model_gauntlet optional in eval.py (#434)

bmosaicml committed 2 years ago

Verified 62e2feac

Update README.md (#429)

abhi-mosaic committed 2 years ago

Verified ef350d9e

Release/v0.2.0 (#410)

vchiley committed 2 years ago

Verified 5b316c37

Update tasks_light.yaml (#422)

jfrankle committed 2 years ago

Verified 3ab04692

rm peft from pypi package since it wont install (#420)

vchiley committed 2 years ago

Verified 904a3216

Edit tutorial comments on PEFT / LoRA (#416)

vchiley committed 2 years ago

Verified 4e6a878b

Update mcli-hf-eval.yaml (#411)

samhavens committed 2 years ago

Verified 29d65cc2

YAMLS for MPT runs inherit global max_seq_len in model config (#409)

alextrott16 committed 2 years ago

Verified 5c146618

updt dtype of causal mask (#408)

vchiley committed 2 years ago

Verified 37bf6f51

add install for AMD beta support (#407)

vchiley committed 2 years ago

Verified 2e852dbf

Fix/bugbash002 (#405)

danbider committed 2 years ago

Verified 99694a76

Clean up train README (#392)

jacobfulano committed 2 years ago

Verified 33aeb79d

Eval Quickstart (#398)

samhavens committed 2 years ago

Verified 7c9f0777

Fixing hf_generate bug to account for pre-tokenization (#387)

ksreenivasan committed 2 years ago

Verified 8746a73e

propogate cache_limit in streaming ds (#402)

vchiley committed 2 years ago

Verified 73783b9c

add fn to clear tests after every test (#400)

vchiley committed 2 years ago

Verified 7ac58e0e

make peft installs a extra_dep (#397)

vchiley committed 2 years ago

Verified 156fcf19

Older