mosaicml/llm-foundry

Pull Requests Commits

Add eval loader to eval script

aspfohl committed 2 years ago

33e6a3bc

aspfohl committed 2 years ago

32902793

add log params to log config

aspfohl committed 2 years ago

d1b54aa9

aspfohl committed 2 years ago

5aab21b6

Merge branch 'main' into anna/temp

aspfohl committed 2 years ago

Verified 02a95c7e

aspfohl committed 2 years ago

e1432a16

Fix missing import (#470)

bcui19 committed 2 years ago

Verified ca0bf0fc

Adding different device intialization to eval (#466)

bcui19 committed 2 years ago

Verified bb0ad428

aspfohl committed 2 years ago

843d9224

aspfohl committed 2 years ago

6d8b5d7c

Update inference benchmark with HF changes (#461)

sashaDoubov committed 2 years ago

Verified 3e292334

Update mpt-30b-instruct.yaml (#448)

samhavens committed 2 years ago

Verified 3b0b678a

Add linear layer and ffn config to enable TransformerEngine layers (with FP8) (#432)

vchiley committed 2 years ago

Verified 340a5665

setup.py: replace composer with mosaicml (#458)

guoyejun committed 2 years ago

Verified 275fa56d

Add trust remote code for tokenizer in inference conversion script (#446)

margaretqian committed 2 years ago

Verified 496b50bd

Update mcli-hf-generate.yaml (#456)

vchiley committed 2 years ago

Verified 2f49eb7f

Use torch.repeat instead of expand on key & value in Triton MQA to prevent NaNs with certain h_dims (#442)

sashaDoubov committed 2 years ago

Verified 86a99e2a

Remove try catch in eval.py; make model_gauntlet optional in eval.py (#434)

bmosaicml committed 2 years ago

Verified 62e2feac

Update README.md (#429)

abhi-mosaic committed 2 years ago

Verified ef350d9e

Release/v0.2.0 (#410)

vchiley committed 2 years ago

Verified 5b316c37

Update tasks_light.yaml (#422)

jfrankle committed 2 years ago

Verified 3ab04692

rm peft from pypi package since it wont install (#420)

vchiley committed 2 years ago

Verified 904a3216

Edit tutorial comments on PEFT / LoRA (#416)

vchiley committed 2 years ago

Verified 4e6a878b

Update mcli-hf-eval.yaml (#411)

samhavens committed 2 years ago

Verified 29d65cc2

YAMLS for MPT runs inherit global max_seq_len in model config (#409)

alextrott16 committed 2 years ago

Verified 5c146618

updt dtype of causal mask (#408)

vchiley committed 2 years ago

Verified 37bf6f51

add install for AMD beta support (#407)

vchiley committed 2 years ago

Verified 2e852dbf

Fix/bugbash002 (#405)

danbider committed 2 years ago

Verified 99694a76

Clean up train README (#392)

jacobfulano committed 2 years ago

Verified 33aeb79d

Eval Quickstart (#398)

samhavens committed 2 years ago

Verified 7c9f0777

Older