mosaicml/llm-foundry

Pull Requests Commits

Merge branch 'output_eval_logging' of github.com:mosaicml/llm-foundry into output_eval_logging

bmosaicml committed 2 years ago

4a8e9c3f

Merge branch 'main' into output_eval_logging

bmosaicml committed 2 years ago

b0285457

Merge branch 'main' into output_eval_logging

bmosaicml committed 2 years ago

e3861070

Fix openai not conditioned imports (#806)

dakinggg committed 2 years ago

Verified f56f1228

update openai wrapper to work with tiktoken interface and newest openai version (#794)

bmosaicml committed 2 years ago

Verified 5cc4dd4c

Fix token counting to use attention mask instead of ids (#802)

dakinggg committed 2 years ago

Verified 5388dc0d

clean up resolve_ffn_hidden_and_exp_ratio (#801)

vchiley committed 2 years ago

Verified 5fdcc43b

Enable GLU FFN type (#796)

vchiley committed 2 years ago

Verified 0797aa66

Minor readme updates and bump min python version (#799)

dakinggg committed 2 years ago

Verified 1c3c909d

Adding a fix for Cross Entropy Loss for long sequence lengths. (#795)

ShashankMosaicML committed 2 years ago

Verified 96cf646c

Enable flag to not pass PAD tokens in ffwd (#775)

bcui19 committed 2 years ago

Verified 410d5c71

Auto packing fixes (#783)

irenedea committed 2 years ago

Verified 34ec2f73

Remove from mcli.sdk imports (#793)

aspfohl committed 2 years ago

Verified 693ef102

Update gauntlet v0.2 to reflect results of calibration (#791)

bmosaicml committed 2 years ago

Verified 8d96f9d0

Fix utf-8 decode errors in tiktoken wrapper (#792)

dakinggg committed 2 years ago

Verified 75cc1e18

Remove tests and support for torch <2.1 (#787)

dakinggg committed 2 years ago

Verified 2017c028

tiktoken chat formatting (#784)

rajammanabrolu committed 2 years ago

Verified ef60e8ee

Disable mosaicml logger in foundry CI/CD (#788)

mvpatel2000 committed 2 years ago

Verified 454faa8e

Update .gitignore (#781)

aspfohl committed 2 years ago

Verified 39095163

Patch flash attn in test to simulate environment without it installed (#778)

dakinggg committed 2 years ago

Verified 1ed9d220

Add missing load_weights_only to example yamls (#776)

dakinggg committed 2 years ago

Verified 6ff3f270

fix siqa (#774)

bmosaicml committed 2 years ago

Verified 61cd1100

Shashank/seq id flash attn (#738)

ShashankMosaicML committed 2 years ago

Verified 84b5d96d

Add "completion" alias for response key (#771)

dakinggg committed 2 years ago

Verified b2e4b0e2

Reorganize tests to make them easier to find (#768)

aspfohl committed 2 years ago

Verified 6a058a60

add single value support to activation_checkpointing_target (#772)

cli99 committed 2 years ago

Verified 6ac01ef7

Add codeowners (#770)

dakinggg committed 2 years ago

Verified 32dc3bd8

Better error message when test does not complete (#769)

aspfohl committed 2 years ago

Verified 9cf99b74

Support inputs_embeds (#687)

samhavens committed 2 years ago

Verified 22ae919c

Add eval loader to eval script (#742)

aspfohl committed 2 years ago

Verified 31008599

Older