mosaicml/llm-foundry

Pull Requests Commits

josejg committed 2 years ago

d068562a

Async eval callback (#702)

aspfohl committed 2 years ago

Verified a7e916b3

Expand options for MMLU. (#811)

Mansheej Paul committed 2 years ago

Verified dc77451f

Fix remote path check for UC volumes (#809)

irenedea committed 2 years ago

Verified ce675222

Clean up the logs, bump datasets and transformers (#804)

dakinggg committed 2 years ago

Verified 06b9a1f3

Make the ffn activation func configurable (#805)

vchiley committed 2 years ago

Verified 15e79f38

Fix openai not conditioned imports (#806)

dakinggg committed 2 years ago

Verified f56f1228

update openai wrapper to work with tiktoken interface and newest openai version (#794)

bmosaicml committed 2 years ago

Verified 5cc4dd4c

Fix token counting to use attention mask instead of ids (#802)

dakinggg committed 2 years ago

Verified 5388dc0d

clean up resolve_ffn_hidden_and_exp_ratio (#801)

vchiley committed 2 years ago

Verified 5fdcc43b

Enable GLU FFN type (#796)

vchiley committed 2 years ago

Verified 0797aa66

Minor readme updates and bump min python version (#799)

dakinggg committed 2 years ago

Verified 1c3c909d

Adding a fix for Cross Entropy Loss for long sequence lengths. (#795)

ShashankMosaicML committed 2 years ago

Verified 96cf646c

Enable flag to not pass PAD tokens in ffwd (#775)

bcui19 committed 2 years ago

Verified 410d5c71

Auto packing fixes (#783)

irenedea committed 2 years ago

Verified 34ec2f73

Remove from mcli.sdk imports (#793)

aspfohl committed 2 years ago

Verified 693ef102

Update gauntlet v0.2 to reflect results of calibration (#791)

bmosaicml committed 2 years ago

Verified 8d96f9d0

Fix utf-8 decode errors in tiktoken wrapper (#792)

dakinggg committed 2 years ago

Verified 75cc1e18

Remove tests and support for torch <2.1 (#787)

dakinggg committed 2 years ago

Verified 2017c028

tiktoken chat formatting (#784)

rajammanabrolu committed 2 years ago

Verified ef60e8ee

Disable mosaicml logger in foundry CI/CD (#788)

mvpatel2000 committed 2 years ago

Verified 454faa8e

Update .gitignore (#781)

aspfohl committed 2 years ago

Verified 39095163

Patch flash attn in test to simulate environment without it installed (#778)

dakinggg committed 2 years ago

Verified 1ed9d220

Add missing load_weights_only to example yamls (#776)

dakinggg committed 2 years ago

Verified 6ff3f270

fix siqa (#774)

bmosaicml committed 2 years ago

Verified 61cd1100

Shashank/seq id flash attn (#738)

ShashankMosaicML committed 2 years ago

Verified 84b5d96d

Add "completion" alias for response key (#771)

dakinggg committed 2 years ago

Verified b2e4b0e2

Reorganize tests to make them easier to find (#768)

aspfohl committed 2 years ago

Verified 6a058a60

add single value support to activation_checkpointing_target (#772)

cli99 committed 2 years ago

Verified 6ac01ef7

Add codeowners (#770)

dakinggg committed 2 years ago

Verified 32dc3bd8

Older