mosaicml/llm-foundry

Pull Requests Commits

MegaBlocks release (#1102)

mvpatel2000 committed 2 years ago

Verified 53160f40

Updating the streaming version in setup.py (#1103)

ShashankMosaicML committed 2 years ago

Verified 2939cc98

fixing evaluator microbatch size (#1100)

ShashankMosaicML committed 2 years ago

Verified d0d94342

Norms registry (#1080)

dakinggg committed 2 years ago

Verified b81897ac

dakinggg committed 2 years ago

Verified 60a1ab4c

cleaned up HF/MPT conversion test (#1048)

milocress committed 2 years ago

Verified 94301cd1

Allow overrides for nested PretrainedConfig (#1089)

dakinggg committed 2 years ago

Verified 96b27c59

fix yamls typo (#1092)

dakinggg committed 2 years ago

Verified f18768b4

Bump transformers to 4.39.3 (#1086)

dakinggg committed 2 years ago

Verified 607b982d

fix typo in expandable_segments (#1088)

mammothb committed 2 years ago

Verified 06ff95f6

Bump HF version (#1091)

b-chu committed 2 years ago

Verified 26f0619d

log packing ratio progress (#1070)

milocress committed 2 years ago

Verified e70e4241

decrease mlflow hf model shard size (#1087)

dakinggg committed 2 years ago

Verified c766cf95

Update README.md to include DBRX blog under "Latest News" (#1085)

lupesko committed 2 years ago

Verified 5455b404

Background mlflow model registration (#1078)

irenedea committed 2 years ago

Verified 23c31734

Fixes for streaming and auto packing (#1083)

dakinggg committed 2 years ago

Verified d452c60d

Upgrade hf chat (#1061)

j316chuck committed 2 years ago

Verified 394735b1

mvpatel2000 committed 2 years ago

Verified 580a4b00

Doing the loss reduction in foundry instead of in the loss functions. (#1079)

ShashankMosaicML committed 2 years ago

Verified 632cb739

Fix tiktoken vocab size (#1081)

dakinggg committed 2 years ago

Verified caf7fda9

Triton RMSNorm (#1050)

josejg committed 2 years ago

Verified b765b470

Check the user provided eos / bos token id against the tokenizer eos / bos token id (#1039)

ShashankMosaicML committed 2 years ago

Verified d8ea2c56

Add expandeable segments flag (#1075)

dakinggg committed 2 years ago

Verified 349c2ff0

Output eval logging batch (#961)

maxisawesome committed 2 years ago

Verified 7a8a1564

added attributes to construct msg in mapi (#1071)

jjanezhang committed 2 years ago

Verified 28467bba

Update README with DBRX (#1069)

hanlint committed 2 years ago

Verified 8a69bd70

Fix context printing (#1068)

irenedea committed 2 years ago

Verified f044d6cf

filter files (#1067)

dakinggg committed 2 years ago

Verified e42ea707

Bump version to 0.7.0 (#1063)

irenedea committed 2 years ago

Verified 7f0fdae6

Custom Exceptions for Mosaic Logger (#1014)

jjanezhang committed 2 years ago

Verified 0ef7cd6b

Older