mosaicml/llm-foundry

Pull Requests Commits

v-chen_data committed 1 year ago

99ff6b30

v-chen_data committed 1 year ago

0a694b1a

Merge branch 'main' into hfcheckpointer-optional-generation-config

KuuCi committed 1 year ago

Verified 8f3c6592

daniel comments

v-chen_data committed 1 year ago

ef0bedb5

v-chen_data committed 1 year ago

e43b8a87

v-chen_data committed 1 year ago

e36ba4cc

v-chen_data committed 1 year ago

ff2cf337

v-chen_data committed 1 year ago

6b956179

Register mosaic logger (#1542)

dakinggg committed 1 year ago

Verified f377090d

v-chen_data committed 1 year ago

7530b513

v-chen_data committed 1 year ago

86f6ad0b

add small check

v-chen_data committed 1 year ago

9b9aa6bf

Bumping flash attention version to 2.6.3 and adding option for softcap in attention and lm_head logits. (#1374)

ShashankMosaicML committed 1 year ago

Verified 85403c08

Make ICL tasks not required for eval (#1540)

snarayan21 committed 1 year ago

Verified a2c05077

Error on text dataset file not found (#1534)

milocress committed 1 year ago

Verified 14cff668

Fix reuse kv cache for torch attention (#1539)

ShashankMosaicML committed 1 year ago

Verified d7c78229

Add deprecation warning to fsdp_config (#1530)

KuuCi committed 1 year ago

Verified 2e3d14f6

Delete unneeded inner base model in PEFT HF Checkpointer (#1532)

snarayan21 committed 1 year ago

Verified 7a23f60a

Revert "Replace FSDP args" (#1533)

KuuCi committed 1 year ago

Verified 9a1b78b1

enable correct padding_idx for embedding layers (#1527)

gupta-abhay committed 1 year ago

Verified 0114f33d

Replace FSDP args (#1517)

KuuCi committed 1 year ago

Verified 83ab9c30

Add HuggingFaceCheckpointer option for only registering final checkpoint (#1516)

irenedea committed 1 year ago

Verified a862d6e4

Add permissions check for delta table reading (#1522)

irenedea committed 1 year ago

Verified dab768f7

Raise DatasetTooSmall exception if canonical nodes is less than num samples (#1518)

irenedea committed 1 year ago

Verified 5465db4f

Peft fsdp (#1520)

dakinggg committed 1 year ago

Verified 6d932602

Raise MisconfiguredDatasetError from original error (#1519)

irenedea committed 1 year ago

Verified 6849eaa2

Sort callbacks so that CheckpointSaver goes before HuggingFaceCheckpointer (#1515)

irenedea committed 1 year ago

Verified 8a8de18d

Put 2.3 image back in release examples (#1513)

dakinggg committed 1 year ago

Verified e8eca4fa

Fix cross attention for blocks (#1512)

gupta-abhay committed 1 year ago

Verified 1adff747

Allow passing key_value_statest for x-attn through MPT Block (#1511)

gupta-abhay committed 1 year ago

Verified 4ab483f6

Older