mosaicml/llm-foundry

Pull Requests Commits

removed extraneous changes

snarayan21 committed 1 year ago

9e9d0f2f

simpler implementation

snarayan21 committed 1 year ago

658ea7e4

don't do anything for plain ol linears

snarayan21 committed 1 year ago

d2393aa5

modified param inits to follow kaiming exactly

snarayan21 committed 1 year ago

955ae6cd

snarayan21 committed 1 year ago

c743fbc9

snarayan21 committed 1 year ago

e1a22d7b

snarayan21 committed 1 year ago

617d099f

snarayan21 committed 1 year ago

cc1913fe

snarayan21 committed 1 year ago

0da72895

modified param init fns

snarayan21 committed 1 year ago

cdf85ca7

modified param init fns

snarayan21 committed 1 year ago

0085285a

Update TUTORIAL.md (#957)

sdonoso committed 1 year ago

Verified fe17c224

allow te to use meta device with deferred init (#958)

cli99 committed 1 year ago

Verified 8c7d6f43

Add default signature to mlflow saved model (#952)

dakinggg committed 1 year ago

Verified 60ab97fb

Add finetuning streaming dataset conversion (#933)

bigning committed 1 year ago

Verified 105f7663

Fix chain-of-thought tasks (#824)

bmosaicml committed 1 year ago

Verified 6591f480

Bump llm-foundry version to 0.5.0 (#948)

irenedea committed 1 year ago

Verified a667ebf5

Add and use VersionedDeprecationWarning (#944)

irenedea committed 1 year ago

Verified c1c4bbfb

Retrieve license information when local files are provided for a pretrained model (#943)

jerrychen109 committed 1 year ago

Verified 2e0a8458

mvpatel2000 committed 1 year ago

Verified 3f21bb7e

Update lora docs (#941)

dakinggg committed 1 year ago

Verified 25599294

Fixing the gen_attention_mask_in_length function to handle the case when sequence id is -1 due to attention masking (#940)

ShashankMosaicML committed 1 year ago

Verified ad126a62

Remove extra call to .to and load_state_dict in hf checkpointer (#939)

dakinggg committed 1 year ago

Verified b9d2bfaf

Refactoring the function to accept list of metric names instead of a dictionary of metrics. (#938)

ShashankMosaicML committed 1 year ago

Verified 706ea7dd

Switch to the Composer integration of LoRA (works with FSDP) (#886)

dakinggg committed 1 year ago

Verified 15ee0acc

Update eval_gauntlet_callback.py with math.log2 (#821)

Skylion007 committed 1 year ago

Verified d9874d2a

dakinggg committed 1 year ago

Verified 86b5a981

Throw error when no EOS (#922)

KuuCi committed 1 year ago

Verified 4b82876d

Remove .ci folder and move FILE_HEADER (#931)

irenedea committed 1 year ago

Verified 203edad0

Changes to setup.py invalidate docker cache. Use branch name in dockerfile (#930)

irenedea committed 1 year ago

Verified 7a81f194

Older