mosaicml/llm-foundry

Pull Requests Commits

Update test_template_tokenization.py

milocress committed 1 year ago

Verified 2c2d8d39

Add dataset swap callback (#1536)

b-chu committed 1 year ago

Verified ec4cafd4

Reapply #1389 (#1561)

dakinggg committed 1 year ago

Verified 30cdd67f

Simplify CL API (#1510)

b-chu committed 1 year ago

Verified bdc58b3c

Deterministic GCRP Errors (#1559)

KuuCi committed 1 year ago

Verified 0ad6ab47

Add NoOp optimizer (#1560)

snarayan21 committed 1 year ago

Verified 4202a063

Insufficient Permissions Error when trying to access table (#1555)

KuuCi committed 1 year ago

Verified 107d246a

Tensor Parallelism (#1521)

eitanturok committed 1 year ago

Verified ee456002

Use `allenai/c4` instead of `c4` dataset (#1554)

eitanturok committed 1 year ago

Verified 3b1fc4ae

Update mcli yamls (#1552)

dakinggg committed 1 year ago

Verified dc58bb7e

Validate Cluster Access Mode (#1551)

KuuCi committed 1 year ago

Verified e6b8d142

Add proper user error for accessing schema (#1548)

KuuCi committed 1 year ago

Verified c786defb

Bump version to 0.13.0.dev0 (#1549)

dakinggg committed 1 year ago

Verified 722526d4

Bump streaming version to 0.9.0 (#1550)

dakinggg committed 1 year ago

Verified 151a2e29

Bump composer version to 0.25.0 (#1546)

dakinggg committed 1 year ago

Verified 275a2a40

Hfcheckpointer optional generation config (#1543)

KuuCi committed 1 year ago

Verified d85c83b1

Register mosaic logger (#1542)

dakinggg committed 1 year ago

Verified f377090d

Bumping flash attention version to 2.6.3 and adding option for softcap in attention and lm_head logits. (#1374)

ShashankMosaicML committed 1 year ago

Verified 85403c08

Make ICL tasks not required for eval (#1540)

snarayan21 committed 1 year ago

Verified a2c05077

Error on text dataset file not found (#1534)

milocress committed 1 year ago

Verified 14cff668

Fix reuse kv cache for torch attention (#1539)

ShashankMosaicML committed 1 year ago

Verified d7c78229

Add deprecation warning to fsdp_config (#1530)

KuuCi committed 1 year ago

Verified 2e3d14f6

Delete unneeded inner base model in PEFT HF Checkpointer (#1532)

snarayan21 committed 1 year ago

Verified 7a23f60a

Revert "Replace FSDP args" (#1533)

KuuCi committed 1 year ago

Verified 9a1b78b1

enable correct padding_idx for embedding layers (#1527)

gupta-abhay committed 1 year ago

Verified 0114f33d

Replace FSDP args (#1517)

KuuCi committed 1 year ago

Verified 83ab9c30

Add HuggingFaceCheckpointer option for only registering final checkpoint (#1516)

irenedea committed 1 year ago

Verified a862d6e4

Add permissions check for delta table reading (#1522)

irenedea committed 1 year ago

Verified dab768f7

Raise DatasetTooSmall exception if canonical nodes is less than num samples (#1518)

irenedea committed 1 year ago

Verified 5465db4f

Peft fsdp (#1520)

dakinggg committed 1 year ago

Verified 6d932602

Older