mosaicml/llm-foundry

Pull Requests Commits

Add debugging logs

b-chu committed 2 years ago

4ca5bcb5

Set pretrained model name correctly, if provided, in HF Checkpointer (#1407)

snarayan21 committed 2 years ago

Verified 6f4aa8c9

Remove curriculum learning error when duration less than saved timestamp (#1406)

b-chu committed 2 years ago

Verified 6d5d016b

Add spin_dataloaders flag (#1405)

dakinggg committed 2 years ago

Verified 5c7e99be

Remove orig params false default (#1401)

dakinggg committed 2 years ago

Verified 5e07a05d

Add pip requirements directly for mlflow save (#1400)

dakinggg committed 2 years ago

Verified 799279bc

Add pre register method for mlflow (#1396)

dakinggg committed 2 years ago

Verified 0c93331f

Enable passing epsilon when building norm layers (#1399)

gupta-abhay committed 2 years ago

Verified d8c15521

Update README.md (#1398)

dakinggg committed 2 years ago

Verified 7de4969e

Add a pretrained guard for the initial meta init on global rank 0 (#1397)

irenedea committed 2 years ago

Verified bb385f65

Dtensor oom (#1395)

dakinggg committed 2 years ago

Verified e8826585

ShashankMosaicML committed 2 years ago

Verified cfab70ed

Support rope scaling (#1391)

milocress committed 2 years ago

Verified 70586c40

bump transformers to 4.43.2 (#1393)

dakinggg committed 2 years ago

Verified af37ea04

Revert "Allow for multiple workers when autopacking (#1375)" (#1392)

dakinggg committed 2 years ago

Verified b636e5f4

Refactor loss function for ComposerMPTCausalLM (#1387)

irenedea committed 2 years ago

Verified ced63ee3

Avoid race condition in convert text to mds script (#1390)

dakinggg committed 2 years ago

Verified 7b160fcc

Revert "Use utils to get shared fs safe signal file name (#1381)" (#1389)

dakinggg committed 2 years ago

Verified 221d3e2b

Add convert_delta_to_json to CLI (#1355)

vinchenzo-db committed 2 years ago

Verified 3d7d12e6

bump transformers (#1388)

dakinggg committed 2 years ago

Verified d49e6a27

[kushalkodnad/tokenizer-registry] Introduce new registry for tokenizers (#1386)

kushalkodn-db committed 2 years ago

Verified 51949c4c

Add transformation hooks to hf_causal_lm (#1383)

irenedea committed 2 years ago

Verified cefd6160

Use utils to get shared fs safe signal file name (#1381)

dakinggg committed 2 years ago

Verified d2d29ada

Do dtype conversion in torch hook to save memory (#1384)

irenedea committed 2 years ago

Verified 596dd9dc

fix load and save planner config logic (#1385)

irenedea committed 2 years ago

Verified 0bed4ffb

Allow train.py-like config for eval.py (#1351)

josejg committed 2 years ago

Verified eb41a6e7

Allow for multiple workers when autopacking (#1375)

b-chu committed 2 years ago

Verified d812f20c

update runners (#1360)

KevDevSha committed 2 years ago

Verified a7b4056a

Update accelerate requirement from <0.26,>=0.25 to >=0.32.1,<0.33 (#1341)

dependabot[bot] committed 2 years ago

Verified 48571959

Allow flash attention up to 3 (#1377)

dakinggg committed 2 years ago

Verified d50b0dbf

Older