mosaicml/llm-foundry

Pull Requests Commits

Enable cross attention layers (#1495)

gupta-abhay committed 1 year ago

Verified d0dc82d2

Fix formatting of loss spike & high loss error messages (#1498)

joyce-chen-uni committed 1 year ago

Verified 07bec5a7

Removing error message for reusing kv cache with torch attn (#1497)

ShashankMosaicML committed 1 year ago

Verified 6d9d79bc

tokenizer is never built when converting finetuning dataset (#1496)

eldarkurtic committed 1 year ago

Verified 100f40f4

Align logged attributes for errors and run metadata in kill_loss_spike_callback.py (#1494)

joyce-chen-uni committed 1 year ago

Verified 85161819

Enable passing in external position ids (#1493)

gupta-abhay committed 1 year ago

Verified bf6cfdf8

Track loss spikes and high losses during training (#1473)

joyce-chen-uni committed 1 year ago

Verified 0db44252

master_weights_dtype not supported by ComposerHFCausalLM.__init__() (#1485)

eldarkurtic committed 1 year ago

Verified 51e92c49

Bump composer to 0.24.1 + FSDP config device_mesh deprecation (#1487)

snarayan21 committed 1 year ago

Verified 249db937

Fix device mismatch when running hf.generate (#1486)

ShashankMosaicML committed 1 year ago

Verified 2978c60b

fix hf checkpointer (#1489)

milocress committed 1 year ago

Verified abdf7cf9

Bump hf-transfer from 0.1.3 to 0.1.8 (#1480)

dependabot[bot] committed 1 year ago

Verified cef39d19

Use Streaming version 0.8.1 (#1479)

snarayan21 committed 1 year ago

Verified 273c2c01

Make sample tokenization extensible (#1478)

gupta-abhay committed 1 year ago

Verified 65936cfb

Add date_string when applying tokenizer chat template (#1474)

snarayan21 committed 1 year ago

Verified e235f420

Add prepare fsdp back (#1477)

dakinggg committed 1 year ago

Verified e84d97e5

Remove extra bos for prompt/response data with llama3.1 (#1476)

dakinggg committed 1 year ago

Verified 01418f8b

Parent class hf models (#1467)

jdchang1 committed 1 year ago

Verified c56401f8

Add train subset num batches (#1472)

mvpatel2000 committed 1 year ago

Verified 3648cef1

Register NaN Monitor Callback (#1471)

josejg committed 1 year ago

Verified b32e48c8

Consistent Naming EnviromentLoggingCallback (#1470)

josejg committed 1 year ago

Verified da62c28d

use default eval interval from composer (#1369)

milocress committed 1 year ago

Verified 6dd04a0d

Simple change to enable mapping functions for ft constructor (#1468)

gupta-abhay committed 1 year ago

Verified d3a9ac9b

Update tenacity requirement from <9,>=8.2.3 to >=8.2.3,<10 (#1460)

dependabot[bot] committed 1 year ago

Verified bc66a8b2

Bump onnxruntime from 1.18.1 to 1.19.0 (#1461)

dependabot[bot] committed 1 year ago

Verified 04080906

Update CI tests to v0.1.2 (#1466)

KuuCi committed 1 year ago

Verified c3a96375

Correct error message for inference wrapper (#1459)

josejg committed 1 year ago

Verified b81af3ae

Update mosaicml/ci-testing to 0.1.2 (#1458)

irenedea committed 1 year ago

Verified d413e014

Add EnvironmentLogger Callback (#1350)

josejg committed 1 year ago

Verified d014d752

Fix log_config (#1432)

josejg committed 1 year ago

Verified d5ed9e7f

Newer Older