mosaicml/llm-foundry

Pull Requests Commits

mattyding committed 1 year ago

7589b59e

Fix backwards compatibility with attention_bias (#1840)

dakinggg committed 1 year ago

Verified 6c0d8649

Bias in QKV input projections for supporting Qwen2 model series (#1837)

gupta-abhay committed 1 year ago

Verified 93d04542

Change test to use foundry images (#1839)

bowenyang008 committed 1 year ago

Verified 102735c8

bump huggingface-hub upper bound to 0.33 (#1838)

bowenyang008 committed 1 year ago

Verified f7d2542a

Bump torch version to 2.7 (#1832)

bowenyang008 committed 1 year ago

Verified eeb7a79f

Fix monolithic checkpointing against composer main (#1836)

dakinggg committed 1 year ago

Verified a51c96cb

Bump Composer 0.31.0 (#1835)

bowenyang008 committed 1 year ago

Verified 429eb847

Configurable shard size (#1833)

dakinggg committed 1 year ago

Verified 9cf23209

Bump coverage[toml] from 7.8.0 to 7.8.2 (#1830)

dependabot[bot] committed 1 year ago

Verified 83b47adb

Update ci-testing version to latest (#1827)

dakinggg committed 1 year ago

Verified 358b23aa

Delete useless print("here") (#1826)

Omar Zoloev committed 1 year ago

Verified 6b6ec053

Bump docformatter for python3.12 and change blank_line_before_module_docstring = false (#1825)

sashaDoubov committed 1 year ago

Verified f0018598

Bump onnx from 1.17.0 to 1.18.0 (#1823)

dependabot[bot] committed 1 year ago

Verified 8aad84d5

Update accelerate requirement from <1.7,>=0.25 to >=0.25,<1.8 (#1824)

dependabot[bot] committed 1 year ago

Verified f83434f6

Fix Dtensor initialization (#1820)

bowenyang008 committed 1 year ago

Verified d39debbe

Deprecate inference API wrappers (#1821)

dakinggg committed 1 year ago

Verified 8c865f4d

Update huggingface-hub[hf_xet] requirement from <0.31,>=0.30.0 to >=0.30.0,<0.32 (#1818)

dependabot[bot] committed 1 year ago

Verified dedcfe3b

Bump onnxruntime from 1.19.2 to 1.22.0 (#1819)

dependabot[bot] committed 1 year ago

Verified 31527818

Update datasets requirement from <3.6,>=3.3.2 to >=3.3.2,<3.7 (#1817)

dependabot[bot] committed 1 year ago

Verified 96427baf

Change RMSNorm to use PyTorch native implementation (#1809)

josejg committed 1 year ago

Verified 7993aebe

Allow subselecting the appropriate config for llama4 (#1815)

dakinggg committed 1 year ago

Verified 5c47350d

Upgrade yapf version (#1814)

dakinggg committed 1 year ago

Verified 502bf051

Update foundry version in MCLI yamls (#1813)

dakinggg committed 1 year ago

Verified ea773086

Adding temperature tuning in attention (#1793)

ShashankMosaicML committed 1 year ago

Verified 67875360

Bump foundry version to 0.21.0.dev0 (#1812)

dakinggg committed 1 year ago

Verified faa7f913

Adding support for nope positional encoding in block overrides. (#1794)

ShashankMosaicML committed 1 year ago

Verified 1a8776cf

Remove some old deprecated code/comments (#1811)

dakinggg committed 1 year ago

Verified 86741ead

Update grouped-gemm version (#1810)

dakinggg committed 1 year ago

Verified f91d8f69

Update datasets requirement from <3.4,>=3.3.2 to >=3.3.2,<3.6 (#1807)

dependabot[bot] committed 1 year ago

Verified 77f89674

Older