mosaicml/llm-foundry

Pull Requests Commits

using base branch

rithwik-db committed 161 days ago

49e7a91e

need to include this as well

rithwik-db committed 161 days ago

0b48c451

testing out with profiling

rithwik-db committed 161 days ago

6add6a14

removing flash attn dependency

rithwik-db committed 161 days ago

d9f2113a

updated setup.py

rithwik-db committed 161 days ago

c648b248

updated composer and streaming versions (#1857)

ethantang-db committed 165 days ago

Verified 8c8dd48f

Update mosaicml[databricks] requirement from <0.32,>=0.31.0 to >=0.31.0,<0.33 (#1858)

dependabot[bot] committed 166 days ago

Verified 316a63b1

Bump coverage[toml] from 7.9.1 to 7.9.2 (#1853)

dependabot[bot] committed 178 days ago

Verified 6048d982

Update accelerate requirement from <1.8,>=0.25 to >=0.25,<1.9 (#1852)

dependabot[bot] committed 186 days ago

Verified b3d3fcdc

Update mlflow requirement from <2.22,>=2.14.1 to >=2.14.1,<3.2 (#1846)

dependabot[bot] committed 190 days ago

Verified e3251cf1

Bump coverage[toml] from 7.8.2 to 7.9.1 (#1845)

dependabot[bot] committed 193 days ago

Verified 6acf8b1f

Bump hf-transfer from 0.1.8 to 0.1.9 (#1849)

dependabot[bot] committed 193 days ago

Verified 2f1c9339

Update huggingface-hub[hf_xet] requirement from <0.33,>=0.30.0 to >=0.30.0,<0.34 (#1844)

dependabot[bot] committed 193 days ago

Verified 2f8aa7d3

Display data type in error message (#1834)

emmanuel-ferdman committed 193 days ago

Verified 963e95a9

Support for reusing the input to W_k and W_v (#1710)

ShashankMosaicML committed 200 days ago

Verified dd89aba7

Add Head Dim as a configurable parameter for Attention and Rope (#1842)

jdchang1 committed 205 days ago

Verified 875940be

Fix backwards compatibility with attention_bias (#1840)

dakinggg committed 213 days ago

Verified 6c0d8649

Bias in QKV input projections for supporting Qwen2 model series (#1837)

gupta-abhay committed 213 days ago

Verified 93d04542

Change test to use foundry images (#1839)

bowenyang008 committed 217 days ago

Verified 102735c8

bump huggingface-hub upper bound to 0.33 (#1838)

bowenyang008 committed 217 days ago

Verified f7d2542a

Bump torch version to 2.7 (#1832)

bowenyang008 committed 217 days ago

Verified eeb7a79f

Fix monolithic checkpointing against composer main (#1836)

dakinggg committed 218 days ago

Verified a51c96cb

Bump Composer 0.31.0 (#1835)

bowenyang008 committed 219 days ago

Verified 429eb847

Configurable shard size (#1833)

dakinggg committed 219 days ago

Verified 9cf23209

Bump coverage[toml] from 7.8.0 to 7.8.2 (#1830)

dependabot[bot] committed 220 days ago

Verified 83b47adb

Update ci-testing version to latest (#1827)

dakinggg committed 227 days ago

Verified 358b23aa

Delete useless print("here") (#1826)

tsebaka committed 227 days ago

Verified 6b6ec053

Bump docformatter for python3.12 and change blank_line_before_module_docstring = false (#1825)

sashaDoubov committed 228 days ago

Verified f0018598

Bump onnx from 1.17.0 to 1.18.0 (#1823)

dependabot[bot] committed 228 days ago

Verified 8aad84d5

Update accelerate requirement from <1.7,>=0.25 to >=0.25,<1.8 (#1824)

dependabot[bot] committed 228 days ago

Verified f83434f6

Older