log details to metadata for run analytics #992
angel-ruiz7
merged
67 commits into
main
from
angel/log-data-for-run-analytics
add `uses_llmfoundry`, `model_name`, and `llmfoundry_run_type`
c0ac7670
Merge branch 'main' into angel/log-data-for-run-analytics
fccabd91
remove `uses_llmfoundry` flag, prefix with `mosaicml/llmfoundry/`, an…
fe8948b4
Merge branch 'angel/log-data-for-run-analytics' of github.com:mosaicm…
faede2cb
get `model_name` from `pretrained_model_name_or_path`
1e28dec7
Merge branch 'main' of github.com:mosaicml/llm-foundry into angel/log…
a935c421
fix quotes
e8bab059
add TODO comments and remove redundant flushing from `eval.py`
f49d6b39
get `llmfoundry_run_subtype` for training runs
f726fe2d
check for `mosaicml_logger` before logging
40e3b83f
fix `reportUnboundVariable` linting error
599807ca
add `tokenizer` and train/eval loader names
a46cc8b0
use brackets to get `name` from `model_config`
ed2deade
add cloud provider from load / save paths
4165d59a
add `num_workers` for `eval_loader` and `train_loader`
598ccb12
Merge branch 'main' into angel/log-data-for-run-analytics
7cb9e0ff
try to fix key error
43be3143
Revert "try to fix key error"
09dcd561
add `d_model`, `callbacks`, and `vocab_size`
7aa5f34f
format, add `n_heads`
8afa7ad1
Merge branch 'main' into angel/log-data-for-run-analytics
e296693e
format + support `ListConfig` and `DictConfig` for `eval_loader_config`
336d697e
fix access issues with `loader_config`
850e587f
use `get()` instead of brackets
d098c6c0
use `get` instead of brackets
dcaf7a73
Merge branch 'main' into angel/log-data-for-run-analytics
5e5fde14
format code
dc074de9
Merge branch 'angel/log-data-for-run-analytics' of github.com:mosaicm…
c123571b
add `gauntlet_configured` and `icl_configured` fields
347ff19e
make sure to not pass in `mosaicml_logger` when `None`
2d66f5a9
run formatter
12e9d399
Merge branch 'main' into angel/log-data-for-run-analytics
76fe4486
make small tweaks to naming + access values more carefully
65bfb661
Merge branch 'angel/log-data-for-run-analytics' of github.com:mosaicm…
c1c39ab4
run formatter
71383d18
add `False` values to `gauntlet_configured` and `icl_configured`
81af3d66
for `eval.py` log metrics inside of `main`
cebe1ccc
remove `tokenizer_name` from eval logs
1f026a97
fix typing of `metrics` Dictionaries
9edb0cbc
add a helper function to parse `cloud_provider_data` and `cloud_provi…
2d204057
Merge branch 'main' into angel/log-data-for-run-analytics
ad46b319
remove `mosaicml_logger = None`
d8e288bf
remove comment
87a515c1
Merge branch 'angel/log-data-for-run-analytics' of github.com:mosaicm…
482a9495
move helpers into `mosaicmllogger_utils.py`
a95b2fd3
irenedea
commented
on 2024-03-12
give a description that makes `pydocstyle` happy
265d5085
log `cloud_provider_data` and `cloud_provider_checkpoints` from compo…
6aecab84
run formatters
ca0df5ef
Merge branch 'main' into angel/log-data-for-run-analytics
84720dca
Merge branch 'main' into angel/log-data-for-run-analytics
50b284c2
remove TODOs
7f57a8ad
Merge branch 'angel/log-data-for-run-analytics' of github.com:mosaicm…
31d3b79a
irenedea
commented
on 2024-03-15
fix import
564fc41f
Revert "fix import"
ccfb4fab
combine both import methodss for `mosiacmllogger_utils`
3e5f9a4d
only import from utils
5806493c
format files
b5ed2f34
build loggers outside of `evaluate_model`
07abaa76
irenedea
approved these changes
on 2024-03-22
merge and resolve conflicts
309f6837
run formatter on `__init__`
02522830
create `MosaicMLLogger` if it doesn't exist in `eval.py`
a59fdc9d
Merge branch 'main' into angel/log-data-for-run-analytics
830683ea
docstring fixes
54b78a92
Merge branch 'angel/log-data-for-run-analytics' of github.com:mosaicm…
be2294ae
oops `loggers` is definitely supposed to be a `List`
78925c49
don't add `mosaicml_logger` if it's `None`
dd792ccc
do the same thing for `train.py`
e6b43a8f
Login to write a write a comment.
Login via GitHub