llm-foundry

cbcc6fac - Update config_moe_args.py

Update config_moe_args.py https://databricks.atlassian.net/browse/GRT-2812 see [here](https://github.com/mosaicml/llm-foundry-private/pull/245#issuecomment-2046306845) Ran 500 steps, new version did marginally better