llm-foundry

b4146269 - Added torch_dmoe defaults, bug fixes for 2D inputs (#1210)

Added torch_dmoe defaults, bug fixes for 2D inputs (#1210) * defaults for torch dmoe match mb dmoe * defaults for torch dmoe match mb dmoe * defaults for torch dmoe match mb dmoe * defaults for torch dmoe match mb dmoe * defaults for torch dmoe match mb dmoe * defaults for torch dmoe match mb dmoe * defaults for torch dmoe match mb dmoe * top k proper * permute fix * permute fix * permute fix * permute fix * permute fix * narrow down world size bug * narrow down world size bug * narrow down world size bug * narrow down world size bug * narrow down world size bug * narrow down world size bug * narrow down world size bug * narrow down world size bug * narrow down world size bug * narrow down world size bug * narrow down world size bug * narrow down world size bug * narrow down world size bug * narrow down world size bug * blocking dimension bug * done * yo * yo