non standard moe support (#273)

Commit

4 years ago

non standard moe support (#273) Co-authored-by: Jeff Rasley <jerasley@microsoft.com>