DeepSpeed

if no expert found in parameter that have expert in name the loop should continue

#7685

Open