Keep AFMoE expert biases in FP32 on BF16 load #50687
Preserve AFMoE normalization weights and expert biases on BF16 load
7fa1fdd3
Keep only AFMoE expert biases in FP32 on BF16 load
aac42e1a
annekethvij
changed the title Preserve AFMoE normalization weights and expert biases on BF16 load Keep AFMoE expert biases in FP32 on BF16 load 5 days ago
Assignees
No one assigned
Login to write a write a comment.
Login via GitHub