transformers

49aff18f - Actually i think the attention casting only makes sense when we use torch.float16