transformers
40292aa4 - bugfix: torch.export failure caused by `_make_causal_mask` (#35291)

Commit
1 year ago
bugfix: torch.export failure caused by `_make_causal_mask` (#35291) * bugfix: torch.export failure caused by `_make_causal_mask` Recent changes in torch dynamo prevent mutations on tensors converted with aten::_to_copy. To address this, we can clone such tensor before performing in-place operation `masked_fill_` only when the code is being compiled by torch dynamo. (relevant issue: https://github.com/pytorch/pytorch/issues/127571) * chore: use `is_torchdynamo_compiling` instead of `torch._dynamo.is_compiling`
Author
Jiwoong
Parents
Loading