transformers
c17877c2 - Fix `maybe_autocast` crashing on meta device tensors (#44984)

Commit
27 days ago
Fix `maybe_autocast` crashing on meta device tensors (#44984) `torch.is_autocast_enabled("meta")` raises a RuntimeError because torch does not support autocast for the meta device. This breaks any code that runs a forward pass on meta tensors (e.g. nnsight's `.scan()` for tracing without materializing weights). Since autocast is meaningless on meta tensors, return `nullcontext()` early when `device_type == "meta"`. Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
Author
Parents
Loading