transformers
de8a0b75 - Option to set 'non_blocking' for to(device) in BatchEncoding and BatchFeature (#34883)

Commit
1 year ago
Option to set 'non_blocking' for to(device) in BatchEncoding and BatchFeature (#34883) * Option to set 'non_blocking' for to(device) operation for performance improvements. Defaults to 'false', thus no behavioral changes. * Enabling non_blocking in to() operation of BatchFeature. * Improved docstring on utilization of non_blocking * Force non_blocking as keyword argument Co-authored-by: Pavel Iakubovskii <qubvel@gmail.com> --------- Co-authored-by: Daniel Bogdoll <dbogdoll@umich.edu> Co-authored-by: Pavel Iakubovskii <qubvel@gmail.com>
Parents
Loading