transformers
be42c24d - Honor trust_remote_code for custom tokenizers (#28854)

Commit
1 year ago
Honor trust_remote_code for custom tokenizers (#28854) * pass through trust_remote_code for dynamically loading unregistered tokenizers specified by config add test * change directories back to previous directory after test * fix ruff check * Add a note to that block for future in case we want to remove it later --------- Co-authored-by: Matt <rocketknight1@gmail.com>
Author
Parents
Loading