transformers.js
Auto device fallback on provider failure and tokenizer_options passthrough in Text2TextGenerationPipeline
#1670
Closed
Closed
Auto device fallback on provider failure and tokenizer_options passthrough in Text2TextGenerationPipeline #1670
Suh0161
wants to merge
5 commits into
huggingface:main
from
Suh0161:feat/cuda-fallback-tokenizer-options
Add start/end offsets to token classification and return_offsets_mapp…
53cb31bb
Fix num_logits_to_keep default and add get_available_devices()
a90fc329
Auto device fallback on provider failure and tokenizer_options passth…
9f498ef1
Refactor #1642 and #1096 fixes with proper separation of concerns
57c4267f
fix(tokenizer): align GPT-2 offset_mapping with ByteLevel space prefix
72d4c787
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Login to write a write a comment.
Login via GitHub