PR #46161 Fix tokenizer subfolder fallback

Fix tokenizer subfolder fallback #46161

Prachi-kushwaha wants to merge 9 commits into huggingface:main from Prachi-kushwaha:fix-tokenizer-subfolder-fallback

WIP:fix(deepseek_v4):correct CSA per-query block mask and causal top-…

b63552bf

WIP:fix(deepseek_v4):correct CSA per-query block mask and causal top-…

82d9ba7b

Merge remote-tracking branch 'upstream/main' into csa-per-query-block…

c8e21407

Merge remote-tracking branch 'upstream/main' into csa-per-query-block…

a36e4755

Merge remote-tracking branch 'origin/main' into csa-per-query-block-m…

7d6dec22

Merge branch 'main' of https://github.com/Prachi-kushwaha/transformer…

ba5ace98

Fix tokenizer fallback for custom processor tokenizer attributes

10bccc33

Prachi-kushwaha marked this pull request as draft 13 days ago

test case added

98a809b3

Prachi-kushwaha marked this pull request as ready for review 13 days ago

github-actions requested a review from

Rocketknight1 13 days ago

github-actions requested a review from

ydshieh 13 days ago

Prachi-kushwaha marked this pull request as draft 13 days ago

style checking

e34aa5df

Prachi-kushwaha marked this pull request as ready for review 13 days ago

Reviewers

Rocketknight1

ydshieh

Assignees

No one assigned

Labels

None yet

Milestone

No milestone