[Misc] Make cached tokenizer pickle-compatible #17048
[Misc] Make cached tokenizer pickle-compatible
2614d63b
Use a list
aa383968
Update type annotations
b8f75984
Fix chatglm tokenizer
1b5393cd
Rename
1fcebb1a
Merge branch 'main' into pickle-cached-tokenizer
84769d21
Update attribute access
fbd688b6
Merge branch 'main' into pickle-cached-tokenizer
385b4f4c
njhill
commented
on 2025-04-25
Simplify the code
8e0c95d6
Rename
9aeeabcb
Update
3d2007c9
njhill
commented
on 2025-04-26
Use copy instead of deepcopy
1239e1c9
Remove unnecessary parenthesis
af6b11e9
njhill
approved these changes
on 2025-04-27
DarkLight1337
deleted the pickle-cached-tokenizer branch 238 days ago
Assignees
No one assigned
Login to write a write a comment.
Login via GitHub