transformers
[core] Refactor the Cache logic to make it simpler and more general
#39797
Merged
Overview
Commits
51
Changes
View On GitHub

[core] Refactor the Cache logic to make it simpler and more general #39797

Cyrilvallez merged 51 commits into main from explicit-cache
Cyrilvallez
HuggingFaceDocBuilderDev
Cyrilvallez Cyrilvallez force pushed from 50825518 to 59a32960 283 days ago
Cyrilvallez Cyrilvallez changed the title Simplify/make more explicit the caching logic Rework the Cache logic to make it simpler and more general 282 days ago
Cyrilvallez Cyrilvallez force pushed from f09bd1a5 to 71124e6c 282 days ago
Cyrilvallez Cyrilvallez changed the title Rework the Cache logic to make it simpler and more general Refactor the Cache logic to make it simpler and more general 282 days ago
Cyrilvallez
gante
Cyrilvallez
Cyrilvallez Cyrilvallez changed the title Refactor the Cache logic to make it simpler and more general [core] Refactor the Cache logic to make it simpler and more general 277 days ago
gante
Cyrilvallez Cyrilvallez force pushed from 7617e35b to f4f7361b 276 days ago
ArthurZucker
ArthurZucker approved these changes on 2025-08-08
ArthurZucker
github-actions
Cyrilvallez Simplify the logic quite a bit
100ae2cc
Cyrilvallez Update cache_utils.py
19ecbd85
Cyrilvallez continue work
7b3d65c1
Cyrilvallez continue simplifying a lot
f385ac7e
Cyrilvallez style
d54e3380
Cyrilvallez Update cache_utils.py
2a7aac78
Cyrilvallez offloading much simpler
ec96c772
Cyrilvallez style
2081941d
Cyrilvallez Update cache_utils.py
25922405
Cyrilvallez update inits
37bd5555
Cyrilvallez Update cache_utils.py
c0c964fd
Cyrilvallez consistemncy
9fd8803f
Cyrilvallez Update cache_utils.py
2518e75f
Cyrilvallez update generate
17ca71e3
Cyrilvallez style
8dade3da
Cyrilvallez fix
a404dbaa
Cyrilvallez fix
74ab8c89
Cyrilvallez add early_initialization
78ffd4c5
Cyrilvallez fix
19fef9dc
Cyrilvallez fix mamba caches
c0ce4468
Cyrilvallez update
b0515263
Cyrilvallez fix
3dc25380
Cyrilvallez fix
ccda84d3
Cyrilvallez fix
8ee7cc9f
Cyrilvallez fix tests
11a8f978
Cyrilvallez fix configs
b41a4b93
Cyrilvallez revert
b57cedf2
Cyrilvallez fix tests
709e51fb
Cyrilvallez alright
11e22b6f
Cyrilvallez Update modeling_gptj.py
f8907694
Cyrilvallez fix the constructors
4f9581a5
Cyrilvallez cache tests
9c4ce686
Cyrilvallez Update test_cache_utils.py
d990e80e
Cyrilvallez fix
0c1f41af
Cyrilvallez simplify
36d2470e
Cyrilvallez back to before -> avoid compile bug
241d48af
Cyrilvallez doc
03b84017
Cyrilvallez mistral test
2d007c1b
Cyrilvallez llama4 test dtype
71ada771
Cyrilvallez Update test_modeling_llama4.py
23054e2c
Cyrilvallez CIs
e8ceb9d8
Cyrilvallez Finally find a nice impl
d0763b82
Cyrilvallez Update cache_utils.py
06fd9e4c
Cyrilvallez Update cache_utils.py
b6eeae25
Cyrilvallez add lazy methods in autodoc
ca32e1ff
Cyrilvallez typo
a173a649
Cyrilvallez better doc
1f7dd276
Cyrilvallez Add detailed docstring for lazy init
203ab695
Cyrilvallez CIs
48e78d0b
Cyrilvallez style
236bf9d1
Cyrilvallez Cyrilvallez force pushed from 197f3300 to 236bf9d1 275 days ago
Cyrilvallez fix
0630cd29
github-actions
Cyrilvallez
Cyrilvallez Cyrilvallez merged dc11a3cb into main 275 days ago
Cyrilvallez Cyrilvallez deleted the explicit-cache branch 275 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum