transformers
Support per-layer cache configuration and attention-mask selection
#47901
Merged

Support per-layer cache configuration and attention-mask selection #47901

eladsegal
eladsegal Support heterogeneous cache layouts
bbfbd9bf
eladsegal Add heterogeneous cache compatibility tests
368bcb89
eladsegal revert gpt-oss mxfp4 changes
9f8026ae
eladsegal Merge branch 'main' into cache-heterogeneity-compat
160d2e2c
eladsegal Merge branch 'main' into cache-heterogeneity-compat
3d8e17d7
github-actions
Cyrilvallez Cyrilvallez merged c84ac341 into main 93 days ago
Cyrilvallez

Login to write a write a comment.

Login via GitHub

Reviewers
No reviews
Assignees
No one assigned
Labels
Milestone