PR #37401 Offloaded hybrid cache for Llama4

Offloaded hybrid cache for Llama4 #37401

ArthurZucker merged 5 commits into main from offloaded-hybrid

first try (maybe race condition)

df402374

Update cache_utils.py

ee6674cd

cannot avoid the race condition -> use 2 layers

0a0b495e

Update cache_utils.py

72d63d5e

Update cache_utils.py

f78c5fba

github-actions marked this pull request as draft 1 year ago

Cyrilvallez marked this pull request as ready for review 1 year ago

github-actions requested a review from

ArthurZucker 1 year ago

github-actions requested a review from

Rocketknight1 1 year ago

ArthurZucker approved these changes on 2025-04-10

ArthurZucker merged fbb2054e into main 1 year ago

ArthurZucker deleted the offloaded-hybrid branch 1 year ago

Reviewers

ArthurZucker

Rocketknight1

Assignees

No one assigned

Labels

None yet

Milestone

No milestone