transformers
feat: add cache retention for requests
#38446
Merged

feat: add cache retention for requests #38446

McPatate
McPatate feat: add cache retention for requests
4d2d26f2
McPatate McPatate requested a review from LysandreJik LysandreJik 1 year ago
McPatate McPatate requested a review from ArthurZucker ArthurZucker 1 year ago
HuggingFaceDocBuilderDev
McPatate fix: propagate `manual_eviction` param & refactor `finish_request`
77f38f72
ArthurZucker
ArthurZucker approved these changes on 2025-05-28
McPatate refactor: pop req from `active_requests`
0eb95de0
ArthurZucker
ArthurZucker
github-actions[bot] Apply style fixes
bca65a99
github-actions
ArthurZucker ArthurZucker enabled auto-merge (squash) 1 year ago
McPatate Merge branch 'main' into feat/implement_cache_retention_between_reqs
3f7d0630
ArthurZucker ArthurZucker merged 8010f3cf into main 1 year ago
ArthurZucker ArthurZucker deleted the feat/implement_cache_retention_between_reqs branch 1 year ago

Login to write a write a comment.

Login via GitHub

Assignees
No one assigned
Labels
Milestone