PR #1068 diskcache for caching

diskcache for caching #1068

f14-bertolotti wants to merge 8 commits into huggingface:main from francesco-bertolotti:f14-diskcache

graceful shutdown of vllm async

7acea0d6

f14-bertolotti changed the title ~~graceful shutdown of vllm async~~ diskcache for caching 27 days ago

clefourrier commented on 2025-11-20

Merge branch 'main' into f14-diskcache

6c1bc6c9

NathanHB approved these changes on 2025-11-20

added model_dump() to EnhancedJSONEncoder

c3125a0f

using EnhancedJSONEncoder instead of custom encoder

ef980821

reverted progress bar in async vllm

e73adee3

forgot removing two lines

a42babfa

clefourrier commented on 2025-11-20

reverted list checking with as_list

8639936c

NathanHB added breaking

NathanHB added enhancement

typ annotation fix

012158ea

Reviewers

NathanHB

clefourrier

Assignees

No one assigned

Labels

breaking enhancement

Milestone

No milestone