vllm
Serialize using safetensors for KV caches
#14228
Merged

Serialize using safetensors for KV caches #14228

KuntaiDu
KuntaiDu serialize using safetensors instead of pickle for better security
9cb088f3
github-actions
KuntaiDu KuntaiDu requested a review from simon-mo simon-mo 1 year ago
KuntaiDu fix precommit hook
81baf01f
simon-mo
simon-mo approved these changes on 2025-03-04
simon-mo simon-mo enabled auto-merge (squash) 1 year ago
github-actions github-actions added ready
KuntaiDu KuntaiDu changed the title [Security] Serialize using safetensors instead of pickle in Mooncake Pipe Serialize using safetensors 1 year ago
KuntaiDu KuntaiDu changed the title Serialize using safetensors Serialize using safetensors for KV caches 1 year ago
simon-mo simon-mo merged 288ca110 into main 1 year ago
KuntaiDu KuntaiDu deleted the kuntai-fix-mooncake-security-concern branch 1 year ago
ShangmingCai

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone