llama.cpp
metal : add residency sets keep-alive heartbeat
#17766
Merged

metal : add residency sets keep-alive heartbeat #17766

ggerganov merged 6 commits into master from gg/idle-new
ggerganov
ggerganov examples : add idle
84c2a6d0
ggerganov metal : attach residency sets to queue
a103ca1e
ggerganov idle : add link
5074a214
ggerganov
github-actions github-actions added examples
github-actions github-actions added ggml
github-actions github-actions added Apple Metal
ggerganov idle : adjust intervals
5f52ca56
ggerganov metal : add residency sets keep-alive heartbeat
b2d7fa66
ggerganov ggerganov changed the title metal : attach residency sets to queue metal : add residency sets keep-alive heartbeat 26 days ago
ggerganov cont : adjust default keep-alive time
df4f195b
ggerganov ggerganov merged c41bde6f into master 25 days ago
ggerganov ggerganov deleted the gg/idle-new branch 25 days ago
CISC

Login to write a write a comment.

Login via GitHub

Reviewers
No reviews
Assignees
No one assigned
Labels
Milestone