llama.cpp
server: add -pp parameter to force enable/disable pipeline parallelism
#24204
Closed
Overview
Commits
2
Changes
View On GitHub

server: add -pp parameter to force enable/disable pipeline parallelism #24204

dark-penguin wants to merge 2 commits into ggml-org:master from dark-penguin:pr-disable-pipeline-parallelism
dark-penguin
dark-penguin server: add -pp parameter to force enable/disable pipeline parallelism
37ca248f
dark-penguin Also abort if pipeline parallelism is enabled but unsupported
b0cf9515
dark-penguin dark-penguin requested a review from ggerganov ggerganov 3 days ago
dark-penguin dark-penguin requested a review 3 days ago
dark-penguin dark-penguin closed this 3 days ago
dark-penguin dark-penguin deleted the pr-disable-pipeline-parallelism branch 3 days ago

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
None yet
Milestone
No milestone
Terms Of Use Privacy Policy Refund Policy Impressum