llama.cpp
perplexity : faster Winogrande via batching
#5024
Merged

perplexity : faster Winogrande via batching #5024

ggerganov merged 3 commits into master from gg/winogrande-batched
ggerganov
ggerganov perplexity : faster Winogrande via batching
0f3ed789
ggerganov ggerganov requested a review from ikawrakow ikawrakow 1 year ago
ggerganov perplexity : remove unused function
bb58b0e7
ikawrakow
ikawrakow approved these changes on 2024-01-19
ikawrakow ikawrakow added performance
ggerganov perplexity : only tokenize selected tasks for Winogrande
9e4ad80c
ggerganov
ggerganov ggerganov merged 8b20858e into master 1 year ago
ggerganov ggerganov deleted the gg/winogrande-batched branch 1 year ago
ikawrakow

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone