llama.cpp
Better perplexity for 2- and 3-bit quantization for LLaMA-v2-70B
#2807
Merged

Better perplexity for 2- and 3-bit quantization for LLaMA-v2-70B #2807

ikawrakow merged 2 commits into master from ik/refine_70B
ikawrakow
Better perplexity for 2- and 3-bit quantization for the 70B model
65447568
IgnacioFDM
ggerganov
ggerganov approved these changes on 2023-08-26
PR comment
3979af1e
ikawrakow ikawrakow merged 75923754 into master 2 years ago
ikawrakow ikawrakow deleted the ik/refine_70B branch 2 years ago
Nexesenex
ikawrakow

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone