ggerganov/llama.cpp

Pull Requests Commits

gguf-py : remove unused import

compilade committed 1 year ago

c5fe1d6c

gguf-py : fix and simplify quantized shape round-trip

compilade committed 1 year ago

2ff601fc

CUDA: fix FA out-of-bounds reads (#7479)

JohannesGaessler committed 1 year ago

Verified cd93a28c

SimpleChat: a simple and dumb web front end for testing /chat/completions and /completions end points and try chat (#7350)

hanishkvc committed 1 year ago

Verified 1e374365

build : remove zig (#7471)

ggerganov committed 1 year ago

Verified 197ff914

common : normalize naming style (#7462)

ggerganov committed 1 year ago

Verified 6ff13987

CUDA: fix FA out-of-bounds writes (#7465)

JohannesGaessler committed 1 year ago

Verified 38c03478

phi3 : duplicate rope factors in each layer (#7447)

slaren committed 1 year ago

Verified b18532a4

vulkan: add workaround for iterator boundary check to fix clang-cl debug build (#7426)

Adriankhl committed 1 year ago

Verified fcda1128

llama : add missing model type names (#7445)

jart committed 1 year ago

Verified 03d8900e

cuda : fix compile warning (#7454)

ggerganov committed 1 year ago

Verified 9b3d8331

CUDA: remove incorrect precision check (#7454)

JohannesGaessler committed 1 year ago

Verified 95fb0aef

cuda : fix rope + add tests (#7452)

ggerganov committed 1 year ago

Verified 3e5faa85

llama : add phi3 128K model support (#7225)

liuwei-git committed 1 year ago

Verified 201cc11a

metal : handle F16 inf values, fix FA partial offload (#7434)

ggerganov committed 1 year ago

Verified 6369bf04

`grammars`: fix resampling logic regression (#7424)

ochafik committed 1 year ago

Verified e402de36

CUDA: fix unused warning in mmq.cu (#7442)

JohannesGaessler committed 1 year ago

Verified fcf6538b

tests : test-tokenizer-0.sh print more info (#7402)

ggerganov committed 1 year ago

Verified c3f8d583

examples: cache hf model when --model not provided (#7353)

amirzia committed 1 year ago

Verified 11474e75

CUDA: deduplicate mmq code (#7397)

JohannesGaessler committed 1 year ago

Verified d8ee9022

Tokenizer SPM fixes for phi-3 and llama-spm (bugfix) (#7425)

jaime-m-p committed 1 year ago

Verified d7e852c1

Tokenizer SPM fixes for phi-3 and llama-spm (#7375)

jaime-m-p committed 1 year ago

Verified 917dc8cf

llama : remove Persimmon (#7408)

ggerganov committed 1 year ago

Verified fabf30b4

perplexity: update README FP16 results [no ci] (#7413)

JohannesGaessler committed 1 year ago

Verified 20385ceb

rpc : track allocated buffers (#7411)

rgerganov committed 1 year ago

Verified db10f013

server : fix temperature + disable some tests (#7409)

ggerganov committed 1 year ago

Verified 3bc10cb4

[SYCL] Update SYCL upscale operation (#7321)

AidanBeltonS committed 1 year ago

Verified 6bf9b66f

Update README.md (#7410)

binganao committed 1 year ago

Verified 26cd4237

ggml-opencl, llama: using reserve() if count already known (#7272)

GermanAizek committed 1 year ago

Verified 213e90ed

ggml : add loongarch lsx and lasx support (#6454)

junchao-loongson committed 1 year ago

Verified 65c58207

Older