ggerganov/llama.cpp

Pull Requests Commits

ggerganov committed 1 year ago

Verified f32f30bc

simplify bug issue template (#4623)

slaren committed 1 year ago

Verified b9f47952

llama : add PLaMo model (#3557)

okdshin committed 1 year ago

Verified 753be377

cuda : improve cuda pool efficiency using virtual memory (#4606)

slaren committed 1 year ago

Verified 5bf3953d

fallback to CPU buffer if host buffer alloc fails (#4610)

slaren committed 1 year ago

Verified 708e179e

ci(docker): fix tags in "Build and push docker image (tagged)" (#4603)

samm81 committed 1 year ago

Verified 925e5584

server : allow to specify custom prompt for penalty calculation (#3727)

z80maniac committed 1 year ago

Verified 61239799

grammar : check the full vocab only if necessary (opt) (#4306)

kalomaze committed 1 year ago

Verified b9ec82d2

CUDA: fixed row rounding for 0 tensor splits (#4594)

JohannesGaessler committed 1 year ago

Verified e0a40022

lookup : add prompt lookup decoding example (#4484)

LeonEricsson committed 1 year ago

Verified 7082d24c

sync : ggml (fix im2col) (#4591)

ggerganov committed 1 year ago

Verified ba661751

cuda : fix jetson compile error (#4560)

FantasyGmm committed 1 year ago

Verified a5587695

Fix CudaMemcpy direction (#4599)

Ttl committed 1 year ago

Verified 6724ef16

llama : fix platforms without mmap (#4578)

slaren committed 1 year ago

Verified 48b7ff19

ggml : add comment about backward GGML_OP_DIAG_MASK_INF (#4203)

GermanAizek committed 1 year ago

Verified 48b24b17

make : add LLAMA_HIP_UMA option (#4587)

Michael Kesper committed 1 year ago

Verified 28cb35a0

ci : tag docker image with build number (#4584)

rhuddleston committed 1 year ago

Verified f31b9848

readme : add zig bindings (#4581)

Deins committed 1 year ago

Verified 2bb98279

ggml : extend `enum ggml_log_level` with `GGML_LOG_LEVEL_DEBUG` (#4579)

bobqianic committed 1 year ago

Verified 0137ef88

llama : add ability to cancel model loading (#4462)

crasm committed 1 year ago

Verified c7e9701f

ggml : change ggml_scale to take a float instead of tensor (#4573)

ggerganov committed 1 year ago

Verified afefa319

gguf-py : fix broken link

ggerganov committed 1 year ago

Verified 769a7bc8

gguf : simplify example dependencies

ggerganov committed 1 year ago

Verified 32259b2d

ci : add `jlumbroso/free-disk-space` to docker workflow (#4150)

samm81 committed 1 year ago

Verified 4a5f9d62

llama : initial ggml-backend integration (#4520)

slaren committed 1 year ago

Verified d232aca5

llama : allow getting n_batch from llama_context in c api (#4540)

MarcusDunn committed 1 year ago

Verified 31f27758

metal : fix `ggml_metal_log` vargs (#4373)

finnvoor committed 1 year ago

Verified 56fa5081

cuda : ROCm AMD Unified Memory Architecture (UMA) handling (#4449)

ekg committed 1 year ago

Verified 0f630fbc

ggml-cuda: Fix HIP build by adding define for __trap (#4569)

arlo-phoenix committed 1 year ago

Verified 562cf222

common : remove incorrect --model-draft default (#4568)

cebtenzzre committed 1 year ago

Verified 8fe03ffd

Older