ggerganov/llama.cpp

Pull Requests Commits

llama : print a log of the total cache size

ggerganov committed 1 year ago

Verified 8a8f8b95

llama : throw on unknown tokenizer types

ggerganov committed 1 year ago

Verified 1494a184

llama : use vectors and avoid has_cache

ggerganov committed 1 year ago

Verified 21ccd645

llama : cache llama_token_to_piece

ggerganov committed 1 year ago

Verified 9964cd02

ggml : fix YARN + add tests + add asserts (#7617)

ggerganov committed 1 year ago

Verified fb76ec31

cuda : non-cont concat support (#7610)

ggerganov committed 1 year ago

Verified cce3dcff

llama-bench : add support for the RPC backend (#7435)

rgerganov committed 1 year ago

Verified 210d9917

ggml : use atomic_flag for critical section (#7598)

slaren committed 1 year ago

Verified 87bdf2a1

scripts : remove mpi remnants

ggerganov committed 1 year ago

Verified 00281b7b

ggerganov committed 1 year ago

Verified 2ab97728

ggml : restore ggml_rope_xpos_inplace (ggml/0)

ggerganov committed 1 year ago

Verified 72de268b

Add Arc A750 and Arch linux to readme-sycl.md as verified GPU model and Linux distro (#7605)

Akarshan Biswas committed 1 year ago

Verified 0e8d8bfd

ggml : fix typo in ggml.c (#7603)

jeffzhou2000 committed 1 year ago

Verified 504f0c34

[SYCL] Align GEMM dispatch (#7566)

airMeng committed 1 year ago

Verified b864b50c

Tokenizer WPM fixes (#7500)

jaime-m-p committed 1 year ago

Verified 02c1ecad

sycl : fix assert (#7563)

ggerganov committed 1 year ago

Verified 6bd12ce4

llama : support small Granite models (#7481)

giuseppe committed 1 year ago

Verified 5442939f

vulkan: properly initialize vulkan devices for LLAMA_SPLIT_MODE_NONE (#7552)

Adriankhl committed 1 year ago

Verified 56411a95

rpc : resource management rework (#7562)

rgerganov committed 1 year ago

Verified 2b737caa

Add support for DeepseekV2ForCausalLM (#7519)

fairydreaming committed 1 year ago

Verified ee3dff6b

tests : fix test-tokenizer-0.sh

ggerganov committed 1 year ago

Verified edc29433

llama : handle unknown utf8 bytes (#7588)

ggerganov committed 1 year ago

Verified 8b99e2aa

github: add refactor to issue template (#7561)

mofosyne committed 1 year ago

Verified 271ff3fc

[SYCL]fix ggml_sycl_mul_mat_id() to match the change of api (#7436)

arthw committed 1 year ago

Verified e2b06507

ggml : generalize GGML_OP_CONCAT (#7563)

ggerganov committed 1 year ago

Verified 0548a418

server: do not remove whitespace at the start of a completion chunk (#7524)

mgroeber9110 committed 1 year ago

Verified 9335b969

Markdownish code block fix (#7571)

nathan-sixnines committed 1 year ago

Verified c4176715

llava : update clip.h (#7580)

eltociear committed 1 year ago

Verified 74b239b3

update HIP_UMA #7399 (#7414)

Djip007 committed 1 year ago

Verified 852aafb1

adding in x64 targets to cmake presets (#7574)

kunnis committed 1 year ago

Verified 0136966d

Older