ggerganov/llama.cpp

Pull Requests Commits

ci : only show warnings and errors in python type-check

compilade committed 324 days ago

86ccd309

tests : fix test-tokenizer-random.py

compilade committed 324 days ago

6ec70c93

py : fix new type errors from master branch

compilade committed 325 days ago

6f215f1f

Merge branch 'master' into compilade/pyright-tests

compilade committed 325 days ago

0caf60a7

ci : disable pip cache in type-check workflow

compilade committed 325 days ago

872aecbf

readme : update bindings list (#8222)

andy-tai committed 325 days ago

Verified f1948f1e

gguf-hash: model wide and per tensor hashing using xxhash and sha1 (#8048)

mofosyne committed 325 days ago

Verified f7cab35e

llama : support glm3 and glm4 (#8031)

youth123 committed 325 days ago

Verified 905942ab

llama : fix n_rot default (#8348)

ggerganov committed 325 days ago

Verified b5040086

py : use cpu-only torch in requirements.txt (#8335)

compilade committed 325 days ago

Verified d39130a3

finetune: Rename command name in README.md (#8343)

standby24x7 committed 325 days ago

Verified b81ba1f9

finetune: Rename an old command name in finetune.sh (#8344)

standby24x7 committed 325 days ago

Verified 210eb9ed

server: Retrieve prompt template in /props (#8337)

bviksoe committed 325 days ago

Verified cb4d86c4

server-tests : model metadata is a dict

compilade committed 325 days ago

60c39aca

server-tests : strip "chat" from base_url in oai_chat_completions

compilade committed 325 days ago

959c057b

server-tests : add more type annotations

compilade committed 325 days ago

71b50a14

server-tests : use trailing slash in openai base_url

compilade committed 325 days ago

fbf4a858

py : type-check all Python scripts with Pyright

compilade committed 325 days ago

e29fd963

added support for Authorization Bearer tokens when downloading model (#8307)

dwoolworth committed 325 days ago

Verified 86e7299e

update main readme (#8333)

ngxson committed 325 days ago

Verified 60d83a01

llama : add early return for empty range (#8327)

danbev committed 326 days ago

Verified 87e25a1d

Detokenizer fixes (#8039)

jaime-m-p committed 326 days ago

Verified 213701b5

Reorganize documentation pages (#8325)

ngxson committed 326 days ago

Verified be20e7f4

llama : fix compile warning (#8304)

ggerganov committed 327 days ago

Verified 7ed03b89

cmake : add GGML_BUILD and GGML_SHARED macro definitions (#8281)

akemimadoka committed 327 days ago

Verified 1d894a79

Enabled more data types for oneMKL gemm_batch (#8236)

OuadiElfarouki committed 327 days ago

Verified 1f3e1b66

convert : remove AWQ remnants (#8320)

ggerganov committed 327 days ago

Verified 148ec970

llama : minor indentation during tensor loading (#8304)

ggerganov committed 327 days ago

Verified 2cccbaa0

CUDA: MMQ support for iq4_nl, iq4_xs (#8278)

JohannesGaessler committed 327 days ago

Verified 8e558309

CUDA: revert part of the RDNA1 optimizations (#8309)

daniandtheweb committed 327 days ago

Verified 0a423800

Older