ggerganov/llama.cpp

Pull Requests Commits

Support SYCL device register

arthw committed 1 year ago

8233009d

flake.lock: Update (#9870)

ggerganov committed 1 year ago

Verified 92be9f12

server : add option to time limit the generation phase (#9865)

ggerganov committed 1 year ago

Verified edc26566

server : remove self-extend features (#9860)

ggerganov committed 1 year ago

Verified 1bde94dd

server : remove legacy system_prompt feature (#9857)

ggerganov committed 1 year ago

Verified 95c76e8e

llama : improve infill support and special token detection (#9798)

ggerganov committed 1 year ago

Verified 11ac9800

musa : update doc (#9856)

yeahdongcn committed 1 year ago

Verified 943d20b4

ggml : move more prints to the ggml log system (#9839)

slaren committed 1 year ago

Verified 96776405

common : use common_ prefix for common library functions (#9805)

slaren committed 1 year ago

Verified 7eee341b

rpc : add backend registry / device interfaces (#9812)

slaren committed 1 year ago

Verified 0e9f760e

musa: add docker image support (#9685)

yeahdongcn committed 1 year ago

Verified cf8e0a3b

examples : do not use common library in simple example (#9803)

slaren committed 1 year ago

Verified c7499c55

cmake : do not build common library by default when standalone (#9804)

slaren committed 1 year ago

Verified c81f3bbb

perplexity : fix integer overflow (#9783)

ggerganov committed 1 year ago

Verified e7022064

examples : remove llama.vim

ggerganov committed 1 year ago

Verified 3dc48fe7

ggml : fix BLAS with unsupported types (#9775)

slaren committed 1 year ago

Verified dca1d4b5

server : better security control for public deployments (#9776)

ngxson committed 1 year ago

Verified 458367a9

scripts : fix spelling typo in messages and comments (#9782)

standby24x7 committed 1 year ago

Verified fa42aa6d

ggml : add backend registry / device interfaces to BLAS backend (#9752)

slaren committed 1 year ago

Verified 63747437

Update building for Android (#9672)

amqdn committed 1 year ago

Verified f1af42fa

flake.lock: Update (#9753)

ggerganov committed 1 year ago

Verified 6279dac0

ggml : add metal backend registry / device (#9713)

ggerganov committed 1 year ago

Verified d5ac8cf2

metal : single allocation of encode_async block (#9747)

ptsochantaris committed 1 year ago

Verified 96b69121

contrib : simplify + minor edits [no ci]

ggerganov committed 1 year ago

Verified d5cb8684

readme : fix typo [no ci]

ggerganov committed 1 year ago

Verified f4b2dcdf

sync : llama.cpp

ggerganov committed 1 year ago

Verified b6d6c528

vulkan : retry allocation with fallback flags (whisper/2451)

SRHMorris committed 1 year ago

Verified b0915d5b

rerank : use [SEP] token instead of [BOS] (#9737)

ggerganov committed 1 year ago

Verified 8c475b97

ggerganov committed 1 year ago

Verified 58b16695

metal : zero-init buffer contexts (whisper/0)

ggerganov committed 1 year ago

Verified 905f5485

Older