ggerganov/llama.cpp

Pull Requests Commits
metal : minor Q4_0 optimization
ggerganov committed 1 year ago
Verified 8c1b186c
ggml : add ggml-metal-impl.h
ggerganov committed 1 year ago
Verified 86ed72d2
metal : add TODOs for rest of ops
ggerganov committed 1 year ago
Verified 63bab93c
metal : GGML_OP_NORM
ggerganov committed 1 year ago
Verified 964206a7
metal : GGML_OP_RMS_NORM
ggerganov committed 1 year ago
Verified e9ecd5d4
metal : GGML_OP_CPY
ggerganov committed 1 year ago
Verified 647a7044
metal : GGML_OP_REPEAT
ggerganov committed 1 year ago
Verified f46f710c
metal : GGML_OP_ADD, GGML_OP_SUB, GGML_OP_MUL, GGML_OP_DIV
ggerganov committed 1 year ago
Verified 3250c98b
metal : GGML_OP_CONCAT
ggerganov committed 1 year ago
Verified 9058c51d
cont : int safety + register optimizations
ggerganov committed 1 year ago
Verified bb821e48
cont : mul mm id
ggerganov committed 1 year ago
Verified c5cf1d74
cont : thread counters style
ggerganov committed 1 year ago
Verified 15a71059
cont : shmem style
ggerganov committed 1 year ago
Verified cacc4c22
cont : use char ptr
ggerganov committed 1 year ago
Verified a1a201c1
cont : args is first argument
ggerganov committed 1 year ago
Verified c81640a5
cont : pass by reference
ggerganov committed 1 year ago
Verified b65e4c1e
cont : mul mat vec
ggerganov committed 1 year ago
Verified c59a13d9
metal : mul mat struct (wip)
ggerganov committed 1 year ago
Verified 7670809a
metal : cont + avoid potential int overflow [no ci]
ggerganov committed 1 year ago
Verified 4fd6fc5a
metal : fattn args
ggerganov committed 1 year ago
Verified 9e07bcc0
metal : add kernel arg structs (wip)
ggerganov committed 1 year ago
Verified 1198ae77
vulkan: Throttle the number of shader compiles during the build step. (#10222)
jeffbolznv committed 1 year ago
Verified 54ef9cfc
metal : more precise Q*K in FA vec kernel (#10247)
ggerganov committed 1 year ago
Verified b0cefea5
server : enable KV cache defrag by default (#10233)
ggerganov committed 1 year ago
Verified b141e5f6
flake.lock: Update (#10243)
ggerganov committed 1 year ago
Verified 4b3a9212
server : (web UI) Add back sampler settings (#10239)
MaggotHATE committed 1 year ago
Verified 505f3327
vulkan: Fix newly added tests for permuted mul_mat and 1D im2col (#10226)
jeffbolznv committed 1 year ago
Verified 160687b3
metal : reorder write loop in mul mat kernel + style (#10231)
ggerganov committed 1 year ago
Verified 6423c65a
metal : fix build and some more comments (#10229)
ggerganov committed 1 year ago
Verified 39a334a9
metal : fix F32 accumulation in FA vec kernel (#10232)
ggerganov committed 1 year ago
Verified bb38cdd8
Terms Of Use Privacy Policy Refund Policy Impressum