ggerganov/llama.cpp

Pull Requests Commits

gguf-py : Numpy dequantization for grid-based i-quants

compilade committed 287 days ago

73bc9350

gguf-py : Numpy dequantization for most types

compilade committed 288 days ago

5a9edda7

gguf-py : simplify support for quant types (#8838)

compilade committed 289 days ago

Verified 3a14e003

scripts : sync cann files (#0)

ggerganov committed 289 days ago

Verified afd27f01

scripts : fix sync filenames (#0)

ggerganov committed 289 days ago

Verified 366d486c

ggerganov committed 289 days ago

Verified e44a561a

ggml : ignore more msvc warnings (ggml/906)

iboB committed 289 days ago

Verified f93d49ab

metal : fix struct name (ggml/912)

ggerganov committed 289 days ago

Verified 5b33ea1e

metal : add abort callback (ggml/905)

conradev committed 289 days ago

Verified 85fca8de

make : clean llamafile objects (#8923)

DrDub committed 289 days ago

Verified ebd541a5

make : use C compiler to build metal embed object (#8899)

slaren committed 290 days ago

Verified 15fa07a5

ggml-backend : fix async copy from CPU (#8897)

slaren committed 290 days ago

Verified be55695e

[SYCL] Updated SYCL device filtering (#8901)

OuadiElfarouki committed 290 days ago

Verified 0478174d

CUDA/HIP: fix tests/test-backend-ops (#8896)

JohannesGaessler committed 290 days ago

Verified a8dbc6f7

llama-bench : add support for getting cpu info on Windows (#8824)

kylo5aby committed 291 days ago

Verified 506122d8

quantize : update usage comment in quantize.cpp (#8889)

danbev committed 291 days ago

Verified 725e3d94

typo correction (#8891)

Nexesenex committed 291 days ago

Verified 31958546

server : add lora hotswap endpoint (WIP) (#8857)

ngxson committed 291 days ago

Verified 1e6f6554

CUDA: fix padding logic for FP16/FP32 (#8884)

JohannesGaessler committed 291 days ago

Verified 641f5dd2

simple : update name of executable to llama-simple (#8885)

danbev committed 291 days ago

Verified 5f4dcb1e

cmake : Link vulkan-shaders-gen with pthreads (#8835)

Patater committed 291 days ago

Verified db20f50c

[Vulkan] Fix compilation of `vulkan-shaders-gen` on w64devkit after `e31a4f6` (#8880)

MaggotHATE committed 291 days ago

Verified efda90c9

contributing : add note about write access

ggerganov committed 291 days ago

Verified 0bf16de0

ggml : add epsilon as a parameter for group_norm (#8818)

MollySophia committed 291 days ago

Verified 2d5dd7bb

convert : add support for XLMRoberta embedding models (#8658)

iamlemec committed 291 days ago

Verified cdd1889d

[CANN]: Fix ggml_backend_cann_buffer_get_tensor (#8871)

MengqingCao committed 291 days ago

Verified c21a8964

[SYCL] correct cmd name (#8877)

arthw committed 292 days ago

Verified d4ff8471

common : Changed tuple to struct (TODO fix) (#8823)

Septa2112 committed 292 days ago

Verified 0a4ce786

cann: fix buffer_num and runtime speed slowly error (#8865)

wangshuai09 committed 292 days ago

Verified bc0f887e

readme : add ramalama to the availables UI (#8811)

ericcurtin committed 292 days ago

Verified b42978e7

Older