PR #10446 Refactor/online repacking

Refactor/online repacking #10446

ggerganov merged 9 commits into ggml-org:master from Djip007:refactor/online_repacking

github-actions added ggml

Djip007 commented on 2024-11-21

Djip007 force pushed from 36a0406f to 655a3fbd 297 days ago

Djip007 force pushed from 655a3fbd to e772df4f 290 days ago

github-actions added Nvidia GPU

github-actions added SYCL

Djip007 force pushed from e772df4f to 00e6a3f2 290 days ago

Djip007 force pushed from 00e6a3f2 to a411d958 290 days ago

Djip007 force pushed from a411d958 to fd768e04 290 days ago

Djip007 commented on 2024-11-29

Djip007 force pushed from fd768e04 to 16154eb7 290 days ago

Djip007 force pushed from 16154eb7 to dc8adeb1 290 days ago

Djip007 force pushed from dc8adeb1 to 1b29245e 287 days ago

Djip007 force pushed from 1b29245e to 733f8916 287 days ago

Djip007 marked this pull request as ready for review 287 days ago

slaren commented on 2024-12-02

Djip007 force pushed from 733f8916 to e8a75e60 286 days ago

Djip007 force pushed from e8a75e60 to 66be52c9 286 days ago

Djip007 force pushed from 66be52c9 to 10df7d09 286 days ago

Djip007 force pushed from cb557b45 to ccdc7709 286 days ago

slaren commented on 2024-12-04

Djip007 force pushed from f9e92183 to dc5def81 284 days ago

github-actions added documentation

github-actions added examples

github-actions added python

Djip007 force pushed from dc5def81 to c5aa5b9c 284 days ago

rename ggml-cpu-aarch64.c to .cpp

9ac05c11

reformat extra cpu backend.

98ea414f

clang-format

95322e93

Clean Q4_0_N_M ref

3a042b48

add op GGML_OP_MUL_MAT_ID for Q4_0_N_M with runtime repack

0a2be72d

slaren approved these changes on 2024-12-06

slaren requested a review from

ggerganov 283 days ago

ggerganov approved these changes on 2024-12-06

Djip007 commented on 2024-12-06

added/corrected control on tensor size for Q4 repacking.

b14b4713

Djip007 force pushed from 8e5bd043 to b14b4713 282 days ago

ggerganov commented on 2024-12-07

Update ggml/src/ggml-cpu/ggml-cpu-aarch64.cpp

7dc8a3e2

Update ggml/src/ggml-cpu/ggml-cpu-aarch64.cpp

e115f6f6

add debug logs on repacks.

1221d13d

Djip007 force pushed from be3c64b2 to 1221d13d 281 days ago

ggerganov merged 19d8762a into master 281 days ago

Reviewers

ggerganov

slaren

Assignees

No one assigned

Labels

documentation Nvidia GPU examples python ggml SYCL

Milestone

No milestone

llama.cpp Refactor/online repacking #10446 Merged

Refactor/online repacking #10446

llama.cpp
Refactor/online repacking
#10446

Merged