llama.cpp
metal : refactor + optimize v2
#15995
Merged

metal : refactor + optimize v2 #15995

ggerganov merged 18 commits into master from gg/metal-refactor-and-optimize-v2
ggerganov
github-actions github-actions added ggml
github-actions github-actions added Apple Metal
github-actions github-actions added devops
ggerganov ggerganov force pushed from 6d78c5e8 1 year ago
ggerganov ggerganov force pushed 1 year ago
ggerganov ggerganov force pushed 1 year ago
github-actions github-actions added testing
ggerganov ggerganov force pushed to 716a3d3f 1 year ago
ggerganov ggerganov marked this pull request as ready for review 1 year ago
ggerganov metal : improve naming
a6a655ee
ggerganov metal : refactor device
61194200
ggerganov cont : props
ee9d0b37
ggerganov metal : apply ggml_mem_ranges_t
af86cc07
ggerganov metal : remove GGML_METAL_USE_BF16
84f11735
ggerganov metal : refactor device buffer
16f4183b
ggerganov cont : fix naming
f9d50067
ggerganov metal : sync before destroying the backend
1f6b8424
ggerganov metal : refactor context
1ad3a7eb
ggerganov metal : migrate ggml-metal.m to ggml-metal.cpp
0048056b
ggerganov metal : adjust ops API
ceaade4c
ggerganov metal : use C++ to store piplienes
45d6c8ef
ggerganov metal : migrate ops to separate functions
fe0ff2de
ggerganov metal : add ggml_metal_library_t
bef9295b
ggerganov ggerganov force pushed to bef9295b 1 year ago
ggerganov metal : improve naming
7a23824e
ggerganov metal : cleanp
831b2042
ggerganov metal : add support for GGML_OP_LOG
be6f519e
ggerganov metal : fix error handling
2324beba
ggerganov ggerganov merged 0320ac52 into master 1 year ago
ggerganov ggerganov deleted the gg/metal-refactor-and-optimize-v2 branch 1 year ago

Login to write a write a comment.

Login via GitHub

Reviewers
No reviews
Assignees
No one assigned
Labels
Milestone