llama.cpp
metal : add BF16 support
#8439
Merged

metal : add BF16 support #8439

ggerganov merged 7 commits into master from gg/metal-bf16
ggerganov
ggerganov ggerganov force pushed to 2aca282e 1 year ago
mofosyne mofosyne added Review Complexity : High
ggerganov ggerganov force pushed from 2aca282e to c40e9dfa 1 year ago
robbiemu
ggerganov ggml : add initial BF16 support
6109cf15
ggerganov ggerganov force pushed from c40e9dfa to 6109cf15 1 year ago
ggerganov metal : add mul_mat_id BF16 support
c915d0ad
github-actions github-actions added testing
ggerganov ggerganov marked this pull request as ready for review 1 year ago
ggerganov metal : check for bfloat support on the Metal device
3ee077a7
ggerganov metal : better var names [no ci]
a408f519
ggerganov metal : do not build bfloat kernels when not supported
ad122698
ggerganov metal : try to fix BF16 support check
69698299
ggerganov metal : this should correctly check bfloat support
670b8dbe
ggerganov ggerganov merged 5c333e01 into master 1 year ago
ggerganov ggerganov deleted the gg/metal-bf16 branch 1 year ago

Login to write a write a comment.

Login via GitHub

Reviewers
No reviews
Assignees
No one assigned
Labels
Milestone