llama.cpp
metal: TRI, FILL, EXPM1, SOFTPLUS
#16623
Merged

metal: TRI, FILL, EXPM1, SOFTPLUS #16623

gabe-l-hart
gabe-l-hart gabe-l-hart requested a review from slaren slaren 261 days ago
gabe-l-hart gabe-l-hart requested a review from CISC CISC 261 days ago
gabe-l-hart gabe-l-hart requested a review from ggerganov ggerganov 261 days ago
github-actions github-actions added testing
github-actions github-actions added Nvidia GPU
github-actions github-actions added examples
github-actions github-actions added ggml
github-actions github-actions added Apple Metal
gabe-l-hart
JohannesGaessler
pwilkin
JohannesGaessler
gabe-l-hart
giuseppe
gabe-l-hart
fat-tire
JohannesGaessler
CarlGao4
CISC
pwilkin
gabe-l-hart
pwilkin
gabe-l-hart
wsbagnsv1
gabe-l-hart
gabe-l-hart
gabe-l-hart feat(wip): Port initial TRI impl from pervious work
a9c92440
gabe-l-hart fix: Remove argument for constant val override
2a7bbc77
gabe-l-hart feat: Move the ttype conditional to templating to avoid conditional i…
f2ad8877
gabe-l-hart gabe-l-hart force pushed from 5071fbd5 to f2ad8877 213 days ago
gabe-l-hart gabe-l-hart changed the title ggml: CUMSUM and TRI (CPU, Metal, CUDA) metal: TRI 213 days ago
gabe-l-hart
ggerganov
ggerganov commented on 2025-12-03
gabe-l-hart fix: Type fixes
6a270503
gabe-l-hart
gabe-l-hart
gabe-l-hart feat: Add softplus for metal
7cbbff74
gabe-l-hart feat: Add EXPM1 for metal
434ec074
gabe-l-hart feat: Add FILL for metal
1496afdf
gabe-l-hart gabe-l-hart changed the title metal: TRI metal: TRI, FILL, EXPM1, SOFTPLUS 213 days ago
gabe-l-hart refactor: Branchless version of tri using _ggml_vec_tri_cmp as a mask
76908089
ggerganov
ggerganov approved these changes on 2025-12-04
gabe-l-hart fix: Remove unused arguments
60fe39b0
gabe-l-hart Merge remote-tracking branch 'origin/master' into ggml-cumsum-tri
c195af2b
gabe-l-hart Merge remote-tracking branch 'origin/master' into ggml-cumsum-tri
d006f357
gabe-l-hart refactor: Use select instead of branch for softplus non-vec
338acb32
gabe-l-hart
ggerganov ggerganov merged bde188d6 into master 212 days ago
gabe-l-hart gabe-l-hart deleted the ggml-cumsum-tri branch 212 days ago
CISC
gabe-l-hart

Login to write a write a comment.

Login via GitHub

Reviewers
Assignees
No one assigned
Labels
Milestone