llama.cpp
ef07a409 - ggml webgpu: add support for soft_max, optimize rms_norm (#16357)

Commit
8 days ago
ggml webgpu: add support for soft_max, optimize rms_norm (#16357) * Add inplace softmax * Move rms_norm to split row approach * Update debug for supports_op * clean up debug statements * Update tests/test-backend-ops.cpp Co-authored-by: Georgi Gerganov <ggerganov@gmail.com> --------- Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
Author
Parents
Loading