PR #6035 [CANN] Add Ascend NPU backend

[CANN] Add Ascend NPU backend #6035

ggerganov merged 8 commits into ggml-org:master from hipudding:npu_support

hipudding marked this pull request as draft 1 year ago

ggerganov commented on 2024-03-14

hipudding force pushed from 07b045ec to 9e5a764b 1 year ago

hipudding force pushed from 65a4236c to 5fec9cbc 1 year ago

hipudding changed the title ~~Add ggml_cann backend~~ [[CANN] Add Ascend NPU backend] 1 year ago

hipudding changed the title ~~[[CANN] Add Ascend NPU backend]~~ [CANN] Add Ascend NPU backend] 1 year ago

hipudding changed the title ~~[CANN] Add Ascend NPU backend]~~ [CANN] Add Ascend NPU backend (Part 1) 1 year ago

hipudding marked this pull request as ready for review 1 year ago

hipudding requested a review from

ggerganov 1 year ago

slaren commented on 2024-03-30

hipudding marked this pull request as draft 1 year ago

hipudding force pushed from 950342d7 to 75d45c8d 1 year ago

hipudding commented on 2024-04-17

hipudding force pushed from 6deb7b67 to 5009d83e 1 year ago

hipudding force pushed from 5b01aa68 to f1bde5d5 1 year ago

hipudding changed the title ~~[CANN] Add Ascend NPU backend (Part 1)~~ [CANN] Add Ascend NPU backend 1 year ago

mofosyne added model

mofosyne added Review Complexity : High

github-actions added build

github-actions added testing

github-actions added examples

github-actions added server

github-actions added ggml

hipudding force pushed from 81a0aace to a1350139 1 year ago

hipudding force pushed from a1350139 to 28b97e88 1 year ago

hipudding force pushed from dda50f3d to 0372d365 1 year ago

wangshuai09 force pushed from 345403b6 to a5e0e2cf 1 year ago

hipudding force pushed from ebe09f39 to 2fbab0a7 1 year ago

[CANN] Add Ascend NPU backend

f8c345d5

hipudding force pushed from 2fbab0a7 to f8c345d5 1 year ago

hipudding marked this pull request as ready for review 1 year ago

hipudding requested a review from

slaren 1 year ago

slaren commented on 2024-07-16

delete trailing whitespaces

0da1e1fc

ggerganov commented on 2024-07-16

Modify the code based on review comment

f50f0905

Rename LLAMA_CANN to GGML_CANN

1115d2f8

hipudding requested a review from

ggerganov 1 year ago

hipudding requested a review from

slaren 1 year ago

slaren commented on 2024-07-16

Make ggml-common.h private

96e09b97

slaren approved these changes on 2024-07-17

add ggml_cann prefix for acl funcs

57197b74

ggerganov approved these changes on 2024-07-17

Add logging for CANN backend

5b7c5752

Delete Trailing whitespace

9944aa60

ggerganov merged 1bdd8ae1 into master 1 year ago

hipudding added Ascend NPU

Reviewers

ggerganov

slaren

Assignees

No one assigned

Labels

model build testing examples Review Complexity : High server ggml Ascend NPU

Milestone

No milestone

llama.cpp [CANN] Add Ascend NPU backend #6035 Merged

[CANN] Add Ascend NPU backend #6035

llama.cpp
[CANN] Add Ascend NPU backend
#6035

Merged