PR #6035 [CANN] Add Ascend NPU backend

[CANN] Add Ascend NPU backend #6035

ggerganov merged 8 commits into ggml-org:master from hipudding:npu_support

hipudding marked this pull request as draft 2 years ago

ggerganov commented on 2024-03-14

hipudding force pushed 2 years ago

hipudding force pushed to 5fec9cbc 2 years ago

hipudding changed the title ~~Add ggml_cann backend~~ [[CANN] Add Ascend NPU backend] 2 years ago

hipudding changed the title ~~[[CANN] Add Ascend NPU backend]~~ [CANN] Add Ascend NPU backend] 2 years ago

hipudding changed the title ~~[CANN] Add Ascend NPU backend]~~ [CANN] Add Ascend NPU backend (Part 1) 2 years ago

hipudding marked this pull request as ready for review 2 years ago

hipudding requested a review from

ggerganov 2 years ago

slaren commented on 2024-03-30

hipudding marked this pull request as draft 1 year ago

hipudding force pushed 1 year ago

hipudding commented on 2024-04-17

hipudding force pushed 1 year ago

hipudding force pushed to f1bde5d5 1 year ago

hipudding changed the title ~~[CANN] Add Ascend NPU backend (Part 1)~~ [CANN] Add Ascend NPU backend 1 year ago

mofosyne added model

mofosyne added Review Complexity : High

github-actions added build

github-actions added testing

github-actions added examples

github-actions added server

github-actions added ggml

hipudding force pushed from 81a0aace to a1350139 1 year ago

hipudding force pushed from a1350139 1 year ago

hipudding force pushed 1 year ago

wangshuai09 force pushed 1 year ago

hipudding force pushed 1 year ago

[CANN] Add Ascend NPU backend

f8c345d5

hipudding force pushed to f8c345d5 1 year ago

hipudding marked this pull request as ready for review 1 year ago

hipudding requested a review from

slaren 1 year ago

slaren commented on 2024-07-16

delete trailing whitespaces

0da1e1fc

ggerganov commented on 2024-07-16

Modify the code based on review comment

f50f0905

Rename LLAMA_CANN to GGML_CANN

1115d2f8

hipudding requested a review from

ggerganov 1 year ago

hipudding requested a review from

slaren 1 year ago

slaren commented on 2024-07-16

Make ggml-common.h private

96e09b97

slaren approved these changes on 2024-07-17

add ggml_cann prefix for acl funcs

57197b74

ggerganov approved these changes on 2024-07-17

Add logging for CANN backend

5b7c5752

Delete Trailing whitespace

9944aa60

ggerganov merged 1bdd8ae1 into master 1 year ago

hipudding added Ascend NPU

Reviewers

ggerganov

slaren

Assignees

No one assigned

Labels

model build testing examples Review Complexity : High server ggml Ascend NPU

Milestone

No milestone

llama.cpp [CANN] Add Ascend NPU backend #6035 Merged

[CANN] Add Ascend NPU backend #6035

llama.cpp
[CANN] Add Ascend NPU backend
#6035

Merged