llama.cpp
CANN Support Ascend310P to accelerate F32 and F16 LLM Model
#10216

Merged

CANN Support Ascend310P to accelerate F32 and F16 LLM Model #10216

hipudding merged 4 commits into ggml-org:master from leo-pony:ascend310PAdapt

hipudding requested a review from

hipudding 1 year ago

hipudding added enhancement

hipudding added Ascend NPU

hipudding commented on 2024-11-18

hipudding assigned

leo-pony 1 year ago

github-actions added documentation

github-actions added build

github-actions added script

github-actions added testing

github-actions added Nvidia GPU

github-actions added nix

github-actions added examples

github-actions added python

github-actions added devops

github-actions added server

github-actions added ggml

github-actions added SYCL

github-actions added Apple Metal

github-actions added Kompute

leo-pony force pushed 1 year ago

hipudding marked this pull request as draft 1 year ago

hipudding removed documentation

hipudding removed build

hipudding removed script

hipudding removed testing

hipudding removed Nvidia GPU

hipudding removed nix

hipudding removed examples

hipudding removed python

hipudding removed devops

hipudding removed server

hipudding removed ggml

hipudding removed SYCL

hipudding removed Apple Metal

hipudding removed Kompute

leo-pony force pushed 1 year ago

CANN Support Ascend310P to accelerate F32 and F16 LLM Model

63273690

leo-pony force pushed to 63273690 1 year ago

Add compile option soc type macro ASCEND_310P to ggml-cann lib

1ee8d721

leo-pony marked this pull request as ready for review 1 year ago

Remove unused code

4201656f

Remove the ascend soc_type hard code compile option in CMakelist.txt

be29da9d

hipudding requested a review from

hipudding 1 year ago

hipudding approved these changes on 2024-11-22

hipudding merged c18610b4 into master 1 year ago

Reviewers

hipudding

Assignees

leo-pony

Labels

enhancement Ascend NPU

Milestone

No milestone

llama.cpp CANN Support Ascend310P to accelerate F32 and F16 LLM Model #10216 Merged

CANN Support Ascend310P to accelerate F32 and F16 LLM Model #10216

llama.cpp
CANN Support Ascend310P to accelerate F32 and F16 LLM Model
#10216

Merged