llama.cpp
CANN: fix RoPE cache issue on multi-device
#15629
Merged

CANN: fix RoPE cache issue on multi-device #15629

hipudding merged 5 commits into ggml-org:master from hipudding:rope_cache
hipudding
hipudding CANN: fix RoPE cache issue on multi-device
c5e77de5
github-actions github-actions added ggml
github-actions github-actions added Ascend NPU
hipudding hipudding requested a review from ggerganov ggerganov 11 days ago
hipudding hipudding requested a review from slaren slaren 11 days ago
ggerganov
ggerganov commented on 2025-08-28
noemotiovon
hipudding hipudding assigned hipudding hipudding 11 days ago
hipudding hipudding requested a review from ggerganov ggerganov 11 days ago
hipudding CANN: Optimize first-layer detection method
24d43d30
noemotiovon
noemotiovon approved these changes on 2025-08-29
noemotiovon
hipudding CANN: Remove trailing whitespace
602563c5
ggerganov
ggerganov commented on 2025-08-29
hipudding
ggerganov
hipudding CANN: Only cache the data that can be determined as unchanged through…
1321c2c4
hipudding
hipudding CANN: Update function comment
ce56f809
hipudding hipudding requested a review from ggerganov ggerganov 10 days ago
hipudding hipudding requested a review from noemotiovon noemotiovon 10 days ago
noemotiovon
ggerganov
ggerganov approved these changes on 2025-08-31
hipudding hipudding merged 3dc7397a into master 8 days ago

Login to write a write a comment.

Login via GitHub

Assignees
Labels
Milestone