ver4a/llama.cpp
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity

CANN: Opt ROPE optimization (#12865)

Browse source 
* [CANN]Opt ROPE optimization

* [CANN]Codestyle adjustment

* [CANN]Fix the ROPE precision issue

* [CANN]codestyle fix

* [CANN]add rope unsupport case

Signed-off-by: noemotiovon <noemotiovon@gmail.com>
This commit is contained in:
Chenguang Li 2025-04-15 10:09:35 +08:00 • committed by GitHub
parent b0c75ac9f9
commit 0019279bb5
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
2 changed files with 84 additions and 121 deletions
Download patch file Download diff file Expand all files Collapse all files

3
ggml/src/ggml-cann/ggml-cann.cpp
View file

@ -2087,6 +2087,9 @@ static bool ggml_backend_cann_supports_op(ggml_backend_dev_t dev,
return false;
}
if(!ggml_is_contiguous(op->src[0])){
return false;
}
return true;
}
case GGML_OP_UPSCALE: {