llama: enable K-shift for quantized KV cache It will fail on unsupported backends or quant types. |
||
|---|---|---|
| .. | ||
| cmake | ||
| include | ||
| src | ||
| .gitignore | ||
| CMakeLists.txt | ||
llama: enable K-shift for quantized KV cache It will fail on unsupported backends or quant types. |
||
|---|---|---|
| .. | ||
| cmake | ||
| include | ||
| src | ||
| .gitignore | ||
| CMakeLists.txt | ||