![]() * Add include files for std::min/max and std::toupper/tolower * win32: move _USE_MATH_DEFINES before includes to ensure M_PI is defined * Use GGML_RESTRICT instead of "restrict" keyword everywhere, and use "__restrict" in MSVC plain C mode * win32: only use __restrict in MSVC if C11/C17 support is not enabled --------- Co-authored-by: Marcus Groeber <Marcus.Groeber@cerence.com> |
||
---|---|---|
.. | ||
CMakeLists.txt | ||
passkey.cpp | ||
README.md |
llama.cpp/example/passkey
A passkey retrieval task is an evaluation method used to measure a language models ability to recall information from long contexts.
See the following PRs for more info:
Usage
make -j && ./llama-passkey -m ./models/llama-7b-v2/ggml-model-f16.gguf --junk 250