ver4a/llama.cpp
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity
llama.cpp/src
History
Diego Devesa 6adc3c3ebc
llama : add thread safety test (#14035) 
* llama : add thread safety test

* llamafile : remove global state

* llama : better LLAMA_SPLIT_MODE_NONE logic

when main_gpu < 0 GPU devices are not used

---------

Co-authored-by: Georgi Gerganov <ggerganov@gmail.com>
2025-06-16 08:11:43 -07:00
..
CMakeLists.txt memory : migrate from llama_kv_cache to more generic llama_memory (#14006) 2025-06-05 15:29:22 +03:00
llama-adapter.cpp llama : do not crash if there is no CPU backend (#13395) 2025-05-09 13:02:07 +02:00
llama-adapter.h llama : refactor llama_context, llama_kv_cache, llm_build_context (#12181) 2025-03-13 12:35:44 +02:00
llama-arch.cpp model : add NeoBERT (#14164) 2025-06-16 14:53:41 +02:00
llama-arch.h model : add NeoBERT (#14164) 2025-06-16 14:53:41 +02:00
llama-batch.cpp llama : rework embeddings logic (#14208) 2025-06-16 14:14:00 +03:00
llama-batch.h llama : rework embeddings logic (#14208) 2025-06-16 14:14:00 +03:00
llama-chat.cpp model : add dots.llm1 architecture support (#14044) (#14118) 2025-06-15 09:52:06 +02:00
llama-chat.h model : add dots.llm1 architecture support (#14044) (#14118) 2025-06-15 09:52:06 +02:00
llama-context.cpp llama : rework embeddings logic (#14208) 2025-06-16 14:14:00 +03:00
llama-context.h batch : rework llama_batch_allocr (#14153) 2025-06-13 13:47:55 +03:00
llama-cparams.cpp cparams : rename LLAMA_MAX_PARALLEL_SEQUENCES to LLAMA_MAX_SEQ (#14188) 2025-06-15 10:08:58 +03:00
llama-cparams.h cparams : rename LLAMA_MAX_PARALLEL_SEQUENCES to LLAMA_MAX_SEQ (#14188) 2025-06-15 10:08:58 +03:00
llama-grammar.cpp server: streaming of tool calls and thoughts when --jinja is on (#12379) 2025-05-25 01:48:08 +01:00
llama-grammar.h tool-call: fix Qwen 2.5 Coder support, add micro benchmarks, support trigger patterns for lazy grammars (#12034) 2025-03-05 13:05:13 +00:00
llama-graph.cpp batch : rework llama_batch_allocr (#14153) 2025-06-13 13:47:55 +03:00
llama-graph.h batch : rework llama_batch_allocr (#14153) 2025-06-13 13:47:55 +03:00
llama-hparams.cpp hparams : initialize arrays (#13728) 2025-05-23 20:16:13 +03:00
llama-hparams.h llama : add RobertaForSequenceClassification reranker support (#13875) 2025-05-29 08:15:01 +02:00
llama-impl.cpp GGUF: C++ refactor, backend support, misc fixes (#11030) 2025-01-07 18:01:58 +01:00
llama-impl.h cleanup: fix compile warnings associated with gnu_printf (#11811) 2025-02-12 10:06:53 -04:00
llama-io.cpp llama : refactor llama_context, llama_kv_cache, llm_build_context (#12181) 2025-03-13 12:35:44 +02:00
llama-io.h llama : refactor llama_context, llama_kv_cache, llm_build_context (#12181) 2025-03-13 12:35:44 +02:00
llama-kv-cache-recurrent.cpp llama : rework embeddings logic (#14208) 2025-06-16 14:14:00 +03:00
llama-kv-cache-recurrent.h llama : rework embeddings logic (#14208) 2025-06-16 14:14:00 +03:00
llama-kv-cache-unified-iswa.cpp llama : rework embeddings logic (#14208) 2025-06-16 14:14:00 +03:00
llama-kv-cache-unified-iswa.h llama : rework embeddings logic (#14208) 2025-06-16 14:14:00 +03:00
llama-kv-cache-unified.cpp llama : rework embeddings logic (#14208) 2025-06-16 14:14:00 +03:00
llama-kv-cache-unified.h llama : rework embeddings logic (#14208) 2025-06-16 14:14:00 +03:00
llama-kv-cells.h cparams : rename LLAMA_MAX_PARALLEL_SEQUENCES to LLAMA_MAX_SEQ (#14188) 2025-06-15 10:08:58 +03:00
llama-memory.cpp kv-cache : refactor the update/defrag mechanism (#13988) 2025-06-04 18:58:20 +03:00
llama-memory.h llama : rework embeddings logic (#14208) 2025-06-16 14:14:00 +03:00
llama-mmap.cpp llama : allow using mmap without PrefetchVirtualMemory, apply GGML_WIN_VER to llama.cpp sources (#14013) 2025-06-05 11:57:42 +02:00
llama-mmap.h llama-mmap: fix missing include (#11796) 2025-02-10 20:58:18 +02:00
llama-model-loader.cpp llama : support multiple classifier outputs and labels (#13940) 2025-06-06 09:03:25 +02:00
llama-model-loader.h llama : add option to override model tensor buffers (#11397) 2025-04-02 14:52:01 +02:00
llama-model-saver.cpp llama/ggml: add LLM training support (#10544) 2025-05-12 14:44:49 +02:00
llama-model-saver.h llama/ggml: add LLM training support (#10544) 2025-05-12 14:44:49 +02:00
llama-model.cpp model : add NeoBERT (#14164) 2025-06-16 14:53:41 +02:00
llama-model.h model : add dots.llm1 architecture support (#14044) (#14118) 2025-06-15 09:52:06 +02:00
llama-quant.cpp quantize : change int to unsigned int for KV overrides (#14197) 2025-06-15 18:53:45 +02:00
llama-quant.h llama : refactor src/llama.cpp (#10902) 2025-01-03 10:18:53 +02:00
llama-sampling.cpp sampling : make sure samplers return at least 1 token (#13822) 2025-05-27 12:07:52 +03:00
llama-sampling.h llama : add llama_vocab, functions -> methods, naming (#11110) 2025-01-12 11:32:42 +02:00
llama-vocab.cpp model : Add support for Arcee AI's upcoming AFM model (#14185) 2025-06-16 01:04:06 +02:00
llama-vocab.h llama/ggml: add LLM training support (#10544) 2025-05-12 14:44:49 +02:00
llama.cpp llama : add thread safety test (#14035) 2025-06-16 08:11:43 -07:00
unicode-data.cpp server : better security control for public deployments (#9776) 2024-10-08 13:27:04 +02:00
unicode-data.h llama : reduce compile time and binary size (#9712) 2024-10-02 15:49:55 +02:00
unicode.cpp repo : update links to new url (#11886) 2025-02-15 16:40:57 +02:00
unicode.h unicode : improve naming style (#10838) 2024-12-16 12:31:45 +02:00