Radoslav Gerganov 553a5c3a9f rpc : do not wait for response when sending RPC_CMD_SET_TENSOR (#12943) ... RPC_CMD_SET_TENSOR always returns an empty response and we send this 4 times per token. We can improve TG speed if we don't wait for this empty response. The performance impact of this change depends on the network latency.		2025-04-25 10:08:08 +03:00
..
ggml-alloc.h	ggml : upgrade init_tensor API to return a ggml_status (#11854)	2025-02-28 14:41:47 +01:00
ggml-backend.h	ggml : upgrade init_tensor API to return a ggml_status (#11854)	2025-02-28 14:41:47 +01:00
ggml-blas.h	ggml : build backends as libraries (#10256)	2024-11-14 18:04:35 +01:00
ggml-cann.h	ggml : build backends as libraries (#10256)	2024-11-14 18:04:35 +01:00
ggml-cpp.h	GGUF: C++ refactor, backend support, misc fixes (#11030)	2025-01-07 18:01:58 +01:00
ggml-cpu.h	ggml-cpu: Faster IQ1 mul_mat_vec on AVX2 using BMI2 instructions (#12154)	2025-03-06 02:26:10 +01:00
ggml-cuda.h	ggml : build backends as libraries (#10256)	2024-11-14 18:04:35 +01:00
ggml-kompute.h	ggml : build backends as libraries (#10256)	2024-11-14 18:04:35 +01:00
ggml-metal.h	repo : update links to new url (#11886)	2025-02-15 16:40:57 +02:00
ggml-opencl.h	Introducing experimental OpenCL backend with support for Qualcomm Adreno GPUs (#10693)	2024-12-13 12:23:52 -08:00
ggml-opt.h	ggml: new optimization interface (ggml/988)	2024-11-17 08:30:29 +02:00
ggml-rpc.h	rpc : do not wait for response when sending RPC_CMD_SET_TENSOR (#12943)	2025-04-25 10:08:08 +03:00
ggml-sycl.h	ggml : build backends as libraries (#10256)	2024-11-14 18:04:35 +01:00
ggml-vulkan.h	vulkan: Make Vulkan optional at runtime (#11493). (#11494)	2025-02-10 07:17:21 +01:00
ggml.h	ggml : Depthwise 2D convolution (ggml/1152)	2025-04-24 17:32:47 +03:00
gguf.h	GGUF: C++ refactor, backend support, misc fixes (#11030)	2025-01-07 18:01:58 +01:00