Georgi Gerganov b4ae50810e metal : improve FA + improve MoE (#12612) ... * ggml : FA with different K, V head sizes (CPU) ggml-ci * metal : add FA with HS=192 * metal : extend FA to support different K and V head sizes ggml-ci * metal : add FA vector kernels for heads K 192 and V 128 ggml-ci * ggml : restrict op on other backends to equal head sizes ggml-ci * metal : optimize FA-vec kernel ggml-ci * metal : FA remove mq registers * metal : improve MoE mul_mat_id condition ggml-ci * metal : fix comments + remove unnecessary addition ggml-ci * metal : avoid too much shared memory usage with mul_mat_id ggml-ci		2025-03-28 20:21:59 +02:00
..
ggml-alloc.h	ggml : upgrade init_tensor API to return a ggml_status (#11854)	2025-02-28 14:41:47 +01:00
ggml-backend.h	ggml : upgrade init_tensor API to return a ggml_status (#11854)	2025-02-28 14:41:47 +01:00
ggml-blas.h	ggml : build backends as libraries (#10256)	2024-11-14 18:04:35 +01:00
ggml-cann.h	ggml : build backends as libraries (#10256)	2024-11-14 18:04:35 +01:00
ggml-cpp.h	GGUF: C++ refactor, backend support, misc fixes (#11030)	2025-01-07 18:01:58 +01:00
ggml-cpu.h	ggml-cpu: Faster IQ1 mul_mat_vec on AVX2 using BMI2 instructions (#12154)	2025-03-06 02:26:10 +01:00
ggml-cuda.h	ggml : build backends as libraries (#10256)	2024-11-14 18:04:35 +01:00
ggml-kompute.h	ggml : build backends as libraries (#10256)	2024-11-14 18:04:35 +01:00
ggml-metal.h	repo : update links to new url (#11886)	2025-02-15 16:40:57 +02:00
ggml-opencl.h	Introducing experimental OpenCL backend with support for Qualcomm Adreno GPUs (#10693)	2024-12-13 12:23:52 -08:00
ggml-opt.h	ggml: new optimization interface (ggml/988)	2024-11-17 08:30:29 +02:00
ggml-rpc.h	rpc : send hash when tensor data is above some fixed threshold (#12496)	2025-03-28 08:18:04 +02:00
ggml-sycl.h	ggml : build backends as libraries (#10256)	2024-11-14 18:04:35 +01:00
ggml-vulkan.h	vulkan: Make Vulkan optional at runtime (#11493). (#11494)	2025-02-10 07:17:21 +01:00
ggml.h	metal : improve FA + improve MoE (#12612)	2025-03-28 20:21:59 +02:00
gguf.h	GGUF: C++ refactor, backend support, misc fixes (#11030)	2025-01-07 18:01:58 +01:00