ggml-org/ggml — a trending C++ project

ggml-org/ggml — C++ · 15,797 stars · 1,947 forks · +154 today

Tensor library for machine learning

---

Build from source:

git clone https://github.com/ggml-org/ggml
cd ggml

mkdir build && cd build
cmake ..
cmake --build . --config Release -j 8

For a minimal, fully commented example (matrix multiplication), see examples/simple.

The main goal of ggml is to be a simple, portable, and efficient tensor library for machine learning with minimal setup.

• Plain C/C++ implementation without any dependencies
• Cross-platform - x86, ARM, RISC-V, LoongArch, PowerPC, s390x, and WebAssembly
• SIMD-optimized kernels for x86, ARM, and RISC-V
• Broad backend support - CPU, GPU, NPU, and browser
• 2- to 8-bit integer quantization, plus MXFP4 and NVFP4 microscaling formats
• Zero memory allocations during runtime

• The GGUF file format
• Introduction to ggml
• GGML tips & tricks

• For changes to the core ggml library (including to the CMake build system), please open a PR in llama.cpp - doing so will make your PR more visible, better tested, and more likely to be reviewed

---

Content above is the README of ggml-org/ggml, reproduced from GitHub’s trending list. All rights remain with the original authors.