Inference⚡
llama.cpp
Released Oct 15, 2022
C++ implementation of LLMs for efficient inference on consumer CPUs and GPUs.
LLMC++LocalEfficient
Back to resources
Inference⚡
Magnitude
Released on Jun 12, 2026
Open-source inference engine (Rust, YC S25) that compiles and tunes its kernels directly on the target hardware: Apple Silicon, NVIDIA, AMD or CPU. On open models it claims up to 2× the speed of llama.cpp. Also aimed at serving agents.
Features
- Kernels compiled on your hardware
- Up to 2× vs llama.cpp
- Apple Silicon / NVIDIA / AMD / CPU
- Agent serving optimization
Version history
- 1.0Latest
Lancio pubblico (YC S25, presentazione su Hacker News): repository magnitudedev/magnitude creato a giugno 2026.
Tags
Useful links
Discover Magnitude
Visit the official site to download, learn more and start using Magnitude.
Related resources — Inference
Inference🦙
Ollama
Released Jul 27, 2023v0.35.0
Open source tool to run LLMs locally with simplicity.
LLMLocalOpen SourceCLI
Inference🗣️
Piper TTS
Released Apr 1, 2022Piper
Sintesi vocale in locale a bassa latenza basata su ONNX: genera parlato naturale da testo in tempo quasi reale, anche su CPU. Multilingue (italiano incluso) e facile da integrare nei pipeline: download del modello, una riga di comando. MIT.
AudioTTSOpen SourceLocale