Inference⚡
llama.cpp
Released Oct 15, 2022
C++ implementation of LLMs for efficient inference on consumer CPUs and GPUs.
LLMC++LocalEfficient
Released on Apr 1, 2022
Sintesi vocale in locale a bassa latenza basata su ONNX: genera parlato naturale da testo in tempo quasi reale, anche su CPU. Multilingue (italiano incluso) e facile da integrare nei pipeline: download del modello, una riga di comando. MIT.
TTS locale basato su VITS + ONNX: sintesi vocale in tempo reale su CPU, voci multilingue. MIT.
Visit the official site to download, learn more and start using Piper TTS.
C++ implementation of LLMs for efficient inference on consumer CPUs and GPUs.
Open source tool to run LLMs locally with simplicity.
High-throughput LLM serving with PagedAttention and hardware optimizations.