Tools, frameworks, and models for local AI
7 resources found for "Hardware"
Google's open model family in 1B, 4B, 12B and 27B sizes. 128K-token context, 140+ supported languages and multimedia input (text and images). An excellent choice for RAG and long documents on consumer hardware.
La taglia 12B della famiglia Gemma 4 di Google: 11,95B dense, contesto 256K e multimodalità integrata senza encoder separati (testo+immagini+audio). Licenza Apache 2.0. In Q4_K_M occupa circa 7,4GB: il punto di equilibrio tra qualità e requisiti hardware per l'uso locale su 8-16GB.
Aleph Alpha's MoE: 78.1B parameters (3.46B active per token), Apache 2.0, FP8 weights, context up to 1M tokens, reasoning mode and tool calling. Built for mission-critical workloads on local hardware.
Small, fast model with up to 131K-token context. Ideal entry point for chat and summarization on modest hardware, great on phones and mini-PCs.
Ultra-compact 0.5B-parameter model. Runs on any hardware, even embedded: ideal for lightweight summarization and low-power local devices.
3B-parameter model with excellent multilingual support, including Italian. Good balance of quality and hardware requirements for summarization and drafting.
A 35B-parameter MoE model with ~3B active per token from the Qwen family, Apache-2.0. It is the fine-tune base of JEV-35B. Suited to 40GB+ GPUs in BF16 or to 4/8-bit quantizations for smaller hardware.
