GridCore: a scheduler that lets several local LLMs share one GPU
Tools & releasesRelated articles
The 16GB Blackwell cards: 5060 Ti, 5070, 5070 Ti
The 16GB VRAM tier is the center of gravity of local AI in 2026. It's enough memory to run the best open dense models in Q4 formats — the 27B class, the new balance point of the open catalog — without giving up too much context, and a list price that (depending on the month) stays within a personal budget. The Blackwell generation offers three cards exactly in the middle of this tier: the RTX 5060 Ti, 5070 and 5070 Ti. Same generation, same GDDR7, three very different experiences. Here's how they compare: what each one really brings you, and where your budget should go.
Quantization: Get More From the Same Hardware
What quantization is, the Q4/Q5/Q8 levels, and how to pick the right one for your VRAM, with a concrete example on Qwen2.5 14B.
Running LLM Models Locally: From First Install to First Working Model
From zero to a first answering model: what you actually need, Ollama step by step, how to pick a model for your memory, expected speeds per hardware, and the typical problems fixed.
Get the next local-AI briefing
Once a week, the top selection from iaLocale: articles, news and resources on local AI, and more.
After signing up you receive a confirmation email (double opt-in). Without confirmation we send nothing. No spam, we promise.