Skip to main content
← Back to news

Ollama v0.33.0: Claude Desktop can use local models as a gateway

Tools & releases
Source:Ollama
The release adds Claude Desktop setup with Ollama as a third-party gateway provider, plus major caching improvements: Prefill restore points make retries far more efficient and fix a hang when agent clients cancel long prefills.
Read original article

Related articles

Running LLM Models Locally: From First Install to First Working Model

From zero to a first answering model: what you actually need, Ollama step by step, how to pick a model for your memory, expected speeds per hardware, and the typical problems fixed.

Qwen: the open model with the best multilingual support

Qwen is the open family with the best support for Italian and French: generations, sizes, MoE, when to use it, and a quick comparison with Llama.

GGUF: The Format That Keeps Models on Your Hardware

We open the box: what's really inside a .gguf file, why it's a single file, how to read the filename, and how to pick the size for your VRAM, with the real sizes of an 8B model.

Get the next local-AI briefing

Once a week, the top selection from iaLocale: articles, news and resources on local AI, and more.

After signing up you receive a confirmation email (double opt-in). Without confirmation we send nothing. No spam, we promise.

Related resources

Tools and resources from the iaLocale archive relevant to this content.

🖥️

AMD Ryzen AI Max+ 395 (Strix Halo)

Hardware

La APU AMD con la massima memoria unificata su x86: fino a 128GB di LPDDR5X condivisa tra CPU (16 core Zen 5), GPU integrata (40 CU RDNA 3.5) e NPU. Fino a 96GB allocabili alla GPU: modelli fino a 100B+ a 4 bit senza GPU dedicata, su mini-PC o laptop. Bandwidth 256 GB/s.

💻

Apple M5 Max

Hardware

Il chip Apple Silicon di punta per l'IA locale: 18 core CPU e 40 core GPU con memoria unificata fino a 128GB a 614 GB/s. Il Neural Accelerator su ogni core GPU raddoppia la velocità dei modelli MoE in decode rispetto alla generazione M4: ~88 tok/s su gpt-oss-120b, il più veloce della classe.

Bespoke Nimble 9B

Models

Bespoke Labs' 9B decision model: it runs entirely locally via Ollama 0.35 and answers typed questions (true/false, numeric scale, multiple choice) through the new systemone API. Built for fast classification in automated pipelines, no cloud.

🌱

Bonsai-2 27B

Models

27B reasoning model with ternary weights at 1.72 bits per weight, derived from Qwen3.8-27B with hybrid attention (~75% linear). In GGUF PTQ1_0 it takes 5.95 GB, retains 98.2% of the FP16 intelligence and reaches ~47 tok/s on an Apple M5 Max laptop, with a 262K-token context. Apache 2.0 license. Requires Prism ML's llama.cpp fork (ternary kernels are not in stock llama.cpp).

Browse all resources