Skip to main content
← Back to news

llama.cpp: weekly report Sept 7–14 — build b4991, Gemma 4 thinking bug fixed and Vulkan r615 driver for CI

On-device & edge
Source:Weekly Project News (Buttondown)
The weekly report on the llama.cpp project covers the current build b4991 and the week's activity: a bug where Gemma 4 in Thinking mode emitted progressively longer trailing garbage was resolved by trimming whitespace in the chat template; the Vulkan CI runners moved to the NVIDIA r615 driver, and the report analyzes the community's most active issues.
Read original article

Related articles

NVIDIA, AMD and Intel for local AI: which platform to choose

CUDA, ROCm or Vulkan? We compare the three local-AI platforms based on what is actually available: official software stacks, cards by VRAM tier (12, 16 and 24GB) and real speeds. Where the obvious choice remains, where AMD wins on value, and when it makes sense to leave NVIDIA.

Nemotron-Parse: NVIDIA's OCR family for reading documents locally

NVIDIA re-released Nemotron Parse (v1.1, v1.2, 2.0) in the same week, on October 20: under 1 billion parameters, page structure included. Local setup with vLLM and the honest limits.

Mistral vs Gemma: Light Models Compared

Families, sizes, context, licenses: the full comparison of the two most compact open model families, and how to pick the right one for your hardware.

Get the next local-AI briefing

Once a week, the top selection from iaLocale: articles, news and resources on local AI, and more.

After signing up you receive a confirmation email (double opt-in). Without confirmation we send nothing. No spam, we promise.

Related resources

Tools and resources from the iaLocale archive relevant to this content.

💎

Gemma 3

Models

Google's open model family in 1B, 4B, 12B and 27B sizes. 128K-token context, 140+ supported languages and multimedia input (text and images). An excellent choice for RAG and long documents on consumer hardware.

💎

Gemma 3 4B

Models

La taglia compatta della famiglia Gemma 3 di Google: 4,32B di parametri, contesto di 128K token e supporto nativo a 140+ lingue (incluso l'italiano), con input testo+immagini. Licenza Gemma (uso commerciale con condizioni). In Q4_K_M occupa circa 2,9GB: gira su GPU da 8GB e su CPU moderne.

💎

Gemma 4 12B

Models

La taglia 12B della famiglia Gemma 4 di Google: 11,95B dense, contesto 256K e multimodalità integrata senza encoder separati (testo+immagini+audio). Licenza Apache 2.0. In Q4_K_M occupa circa 7,4GB: il punto di equilibrio tra qualità e requisiti hardware per l'uso locale su 8-16GB.

💎

Gemma 4 26B A4B

Models

Il modello MoE della famiglia Gemma 4: 25,2B di parametri totali con 3,8B attivi per token. Contesto 256K, input testo+immagini, oltre 140 lingue, Apache 2.0. In Q4_K_M pesa circa 16,8GB: la scelta per chi ha 24GB di VRAM e vuole qualità da modello grande con velocità da modello piccolo.

Browse all resources