Magnitude: an open-source inference engine that optimizes itself
Tools & releasesRelated articles
Intel and AMD collaborate on PyTorch/oneDNN: what it means for local AI on CPUs
AMD is merging ZenDNN into oneDNN and Intel is folding in its ACE extensions: one open-source x86 acceleration stack in PyTorch, already the default. What it changes if you run models locally on CPUs.
GPU or CPU: when the CPU is enough
Do you really need a GPU for local AI? For many use cases, no: how prefill and decode work, what matters (memory bandwidth), real numbers on a mainstream laptop, the cases where the CPU is enough and where VRAM is needed — with the commands to measure on your own hardware.
NVIDIA, AMD and Intel for local AI: which platform to choose
CUDA, ROCm or Vulkan? We compare the three local-AI platforms based on what is actually available: official software stacks, cards by VRAM tier (12, 16 and 24GB) and real speeds. Where the obvious choice remains, where AMD wins on value, and when it makes sense to leave NVIDIA.
Get the next local-AI briefing
Once a week, the top selection from iaLocale: articles, news and resources on local AI, and more.
After signing up you receive a confirmation email (double opt-in). Without confirmation we send nothing. No spam, we promise.