Resources

Tools, frameworks, and models for local AI

All Organizations Hardware Software Models Inference Frameworks

Sort by:Name (A-Z)Name (Z-A)Category Newest first Oldest first Price (low to high)Price (high to low)VRAM (highest first)Parameters (largest first)

1 resource found for "Rust"

Inference⚡

Magnitude

Released Jun 12, 20261.0

Open-source inference engine (Rust, YC S25) that compiles and tunes its kernels directly on the target hardware: Apple Silicon, NVIDIA, AMD or CPU. On open models it claims up to 2× the speed of llama.cpp. Also aimed at serving agents.

LLMInferenzaRustLocal

Learn more

CompareSite