Kyutai STT on Apple Silicon with MLX: streaming speech recognition
On-device & edgeSource:Hacker News
The KyutaiSTT module brings Kyutai's streaming speech recognition to Apple Silicon via MLX. The reference checkpoint is the STT-1B (English and French) quantized to 8-bit, with a causal Mimi encoder producing 32 audio codes every 80ms. CC-BY-4.0 license.
Related articles
Fine-tuning: adapting a model to your data with LoRA and QLoRA
When prompts and RAG aren't enough: you adapt the model's weights to your data. LoRA, QLoRA, dataset preparation, and local tools (LLaMA-Factory, Unsloth, MLX) on a single consumer GPU.
Ling 3.1 Flash: 560B open-weight with MIT license and 1M context — what changes if you have 24GB of VRAM
Ling 3.1 Flash ships 560B open-weight parameters under an MIT license with 1M context. It won't fit in 24GB of VRAM, but the quantizations, 25B active MoE and the real numbers change the calculation.
Local AI on Mac: the complete Apple Silicon guide
Unified memory, Ollama in three commands and the right models for your Mac: everything you need to run local AI on Apple Silicon.
Get the next local-AI briefing
Once a week, the top selection from iaLocale: articles, news and resources on local AI, and more.
After signing up you receive a confirmation email (double opt-in). Without confirmation we send nothing. No spam, we promise.