Skip to main content
← Back to news

Jev in the Wild: data-driven analysis of Jev decision models in the wild

Decision models
Source:Hugging Face Papers
CUHK study of Jev decision models: 2,050 real-world use cases analyzed, from triage and routing to moderation and labeling. The paper maps how Jev models work, their applications, and the ecosystem of models that answer with structured labels instead of free text.
Read original article

Related articles

Decision models in local: JEV-35B and the 3B-active System 1

You don't need a big LLM to decide. JEV-35B (35B, 3B active) in NVFP4 on a 32GB GPU and ej (11.4MB) on CPU show how to do routing, classification and quality control without generating a single token.

GGUF: The Format That Keeps Models on Your Hardware

We open the box: what's really inside a .gguf file, why it's a single file, how to read the filename, and how to pick the size for your VRAM, with the real sizes of an 8B model.

How to Choose Your First Local AI Model

The three criteria for picking your first model: use case, memory (with the exact formula) and context. Recommended models for 8, 16 and 24 GB, and your first model in two commands.

Get the next local-AI briefing

Once a week, the top selection from iaLocale: articles, news and resources on local AI, and more.

After signing up you receive a confirmation email (double opt-in). Without confirmation we send nothing. No spam, we promise.

Related resources

Tools and resources from the iaLocale archive relevant to this content.

🛡️

Qwen3Guard-Stream-0.6B

Models

0.6B safety-moderation model with a token-level classifier for real-time monitoring during incremental generation. Three severity tiers (safe, controversial, unsafe) and 119 languages: small and local, ideal for filtering outputs without the cloud.

📊

autotrust/JEV-35B

Models

An open decision model from Autotrust, 35B parameters (3B active), a fine-tune of Qwen3.5-35B-A3B for text classification and risk scoring. In NVFP4 quantization it occupies about 25.6 GB of VRAM: it runs on a 32 GB GPU with no frontier inference needed.

💻

LM Studio

Software

Terminal-free desktop app for downloading and running GGUF models: GUI, built-in model search and a local server. The simplest way to get started.

🖥️

Mac Studio (M5 Max)

Hardware

La workstation Apple di fascia alta: M5 Max con 18 core CPU, GPU fino a 40 core con Neural Accelerator e fino a 128GB di memoria unificata a 614 GB/s. Modelli fino a ~120B in 4 bit (e i MoE a bassa attivazione come gpt-oss-120b in tempo quasi reale), con MLX e llama.cpp. 10GbE di serie, Thunderbolt 5, fino a 8 display.

Browse all resources