EAGLE

Family of speculative decoding techniques (EAGLE paper, arXiv:2401.15077): a small draft model reads the big model's hidden states and predicts the next tokens from there. Sampling stays lossless, like classical speculative sampling. Official EAGLE checkpoints (for example Mistral-Medium-3.5-128B-EAGLE) are served natively by vLLM and SGLang.