Skip to main content
← Back to glossary

Multi-Token Prediction (MTP)

Performance

A technique where the model is trained to predict multiple future tokens in a single step instead of one. It lets you propose several candidates without extra calls and underpins speculative decoding: the checkpoint ships the MTP modules already trained.

This term in other languages