Skip to main content
← Back to glossary

Ternary weights

Formats

Weight representation restricted to {−1, 0, +1} values, often with a shared scale per group. Brings the cost to ~1.58 bits per weight (plus the scale), enabling tens-of-billions-of-parameters models in a few GB, as in Bonsai-2 27B.

This term in other languages