Memory bandwidth

Memory bandwidth (GB/s). How fast the GPU reads the model's weights from VRAM. It is the factor that limits token generation speed: for the same model, a card with higher bandwidth produces more tokens per second. Measured in GB per second and listed in every card's official specs.