Make sure we don't add more signatures than needed.