We should check that public exponent is always odd as well.