Tidying up conversion short circuits

Instead of relying on late checks for #respond_to? have it happen very
early