Actually use the provided connection factory