Actually run CI tests with the real settings