Make sure jetty restarts after we created a custom core