Add Thread.sleep on configureAppServer

We need the same Thread.sleep dring configuration as we do
during reset.

Issue: #56