Flush handlers before ensuring service is started

Closes #16