More logging for extra conf store
Ensuring server cleanup on OS signals

atexit won't run registered functions for SIGTERM which we send to the server.
This prevents clean shutdown.

Also making sure that the server logfiles are deleted as well.