If we just stopped a service and it's PID file still exists, delete it.