Utility for smoke testing an applications configuration after install