Make sure certain configs only apply if dashboard is installed.