Create dashboards dir if it does not exists