Create instance dir if it doesn't already exist