If an old tap dir exists, remove it so we can upgrade to new layout