As soon as we were not able to remove on directory stop trying to remove parents

Related to bug:	#1095