Removing policy which is in using