Remove highlights which seem unsafe