Remove previous markers only if they are not displaying an info window.