Only log IPs for connections and disconnections