Make sure to only info-log add/remove node if needed.

Change-Id: Ibb472f6ed3ebd672c89e1033fa59590e4b6cdfb8