Revert "Add callbacks for router interface add/remove"

Looks like we get most of this via the port update.
Therefore I don't think this is necessary right now.

This reverts commit e1257dd079d963be39e7b77de9a66a1ec9dcb0a4.