networkd: manager - enumerate addresses globally, rather than per-link

The kernel always returns all addresses, rather than only for the given link, so let's only enumerate once.