Must test that address is inet or inet6

Must test that address is of inet or inet6 family before we check
to see if the address is part of the passed network.