Change mark from xfail to skipif.

Makes tests a bit faster if requirements are not present as the whole class is skipped (rather than running each test, etc.).
Install correct version of phonenumbers for python2
Add all optional dependencies to testing dependencies.
Touch up IPAddressType; make work in python 2.