PY3: use six for robotparser and urlparse