As mentioned on IRC these tests initially assert that we're offline before connecting. Therefore they require both offline and online. I agree it's a little confusing.