Sphinx test fixes

This fixes a few tests for the Sphinx extensions that have been broken for a little while due to the fact that these tests were mistakenly being skipped by the test runner (see #2222).

Right now Travis should pass, trivially, since it will still skip these tests unless #2222 is merged first.  But I've confirmed locally that this fixes the tests.