Turn on doctests in nose.
Add warning that pdftohtml required in tests doesn't match that on our servers.
Remove unused import
Add 'the ' to expected output for question sections.

In 251e8b42904f8b16099208f29f1bb02a9b0393ea, a 'the' was introduced
to the title of sections containing questions, the test expected output
for the test needed updating to match.
Use unicode strings consistently for questions and answers to json.

We were being inconsistent on unicode/not for strings when creating
json from the questions and answers.

1) Make all the strings in the output unicode.
2) Call 'unicode' on the output of time.strftime calls as these
are inconsistent as in their own unicodeness (roll on Python 3).
Add model to represent batches of questions.

Questions are supplied in papers which contain multiple questions.
See http://www.parliament.gov.za/live/content.php?Category_ID=236
for a list of such papers.

This model is to allow us to store both the external (from the table)
and internal (from headers and titles) metadata of those files. The
hope is that this will help us in assigning answers to questions.

There should be only one questionpaper per (year/issue) combination
so we may as well constrain this in the database.
Tiny bit of PEP8ification.
Shift parsing of question papers out of management command.

It's usually nicer for testing, etc, to have management commands
relatively thin so I'm shifting parsing of question papers to the
question_scraper module instead of directly in the management command.
Remove unused return values.
Use requests rather than urllib2.

I'd forgotten to import urllib2 when moving something, but let's
just get rid of it altogether and use requests instead.
Some PEP8ification of whitespace, etc.
Remove tags from expected json test output.
Start big rewrite.

1) Rename regex variable to something more descriptive.

2) Use integers for parliament/session, etc rather than text,
this will help us see them in order, and also gives an opportunty
to deal with 'FOURT' where there should be 'FOURTH'.

3) Get spliting regex finding same number of questions as before.

This is done by starting to use a </b> rather than a colon as
our indication of the end of the intro.

We're now finding 104 questions, which is the same as in the
test output file.

However, there should be one more, question 720, which is getting
missed because of a unicode character in a name.

Strip out most <b> and <i> tags.
Switch on unicode in regex.

This finds us the last remaining question, the one asked by
Mrs D A Schäfer.
Replace entities in output with unicode.
Add missing question to expected output.

The scraper, and the expected output had both been missing a question
because it contained a unicode character (Mrs D A Schäfer).

Add this to the expected output, now that we're catching it.
Search for the question regex rather than splitting on it.

Also rename it to something more sensible.
Catch named groups in the question regex,
and require whitespace before questionto
Collect question paper metadata and save.
TIDY: ALL SORTS