[569] Fixes to the ONS scraper to make sure we get all results

When a link to a data page is found we mangle it to make sure we get
all of the pages at once, and to make sure we don't miss any. Also added
a test option and a bit more useful logging