Refactor dataset creation into a DSO.
Fix the silly and poor way in which workflow datasets are stored.

There's still more work to be done here, but at least now this is
a proper array of datasets, and the translation to IDs is
transparent.
Update robots.txt, fixing denial of the search page.