okfn/openspending — Issue #351: Lucy's test load: successes and failures
Author: lucychambers
Created: 2011-12-01 09:20:39+00:00
State: open

Yesterday, I trialled loading in OS with some good datasets and some with deliberately introduced errors. The datasets I used can be found here: http://thedatahub.org/dataset/lucy-s-openspending-test

# Findings

Clean dataset (4) - loaded without issue

Dataset with Errors 1 (4.1) : Error = non-unique unique identifiers - loaded with 0 issues (presumably a mistake?)

Dataset with Errors 2 (4.2) : Error = commas used in one of the amounts fields - loaded with 0 issues (presumably a mistake?)

Dataset with Errors 3 (4.3) : Error = ignore - dummy dataset

Dataset with Errors 4 (4.4) : Error = American date format - loaded with 1 error caught - useful error message, (hooray!)

Dataset with Errors 5 (4.5) : Error = Year 2009 -> 09 - loaded with 1 error caught - useful error message, (hooray!)

Dataset with Errors 6 (4.6) : Error = Blank entry in Bank Acc # - loaded with 0 issues (mistake?)

Dataset with Errors 7 (4.7) : Error = Blank entries in Bank Acc # *and* one amount field - loaded with 0 issues (mistake?)