nightly work; sensible database construction plus exceptions