Previous outputs can be missing for side chains too

Last night / this morning's re-org exposed this. We don't fully validate side chain blocks until we connect them so this assertion was incorrect.