Fix an issue allowing unpaired bricks to be flagged as part of a block

Occasionally bricks would remain flagged as if they were part of a block
when half of the parent block got deleted.  This should detect and
prevent that