Fix ghost block bug:

Make sure we're not sending in a refence to a ghost block as the ghost
block vector is being resized.