Fix a crash bug

It causes by offline index construction for vector column that has
orphan reference. Groonga should avoid the case (e.g. groonga returns
an error for removing table that is referred from any column) but
this fix will be useful a bit to make groonga more robust.