Remove cache invalidation after build concurrent index

It is not necessary to invocate that as the index is not ready for planning
btw. Per comment of Andres.