dont rely on external index, just build an inmemory one for our run
make the index after parsing arguments for quicker error exits