check no longer recursive, and always waits; better logging
simple utility to extract ids
now does concurrent lookups with multiprocessing