added consumer for real time indexing