Distributed processing framework for search solutions