eh this is a messy one, has search and kafka additions