refactoring to remove kafka from the design. going with more network bandwidth and more stateless services