added improvements to logging and removed old data publisher define stream pattern