Stream mode

My changes to dir_walker to implement a streamable api call. I also removed the dummy test and changed one of the log statements.