adds logging and offset capabilities; decreases batch size