end of day push, need to allow for non id removal from dictionary