allow processing local files instead of s3
add some more TODO items