- whenever using subprocess.Popen, use close_fds=True
- make sure to catch errors in hdfs listdir
  (and make some minor improvements there)
- add one FIXME question