refactor to hdfs subpackage

This refactors to use a hdfs subpackage for file manipulation commands, and switches to addopt the scanner interface