added options for hidden and system files
hash based compare
remove root from DB class
update the hash code to the new way of accessing log
update tests since DB no longer holds root
instead of a compare, have separate diff and intersection
added non-uniques
misc. refactoring
added testing based on random files
more testing on difference and intersection
added merge 'app'
updated scan so it work with latest DB class
slight comment improvement