Remove empty directories when cleaning up Orphanage

The empty directories were left over after a cleanup. 
This will check for empty directories and remove them.