Enhancements to sweeper to better support Gobblin data

In the interest of simplicity, this code is now used for both hourly and daily retention.  If a targetSubdir is specified, it will check that subdir before deleting.  Other than that, the logic is exactly the same, since we define retention in number of days for both jobs.