unitedstates/inspectors-general — pull request #72 by spulec (2014-07-13 03:12:24+00:00)
Title: Add Department of Labor

So I was pretty happy with this agency-based approached (still need to add semiannual reports) until I started adding up the numbers.

This scraper that goes agency by agency results in 733 reports while just searching for [all reports](http://www.oig.dol.gov/cgi-bin/oa_rpts.cgi?s=&y=all&a=all) results in 824 reports. It appears that some reports are not tagged appropriately with their agency.

For example, report 08-OEI-97-MSHA from http://www.oig.dol.gov/cgi-bin/oa_rpts+.cgi?s=&y=all&a=all&next_i=820 certainly should fall under Mine Safety and Health Administration, but it is not listed on http://www.oig.dol.gov/cgi-bin/oa_rpts.cgi?s=&y=all&a=06 (the MSHA filter).

There does not appear to be any easy way to deduce the agency just based on the listing. My next plan is to throw most of this work away and just use the general listing for all reports. I wanted to check in and see if any other ideas came up.