Dateutil was ignoring time zones and parsing everything as GMT. This was causing robots.txt data to expire too soon or too late, depending on the time zone.