Explain the odd setInterval and res.write logic
Extract keepResponseAlive
Add update_at timestamp to response. Add readable versions of dates to response.
Improve link filtering. Timeout after 8 seconds. Warm proxies.
Limit to the last 3 months of data.
Query for archive pages directly.
Fix indents
Extract variable