explain what we're doing here
draft of a news site crawler