WIP Rewrite RobotsTxtRichClientSession into new .http.robots module.

[ci skip]