conf spy for performance; encode error handling in spider; rotate user agent