assaf/zombie — Issue #259: Error 418 at AOL
Author: brandonhall
Created: 2012-01-13 19:40:28+00:00
State: open

I'm trying to pull contacts from AOL since they don't have an API and running into a 418 unused error. I can pull the page in phantomjs but working through it is a monster with phantom so I would rather use Zombie.

They have a script that detects browsers called badbrowser.psp which I think is getting called when accessing via zombie. If you try to run the page from localhost it redirects to badbrowser.psp as well. I've tried user agent strings, scripts and no scripts, etc...

Any ideas on getting around this? Do I just need to just give up and try to use phantom?

Here's the debug dump:

Zombie: GET https://my.screenname.aol.com/_cqr/login/login.psp?sitedomain=sns.webmail.aol.com&lang=en&locale=us&authLev=0&uitype=mini&siteState=ver%3a4|rt%3aSTANDARD|at%3aSNS|ld%3awebmail.aol.com|uv%3aAOL|lc%3aen-us|mt%3aAOL|snt%3aScreenName|sid%3a22e31aa7-4747-4133-9015-842e000780b6&seamless=novl&loginId=&_sns_width_=174&_sns_height_=196&_sns_fg_color_=373737&_sns_err_color_=C81A1A&_sns_link_color_=0066CC&_sns_bg_color_=FFFFFF&redirType=js&xchk=false => 418

418 unused

unused

The server encountered an internal error or
misconfiguration and was unable to complete
your request.

Please contact the server administrator,
admin@admin.com and inform them of the time the error occurred,
and anything you might have done that may have
caused the error.

More information about this error may be available
in the server error log.

Additionally, a 418 unused
error was encountered while trying to use an ErrorDocument to handle the request.