Switched to using lxml to parse the html.