Issue #97 follow all hrefs

All anchor links with an `href` attribute are now followed, clickable or not. This is configurable from the Crawljax configuration. This fixes #97 

- This pull request also fixes #140 in 4de8c1f