Well, I had an issue with this when working with crawljax and that was the solution. I've tested it a few times now and see that your code does not give me more than a few states. You can test it once with your previous code and once without my code in the SiteSimpleExample. I noticed that in none of your examples a maximum crawl time is specified. So, add the maximum crawl time and then run your own code. You will see it does not find any states but if you run it with what I have added, it will find the maximum states defined by the user.