Get projects by screen scaping and filter for real projects

* filter for project type (i.e. not tags etc)
* filter out archived projects

* bit of refactoring to prevent downloading the page twice
* bit of refactoring in the debugging section, adding --raise to raise
  errors instead of logging them