Extract links normalized links, schemas used and  tags
Store parsed document in the "dom" attribute
user urlnorm to normalize urls
Added admin script to upload data files
graffle file for documentation images
ignore .DS_Store
Made queries more generic and SQL like. 

You can now select columns, group them,  aggregate and order results.
Render query results using ember-table
Move navigation and other default page elements to a layout and browse data in a tabular view.
Script for running debug instance under foreman

Usage:
$ foreman run /srv/surveyor/bin/python  run.py
begining of the insights switching
Added "insights" with the ability to edit them.
Merge branch 'master' of github.com:mozilla/caravela