schema improvements

strip html from title/content fields

added kstem stemming

removed path,repo,url from _all search.

doubled weight of words in title
Merge branch 'master' into stemming
Merge pull request #24 from dgreisen-cfpb/stemming

schema improvements
Adds front end notes. Tweaks some formatting.
Merge pull request #29 from himedlooff/readme

Adds front end notes. Tweaks some formatting.
Merge pull request #28 from himedlooff/dev

Removes broken sourcemap option.
async index_all_repos
use soup strainer
asyncified create_bulk_data
added schema_user.json from previous commit
index_all_repos resets index; remove lots of cruft
removed page_url dump
Merge https://github.com/cfpb/github-wiki-search into stemming
sync.py from anywhere; document syncing
fixed user schema bugs
schema_user -> schema_autocomplete
autocomplete works

autocomplete returns total number of pages indexed for each repo/user

replaced requests with universalclient. I think it makes the code
easier to understand.

we only store the repo name, not the owner/name for autocomplete
because searching on slashes throws errors for some reason.

switched a bunch of for loops into generators to minimize memory.
meant getting rid of most of my progress indicators. Something to
try to put back in in future.

now two functions for creating bulk data - one for wiki pages,
one for autocomplete.

moved bulk data save back into index_all_repos since create_bulk_data
no longer creates all bulk data.

reset autocomplete index as well.
little fixes

job.value lists -> iterators

removed _repo_pages() early termination

github_api_client points to root of api.
Merge pull request #30 from dgreisen-cfpb/stemming

Stemming
forward 9200->9200 install es from rpm

forward elasticsearch from 9200->9200, rather than 8081

install elasticsearch from repo provided by elasticsearch.

got rid of apt-get installation.

removed schema installations since that is done by sync.py now.