tumblr/collins — pull request #57 by DanSimon (2012-11-01 18:42:37+00:00)
Title: Dan solr rebased

This is the same branch as my dan-solr-part-deux, but ready for the rebased master branch.

This is a considerable refactoring and improvement to solr searching:

* CQL queries can be mixed with other selectors
* CQL queries work in remote asset searches
* New CQL Features
* Open, clopen range selects , eg num_disks = (0, 3) or [1,3) or [1,2]
* comparative operators, eg num_disks > 2, num_disks >= 1
* new "SELECT" format for selecting document type (assets, logs, etc)
* full solr reindex no longer deletes everything before starting, uses new INDEX_TIME field to handle removing dead documents
* Asset logs are now searchable with new CQL search interface (does not replace existing functionality...yet)
* using new full-text search analyser on log messages
* new collins client method search_logs, accepts hash with :query, :size, etc..
* new collin-shell endpoint for search_logs, same output format as other log methods
* Added interface for CQL queries to the web search form
* new admin endpoint to reindex single asset
* improved type checking, internal cleanup, tests

I'll have documentation updates soon to include log searching and new CQL features.

These updates require:

* new Solr schema deploy
* several new solr configuration files for full-text searching added to puppet
* collins-client gem version increment (I bumped the version but have not yet published the gem)
* full solr reindexing after collins deploy