sunspot/sunspot — Issue #159: Unusable on moderately sized datasets
Author: surzycki
Created: 2012-01-06 11:15:25+00:00
State: open

Quick warning to anyone using this on larger datasets.

It is unusable.

The problem lays in the fact that any change to your models will invalidate your index, and sunspot or rather solr will no longer be able to find your model.

This is all fine and dandy if you have 300 models and indexing takes 5 minutes. However, if you have 16Million models and indexing takes a week (which it does regardless of your server configuration) this is certainly not the solution for you. Sunspot indexing needs a huge speed increase otherwise it is worthless in anything with more than a couple hundred thousand models

Perhaps I am missing something huge (please tell me I am missing something huge)