Fix exessive memory consumption
Proper settings resetting for SphinxSearch
select_posts and select_comments were doing exactly the opposite of what they were designed for
less verbose
New joining method for shingler's footprint - MD5 joining
assume arguments are already sets(or set-like objects) to reduce type casting overhead
back to workers that can load data into specified database + careful benchmarking of each step.
back to offering an option of loading data into separate database + nice descriptions to each task
benchmarking + hopefully last piece of fix for ambiguous document_id issue.
A little monkey patch to help debugging memory consumption and GC problems.
Remove RubyProf
Merge remote-tracking branch 'origin/master'

Conflicts:
	app/workers/load_data_worker.rb
	lib/tasks/ydata.rake
	lib/y_data_loader/loader.rb