Reversed the logic for logging this statement. Oops
Merge pull request #248 from afuna/fix-logging

Reversed the logic for logging this statement. Oops
(Bug 4855) Get the first non-DOOO entry when importing

Getting the latest entry via the protocol gives us the latest entry
according to eventtime (user-provided time) rather than logtime.
Sometimse this could be a DOOO entry, which then means that everything
after that DOOO entry will not be imported. So let's try to find the
first non-DOOO entry, as that will be the latest according to logtime.
Merge pull request #249 from afuna/import-dooo-first-entry-bug4855

(Bug 4855) Get the first non-DOOO entry when importing
Sphinx improvements, comment indexing

Performance improvements:

* Do not use AUTO_INCREMENT, use a better PRIMARY KEY that InnoDB that
reflects the data access patterns. (All accesses are either single-items
or groups-by-journal.)

* Use COMPRESS to save disk space.

* Don't copy entire journals every time something updates.

* Only copy once when imported -- at the end.

Functionality improvements:

* Add comment indexing and searching.

* Support delta indices for faster indexing cycles.

IMPORTANT: These changes are backwards-incompatible with search
installations. If you deploy this code, you will need to update
your database schema and delete the table and reimport (to get the
compression).
Make sphinx-copier status-line readable
Fix case where OpenIDs get underscores

URLs should have dashes. This is one case where that happens.
Fix miscellaneous Sphinx DB usage

These two codepaths use the Sphinx DB. The table changed.
(Bug 4871) rename search column journal_id to journalid
Merge pull request #251 from alierak/searchdb-bug4871

(Bug 4871) rename search column journal_id to journalid
(Bug 4855) Do not proceed when we fail

When we fail, cut it short. Don't continue.
Merge pull request #261 from afuna/fail-return-bug4855

(Bug 4855) Do not proceed when we fail
Add source data to copier jobs

This allows us to track where a copy job was scheduled from.

Patch by <user name="fu">.
Optimize the sphinx copier

The copier is now resilient and efficient against journals with huge
numbers of comments. It's slightly less efficient with huge numbers of
entries, but it still seems to work fine for all of DW's accounts.

Thanks to <user name="cfud"> and <user name="sixwordstories"> for making
this necessary. :-)