Cleanup, and then while debugging a test, noticed that sqlite3_busy_timeout doesn't retry a sqlite3_step for you automatically.  So that's a problem that I'll need to fix.
More notes to self.