vertica/Vertica-Hadoop-Connector — pull request #3 by billonahill (2013-01-24 18:59:33+00:00)
Title: Refactoring to imrove per-task transaction isolation.

This fixes existing bugs that cause duplicates when tasks die or are killed:
- Each executeBatch in a task is currently committed individually
- Currently the connection is implicitly committed during VerticaOutputFormat.close() which occurs during task kill

The fix includes:
- Setting autoCommit to false
- Handling commits and rollback in a new VerticaTaskOutputCommitter
- Adding ability to plug in a custom committer via mapred.vertica.output.committer. We plan to extend VerticaTaskOutputCommitter to implement custom table verification (and potentially manual rollback) in commitJob.