Interesting, I didn't know this was tried before. So maybe we could use the Celery workers to do the heavy lifting? Basically modify your script to instead of running for three days spawn celery tasks to do the same (maybe in bulk of a few documents) and it could be done quicker because in parallel?