added amazon sqs to system to allow parallel processing.