Added spot client with capability to get s3 url's to be processed