be able to switch to pulling from S3 if run on ec2 nodes