Do a dry run to try to get the s3_website jar to cache