Whoops I just had to set the CORS policy on my S3 bucket