Use heroku's recommended static files solution (dj-static)
Whoops, forgot to disable s3 static files storage
Upgrade django and disable default serving of resources from S3