Clean up files leftover from Heroku buildpacks