Handle heroku addons

~~Still a wip, but I want to give it some visibility~~

Ready to be reviewed!

- [ ] Update dynosaur rails too
We should make this parallel at some point