Make manifest updates more obvious

- [x] re-gen manifest as part of the default rake task
- [x] break CI if it's not updated