Cleanup: Move secret key to settings

This way we can document it, and having it along all the other
configurable settings makes it more difficult to forget about
altering its value on deployments.