Add notice API to check tokens (bug 916372)

This also adds a simple config system