dashboard, bootstrap: Handle setting GITHUB_TOKEN in the app

This should wait until app has restarted to avoid an error on reload (e.g. 503)