Shouldn't we pass `self` to the `before_configuration`?  I'm worried that the config hooks will run multiple times on the same app.  It seems we should either 1) only run the config hooks once, or 2) run the config hooks for each new app, but we should never run the config hooks for the same app many times.