Track config admin dynamically (because I regularly forget to have it
started automatically)