When loading config dynamically, return a promise that will not be fulfilled if a request is already outstanding