Support loading from multiple config paths in order

This makes breaking changes to the API, so updating apps will need to be
coordinated/needs a version bump

The reason for the breaking change is that the config keys need to be ordered, otherwise you'll get faux-random config file precendence.