Refactor settings module setup

I've split this out from the ``backend-refactor`` branch since it is truly unrelated.