Add config option to settings.php

Also see next merge request