Add a feature to set a config option to basically hide the site behind
upgrading.php.