Only overwrite the necessary configuration keys