added setting for allow to override magic base setting per spider