If the Space's "Banner position" is set to "- None -", ...

...don't override the site default banner - even if the Space has a banner image.