To remove a custom background, simply go to System Preferences and select Desktop & Screen Saver. From there, you can choose a different background or select a built-in background.