Go to Appearance -> Customize -> Header Settings -> Website Logo. There you will see options to upload logo.
If you want to show just website name and description, remove the logo image and fill site title then select 'Display Site Title and Tagline' and publish.
Fevicon: Choose a square image of your logo to show a fevicon.