If a hacker manages to get their hands on your email address there is a number of things they can do:
They have access to all your emails, where sensitive information might be stored.
They can reset the passwords on all services that are linked to said email address.
They can use it to send phishing links to your contacts.
They can mine any passwords and data about other services.