There might not be an option for that from the UI, it will depend on which theme your WordPress is using.
In that case, you will need to use custom CSS. You should check what classes the menu elements have and apply the styles you want.
For example, the menu items could have this class: menu-item, so in that case you need to add a CSS rule like this:
.menu-item:hover {
color: blue;
}