When choosing an email service provider (ESP), businesses should consider factors such as pricing, send volume, number of contacts, email design capabilities, automation features, target audience segmentation, and the ability to send transactional emails. It is important to choose an ESP that has a good infrastructure to ensure good email deliverability rates.