Set perform_deliveries to true in mailer settings