Adds nullmailer run and supervisor configuration.