Charset set for message is not respected

When a custom charset, like text/plain for text-only mails, is set, the
message is sent as text/html nonetheless, because the charset setting
from the SwiftMailer class is not respected.