cleanup XmlMessageSerializer
XmlMessageSerializer should throw for nested types

fixes #1233