Wear what is comfortable but appropriate to the conditions you are likely to encounter if you were to have to ditch.  If you are expecting cold water, wear cold weather gear underneath.  However, you can wear as much or as little as you deem appropriate.  Unlike a wet suit, these suits are not form fitting and are not designed to be.  If they were tight, they would be impossible to put on in an emergency.