in addition there is a major dispute as to whether kiddushin and a get is required.
There are some such as Tosfos (Gittin 6a) which imply that the problem with pilegesh is maris ayin (rather than eishis ish) because people think she is an eishes ish.