It would somehow belittle our relationship, as though he wasn't enough for me. That isn't fair. The ending question has me a little confused about you getting the same respect. However, my thought on your comment is that you are miss understanding most men's fantasies. They aren't emotional and more often than not, they are not a comparitive thing.
Men fantasize about women, without any expectation that they are real.
This is very hard to explain. I will simply say this. I have been married 25 years. Yes, I have fantazied about women in those years. They are just pictures, ideas streaming through my head.