Not at all! Poly means more than one person, all committed and open to a multi-person relationship. This can take many forms, with dominant, equal, and occasional partners, so it's all up to you to explore what works best.