A labial cyst can look like bumps under the skin surrounding the vagina. The bumps can differ in size and may feel tender and firm.