Yes, you can tell them apart by turning them upside down and counting the abdominal segments, starting at the hind legs. Female nymphs have five while males have six - the last of which is typically narrow and pointy compared to the female.