This is down to the shape. Apparently, they are supposed to represent a woman's delicate, thin fingers. Cakes made with ladyfingers are considered a rare bakery delicacy. These were introduced to the US when the first French settlers came over.