Haberdashers sell hats and other furnishings for men. Milliners cater to women. They are called milliners because their wares used to come from Milan, a town once famous for textiles, but no one can tell for sure how haberdashers got their name. A town Haberdash did not exist in medieval Europe.