A purse might have originated from the time of "Hunters & Gatherers".  Women were expected to carry items on their backs.  In time these packs got smaller.