Pyrite forms underground in veins near sulfur sources and quartz. It often accompanies gold, copper, lead or zinc ore deposits. Most pyrite specimens are excavated from mines or found in quartz seams. Natural pyrite nuggets can also erode into alluvial deposits.