Tap and die sets are primarily used on metal materials like steel, brass, aluminum, and cast iron. However, they can also be used on plastic and wood, depending on the specific tap and die set. It's essential to choose the appropriate set for the material you're working with to achieve the best results.