No, you do not have to worry about touching either the caterpillars, themselves or their silky tents. Eastern tent caterpillars do not sting. Nor is any irritation caused by touching their nests.