Stone can be mined from Gnat Mounds in the Painted Biome. However, you must watch out for Gnat Swarms will latch onto you and drain your Sanity, and Thunderbirds, which will shock you with electricity if you get too close to them. Alternatively, Stalagmites found in caves provide a source of Stone.