Much like your saw creates dust on the floor, termites may leave tiny piles of sawdust on the ground adjacent to your privacy fence. It takes a long time to gather sawdust of any large magnitude. But if you see a pile of sawdust about the size of a small anthill on the side of your privacy fence, you may have termites invading your privacy fence.