Termites may leave tiny, visible holes on the surface of your privacy fence. These holes may go further into the fence or diagonally near the surface. You will probably see a series of holes together in a grouping.