The amount of time it takes to build a privacy wall depends on the size and type of materials being used. Generally, wood is the quickest material to install, taking anywhere from a few hours to a day or two. Vinyl and metal will typically require more labor-intensive installation processes and may take several days to complete.