Only build required directories