TITLE: High Resolution &#34;DIY&#34; Photogrammetry - &#39;HRP&#39; Protocol
AUTHORS: Yu Tang, Jacopo Niccolo  Cerasoni, Emily Yuko Hallett

[DESCRIPTION]
Photogrammetry is a method of calculating the three-dimensional shape of an object from a set of images. The advantages of Photogrammetry include the ability to record the shape of an object in a short time and with high accuracy without contact. In addition, the generated model can be displayed without textures. Here, the High Resolution Photogrammetry method is presented, which describes the use of photogrammetric techniques to take pictures and generate models. This method aims to give a comprehensive and extensive description for the development of high resolution 3D models, merging the well known techniques used in academic and computer graphic fields, allowing anyone to independently produce high resolution and quantifiable models for any need.

[BEFORE_START]
Note that this protocol is not presenting a novel photogrammetric method. We aimed to create an easy to follow step-by-step protocol which aims to cover the basics for anyone to learn photogrammetry and create high-resolution 3D models independently. For more detailed discussions and guides on academic and computer graphics photogrammetric applications see the following sources:

In English - 
1. Photogrammetric Applications for Cultural Heritage
        https://historicengland.org.uk/images-books/publications/photogrammetric-applications-for-cultural-heritage/
2. Photogrammetry in Paleontology - A practical guide
        https://www.jpaleontologicaltechniques.org/pasta3/JPT%20N12/Pdf/JPT_n012_Jul.pdf
3. A comparison of methods for creating 3D models of obsidian artifacts
        https://www.youtube.com/watch?v=g0YaWDrl5qI&ab_channel=RecordingArchaeology
4. Photogrammetry Workflow - Unity
        https://unity3d.com/files/solutions/photogrammetry/Unity-Photogrammetry-Workflow_2017-07_v2.pdf
5. Full Photogrammetry Guide for 3D Artists
        https://80.lv/articles/full-photogrammetry-guide-for-3d-artists/
6. RealityCapture tutorial: How to create your first 3D model | Part 1-4 (Multilingual Subtitles)
        https://www.youtube.com/watch?v=DTJq1Dz0nxY&ab_channel=CapturingReality
7. The Unbearable Lightness of Mystic "Exposure" Triangle
       https://www.fastrawviewer.com/blog/mystic-exposure-triangle
8. New Old Approach to Dynamic Range
       https://www.fastrawviewer.com/blog/determining-practical-dynamic-range

In Japanese [日本語で] - 
9. 3D Measurement of Lithic Artifacts, Towards Publication and Sharing of Results. [石器の3D計測、成果の公開・共有    を目指して] - Written by Atsushi Noguchi
        http://54.64.145.19/dspace/bitstream/11177/7014/1/data_science_salon01_009_014.pdf
10. 3D Technology and Archaeology [3D技術と考古学] - Book edited by Satoru Nakazono
        https://www.yuzankaku.co.jp/products/detail.php?product_id=8377
        https://www.yuzankaku.co.jp/user_data/special_3d.php *link to the stone tools models presented in the book*

Both academic and computer graphics fields apply photogrammetric processes for different reasons. Each field has its own advantages and disadvantages. For example, heritage preservation specialists rarely discuss the principles of computer graphics (CG), while the CG experts rarely discusses how to optimize the accuracy of scanning. Here we presented both sides into one single overarching method.
 

 


[GUIDELINES]
In the following protocol, typographical emphases and brackets have been used for software and in-text references.
They are: (1) main sub-steps and softwares in bold, e.g. Add imagery and Adobe Photoshop; (2) "software functions" in "quotation marks", e.g. "Copy correction settings"; (3) <keyboard buttons> in <angle markers>, e.g. <right click> or <Del>.

[STEPS]
SECTION: Setting Photographic Environment
1. Collect and prepare equipment.

 
 

 

SECTION: Setting Photographic Environment
2. Set the camera on a tripod.
 

SECTION: Setting Photographic Environment
3. Set the turntable on the table and set the items you want to scan on it, placing it as central as possible.
 

SECTION: Setting Lighting Environment
4. If using a turntable, lighting for photogrammetry does not need to be completely uniform (360 degrees), but you need to keep the front lighting as uniform as possible. Diffused lighting is also recommended.

Ring lights are a good choice, but you can also choose 2 or more LED lights set on the left and right sides of the camera.
 

  
  

SECTION: Camera Settings
6. RAW format (CR2, CRW, NEF, PEF...) is usually preferred for photogrammetry, this will provide a wider color gamut and more correct color calibration in post-processing.
 

SECTION: Camera Settings
7. Manual mode is usually selected because we want to have no difference in brightness during photography.
 

Manual mode is always suggested to use for photogrammetric purposes.
SECTION: Camera Settings
8. Aperture.

Regular Photogrammetry usually selects an aperture between F/5.6 and F/16. Different aperture sizes depend on the focal length and the size of the subject. Too small aperture will cause diffraction and reduce the quality of the photo, while too big aperture will reduce the depth of field.

Generally, for small objects an aperture of F/11 is suggested. Higher apertures such as F/16 are necessary in some cases if the object is too small, however this requires a high-quality lens (e.g. SEL90M28G) so to avoid diffraction.

 

SECTION: Camera Settings
9. Exposure. Setting exposure time and ISO

First set ISO to an optional value such as 200 (high ISO values will result in noisy images). Call up the histogram in the camera and try to shoot the object. Adjust the exposure time to the appropriate time so that the vertical part of the histogram representing the subject is in the middle and the highlighted part of the histogram.
 

 

  

SECTION: Camera Settings
9.1. Advanced methods of measuring exposure.

As the in camera histogram shows a preview image in JPG format, exposure should be directly evaluted on the RAW format photograph.

After taking a photograph, decoduing of the RAW photo to check the photograph's exposure is required.

To do so, Rawdigger can be used. To open a RAW photo on Rawdigger, hold down SHIFT to frame the object. Select
 on selection at the top left to select the histogram.

 
The following exposure method was developed following enhancement of the methods explicated in sources 7 and 8 (before start section).
 

 

SECTION: Camera Settings
10. Set white balance.

You can set an arbitrary white balance when taking pictures and adjust it in post-processing. If possible, use a gray card or color checker and adjust the white balance based on it in post-processing.
SECTION: Photography
11. METHOD 1 - If the object can be placed on a turntable, place the object on it and take a photograph inbetween slight rotations of the turntable (e.g. 15° or 30°). Repeat the process until the object ends in its original position (360°).
 

SECTION: Photography
11.1. Change the placement of the object onto the turntable to so show faces of the object which were not previously in frame (visible through the camera). Repeat step 11 for each placement of the object until you have photograph every face or side.
SECTION: Photography
13. Place the object on the turntable or holder, make sure it is centered on the turntable. The whole object should always be within the frame of the camera. 

Press the shutter by remote control and rotate the turntable. Repeat this operation until it rotates one circle. The angle of rotation can be smaller depending on the details of the subject. Ideally, a minimum of 18 times per rotation is preferred.

 
 

 
 

SECTION: Photography
14. General photography methods and ideas.

Because the basic way of photogrammetry's three-dimensional reconstruction is parallax, we need to take at least 2 photos of each surface of the subject. Therefore, before beginning the process, consider the following when photographing:

1. Imagine a regular polyhedron (e.g., a regular dodecahedron) and place the subject in its center. Subdivide the polyhedron so that each vertex of the subdivision will be the ideal camera position, with each camera facing the center.

2. Imagine a simplified object, place the camera vertically facing all the simplified faces, and all the edges for the shot.

  

SECTION: Photography
14.1. If the object is particularly reflective or shiny (e.g. obsidian), dusting or matting of the surface will be required. For more details, see video n. 3 in the "Before Start" section.
SECTION: Importing Photographs - RAW Processing
15. Open DxO Photolab (image processing software). You can also choose Adobe Photoshop, Adobe Lightroom or Capture One.
 

 

SECTION: Importing Photographs - RAW Processing
16. In the Photo Library, select the folder where the Raw format images are located. Double-click on any image to enter customize mode.

   

SECTION: Importing Photographs - RAW Processing
17. Increase Microcontrast.

  
SECTION: Importing Photographs - RAW Processing
18. Decrease Highlights, Midtones.

Increase Shadows, Blacks,

If necessary, adjust the exposure.

  
 

 

SECTION: Importing Photographs - RAW Processing
19. Set a value for White Balance.You can use the Pick Color tool to take the values from the gray card or from the neutral gray part.

  
SECTION: Importing Photographs - RAW Processing
20. Turn on "Denoising", if the ISO is not very high then the default value is usually very suitable.

  
SECTION: Importing Photographs - RAW Processing
21. Right-click on the photo and select "Copy correction settings" (<Ctrl+Shift+C>).
SECTION: Importing Photographs - RAW Processing
22. Press <Ctrl+A> at the same time to select all photos, right-click on the photo list below and select "Paste all correction settings" (<Crtl+Shift+V>).


SECTION: Importing Photographs - RAW Processing
23. Select "Export to Disk" at the bottom right of the screen to export the corrected photos. Usually JPEG is enough, but select 100 for Quality to get good quality.
SECTION: Importing Photographs - RAW Processing
24. Select a Path and export.

 
SECTION: Importing Photographs - RAW Processing
25. In general, photos used for photogrammetry do not require any other processing, and it is important to note that, no correction to lens distortion should be applied. This is because the distortion correction needs to be calculated together with the parallax calculation in the photogrammetry software.
SECTION: Photogrammetry Software Post-Processing
26. Open RealityCapture.

RealityCapture is a photogrammetry software that can generate 3D models from photographs or laser scans without seams. It has several payment options and a free version is available for educational institutions.
 


SECTION: Photogrammetry Software Post-Processing
27. Add imagery.

Drag and drop all photos or the folder to the software. Then you can see that all the pictures have been added to the software.
SECTION: Photogrammetry Software Post-Processing
27.1. If you use the same focal length, select on "Images" and then "Group button" at the bottom. Following this, all photos will be aligned with the same internal parameters.
SECTION: Photogrammetry Software Post-Processing
27.2. select the "ALIGNMENT TAB" and select "Settings" to see the alignment settings. In most cases, the default settings are fine.

SECTION: Photogrammetry Software Post-Processing
27.3. Generally, you just need to adjust the Image overlap to "Low" and select "Detector Sensitivity" depending on the surface texture of the object.

  

SECTION: Photogrammetry Software Post-Processing
28. Align Images.

Select "Align Images". If there are no problems with the photos, almost all of them will be aligned into one Component. If the alignment is not successful at once, you can select "Align Images" to align the remaining photos manually.

  

SECTION: Photogrammetry Software Post-Processing
28.1. To note, alignment is not always successful at the first try. When it fails, it is suggested to repeatedly attempt the allignment and practice. Experience and time spent practicing are key components to the successful allignment of complex objects.
SECTION: Photogrammetry Software Post-Processing
29. Reconstruction.

Select "MESH MODEL TAB" and select "Set Reconstruction Region" to define a region you want to reconstruct, you can also modify the region manually in the "3Ds" window.

  

SECTION: Photogrammetry Software Post-Processing
29.1. Select "Normal Detail" to reconstruct the model. You can also select "High Detail" to get maximum detail if you are using a digital camera and the ISO is not too high.
SECTION: Photogrammetry Software Post-Processing
29.2.  

SECTION: Photogrammetry Software Post-Processing
30. Simplification Model.

If the model has too many faces, you may get a message when the reconstruction is completed that Warning "Not enough video memory", however, this is just a display issue. Next, simplication of the model can be applied to make it more manageable and easier to view.

  
 

SECTION: Photogrammetry Software Post-Processing
30.1. Select "Simplify Tool" in the "TOOL TAB", it is recommended to select type to "Relative" and set the value to 25 or 50. The Relative method will preserve the maximum details.

 
SECTION: Photogrammetry Software Post-Processing
30.2. You can also choose "Part Merging" as "Create a singleton" (if the model is not very large).

 
SECTION: Photogrammetry Software Post-Processing
31. Generate a texture.

Select "MESH MODEL TAB" and <click> on "Color and Texture Settings".

 
 

SECTION: Photogrammetry Software Post-Processing
31.1. Usually the default settings of 8K texture and other settings are almost enough. If you don't need such a large map, you can also choose 4196 or 2048.

  
SECTION: Photogrammetry Software Post-Processing
31.2. Generate texture.

  
SECTION: Photogrammetry Software Post-Processing
32. Define scale.

Select "ALIGNMENT TAB" and select "Control Points".

 
SECTION: Photogrammetry Software Post-Processing
32.1. Select 2 separate photos. Click on at least 2 points, Point 0 and Point 1, on each of the 2 sets of photos.

  
SECTION: Photogrammetry Software Post-Processing
32.2. After adding "Control Point", click the green plus symbol in "1Ds" to activate the point and then check the accuracy of the point. If the accuracy is less than the expected value such as 1px, the point is not misplaced.

  
SECTION: Photogrammetry Software Post-Processing
32.3. Select "Create distance" in the "1Ds" window and select distance 0 to change the names of the two points A and B to Point 0 and Point 1.
SECTION: Photogrammetry Software Post-Processing
32.4. Set the Defined distance to the real distance.
SECTION: Photogrammetry Software Post-Processing
32.5. Click "Update" in the "ALIGNMENT TAB" to update to the actual size.

  
SECTION: Exporting Model
33. Select the model you want to export in Components.

SECTION: Exporting Model
34. Select "Export - Dense Mesh Model" in the "MESH MODEL TAB".
SECTION: Exporting Model
35. Set a file name and file format and in the next window select "Export Textures" as "Yes".
 

 

SECTION: Exporting Model
36. Click "OK" to finish exporting the model.

  

SECTION: Final Model
37.  
 

SECTION: Final Model
38. Final render video with texture:
 

Final render without texture:
 

SECTION: Final Model
39. Final 3D model with texture:
 

Final 3D model without texture:
 

SECTION: Final Model
40. Below, you can find the downloadable files of the final model:
 
Model in obj. format ->  
Model texture in .tiff format ->   

SECTION: Setting Photographic Environment
2.1. Choose a solid color for the background if possible (Black or white is recommended).
 

SECTION: Photographic Reference
5. The following steps (6-14) present photographic methods and theories which are fundamental for the correct capturing of photographs for photogrammetric purposes. Further detailed explanation for all the discussed techniques and functions can by consulting the "Small Object and Artefacts Photography" protocol (dx.doi.org/10.17504/protocols.io.b53zq8p6).
SECTION: Photography
12. METHOD 2 - If the object can't be placed properly onto different faces, change the height and position of the camera so to frame the object at different angles and take photographs in a circular motion. Repeat this action making sure to photograph the object's upper and lower face.
SECTION: Photography
12.1. When changing the height of the camera, it can also be moved closer to the object. This will make the distance between the camera and the object consistent.
SECTION: Photography
12.2.   

SECTION: Try doing it yourself!
41. Download the attached .zip file, and try following each step to produce your very own 3D model of this quartzite levallois core!

Start from Step 15 if you wish to start by processing the RAW images, or skip to Step 26 if you want to go straight to the photogrammetric processing!

  
(The following .zip file contains the original RAW images used for producing the 3D model presented in this protocol)