xieyizheng
commited on
Commit
•
4469290
1
Parent(s):
02be77d
Update reproduction-instruction.md
Browse files- reproduction-instruction.md +45 -1
reproduction-instruction.md
CHANGED
@@ -1 +1,45 @@
|
|
1 |
-
#
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
# Hypernerf practice reproduction instruction
|
2 |
+
|
3 |
+
## before getting started
|
4 |
+
|
5 |
+
Python 3.8 and Python 3.9 has been tested to work flawlessly. Python 3.10 will fail.
|
6 |
+
|
7 |
+
### Colab
|
8 |
+
|
9 |
+
Important Information: in May 2023, colab is updated to python 3.10, in order for this reproduction to work, select tools- command palatte - use fallback runtime.
|
10 |
+
This will change the runtime back to python 3.9. <br>
|
11 |
+
The fallback runtime is supported until mid May 2023, after that, we could only use other tricks to change the colab python version. <br>
|
12 |
+
Colab TPU doesnot work here anymore, GPU runs flawlessly.
|
13 |
+
|
14 |
+
|
15 |
+
### local machine
|
16 |
+
|
17 |
+
Start with python 3.8 or python 3.9
|
18 |
+
|
19 |
+
Install the following:
|
20 |
+
|
21 |
+
sudo apt-get install libilmbase-dev libopenexr-dev ffmpeg
|
22 |
+
|
23 |
+
Follow official colmap project to install with cuda support, or use default package manager to install colmap, but might only has cpu support.
|
24 |
+
|
25 |
+
Then install pip requirements:
|
26 |
+
|
27 |
+
wget https://raw.githubusercontent.com/xieyizheng/hypernerf/main/requirements.txt
|
28 |
+
pip install -r requirements.txt
|
29 |
+
|
30 |
+
With this, everything is set! The Processing, Training and Rendering notebooks should now work!
|
31 |
+
|
32 |
+
## using the notebooks
|
33 |
+
|
34 |
+
There are three notebooks: Processing, Training and Rendering. <br>
|
35 |
+
- Processing turn raw video into Dataset
|
36 |
+
- Training turn Dataset into a experiment/checkpoint
|
37 |
+
- Rendering load a checkpoint and render desired video
|
38 |
+
|
39 |
+
For our custom scenes, we can start at any notebook, just set the correct data_dir and experiment_dir at the beginning. <br>
|
40 |
+
For rendering from a existing experiment/checkpoint, get into the config.gin and set the correct dir.
|
41 |
+
|
42 |
+
## Dataset Downloading:
|
43 |
+
- hand:
|
44 |
+
- dvd:
|
45 |
+
- tomato-mark:
|