# Hypernerf practice reproduction instruction
[Click to get back to Readme](README.md)
## before getting started

Python 3.8 and Python 3.9 has been tested to work flawlessly. Python 3.10 will fail.

### Colab

Important Information: in May 2023, colab is updated to python 3.10, in order for this reproduction to work, select tools- command palatte - use fallback runtime. 
This will change the runtime back to python 3.9.  <br>
The fallback runtime is supported until mid May 2023, after that, we could only use other tricks to change the colab python version. <br>
Colab TPU doesnot work here anymore, GPU runs flawlessly.


### local machine

Start with python 3.8 or python 3.9

Install the following:

    sudo apt-get install libilmbase-dev libopenexr-dev ffmpeg
    
Follow official colmap project to install with cuda support, or use default package manager to install colmap, but might only has cpu support.

Then install pip requirements:

    wget https://raw.githubusercontent.com/xieyizheng/hypernerf/main/requirements.txt
    pip install -r requirements.txt

With this, everything is set! The Processing, Training and Rendering notebooks should now work!

## using the notebooks

There are three notebooks: Processing, Training and Rendering. <br>
- Processing turn raw video into Dataset
- Training turn Dataset into a experiment/checkpoint
- Rendering load a checkpoint and render desired video

For our custom scenes, we can start at any notebook, just set the correct **data_dir** and **experiment_dir** at the beginning. <br>
For rendering from an existing experiment/checkpoint, also edit the **config.gin** and set the correct **data_dir** before rendering.

Important hyperparameters: image_scale & batch_size

While rendering: setting the "ambient dimension"/"time axis" coordinates correctly to get the desired result. This was not documented in the original notebook.


# Dataset&checkpoint Download:
All in one:<br>https://huggingface.co/datasets/xieyizheng/hypernerf_custom_scenes/resolve/main/custom_scenes_all.zip

Separately:<br>https://huggingface.co/datasets/xieyizheng/hypernerf_custom_scenes/tree/main