dn_splatter_metric_3d.md

DN-Splatter and Metric3D Installation

Note: Because our major dependencies, Nerfstudio and Grounded-SAM-2, officially support two different CUDA versions (11.8 vs. 12.1), we will have to create two separate environments. We hope to resolve this in the future when Nerfstudio bumps its official CUDA support version.

Clone our repo. Make sure to clone the submodule as well by using --recursive.

git clone --recursive https://github.com/ai4ce/FusionSense.git

Create the environment.

cd FusionSense

conda env create -f config.yml

conda activate fusionsense

Install compatible PyTorch and cuda-toolkit version:

pip install torch==2.1.2+cu118 torchvision==0.16.2+cu118 --extra-index-url https://download.pytorch.org/whl/cu118

conda install -c "nvidia/label/cuda-11.8.0" cuda-toolkit

Install mmcv:

pip install mmcv

Install tinycudann:

pip install ninja git+https://github.com/NVlabs/tiny-cuda-nn/#subdirectory=bindings/torch

Build the environment

pip install -e .

Note that this part of our codebase is largely modified from dn-splatter, so we did not modify their project name out of respect.

This environment is largely a mix of dn-splatter(doc) and Metric3D(doc). If you encounter any installation problem, in addition to posting an issue in this repo, you are welcome to checkout their repos as well.