DOI: 10.21950/laur3d
title: SLIMBRAIN Database: A Multimodal Image Database of In Vivo Human Brains for Tumor Detection.

description: &lt;p&gt;&lt;/p&gt;
&lt;p&gt;Project Description&lt;/p&gt;
&lt;p&gt;&lt;/p&gt;
&lt;p&gt;Hyperspectral imaging and machine learning have been employed in the medical field for classifying highly infiltrative brain tumors. Although existing HSI databases of in-vivo human brains are available, they present two main deficiencies. Firstly, the amount of labeled data is scarce and secondly, 3D-tissue information is unavailable. To address both issues, we present the SLIMBRAIN database, a multimodal image database of in-vivo human brains which provides HS brain tissue data within the 400-1000 nm spectrum, as well as RGB, depth and multi-view images. Two HS cameras, two depth cameras and different RGB sensors were used to capture images and videos from 193 patients. All data in the SLIMBRAIN database can be used in a variety of ways, for example to train ML models with more than 1 million HS pixels available and labeled by neurosurgeons, to reconstruct 3D scenes or to visualize RGB brain images with different pathologies, offering unprecedented flexibility for both the medical and engineering communities.&lt;/p&gt;
&lt;p&gt;&lt;/p&gt;
&lt;p&gt;--------------------------------&lt;/p&gt;
&lt;p&gt; Data Description&lt;/p&gt;
&lt;p&gt;--------------------------------&lt;/p&gt;
&lt;p&gt;&lt;/p&gt;
&lt;p&gt;The SLIMBRAIN database contains anonymous hyperspectral, depth and RGB image data from in-vivo, and also ex-vivo, human brains from 193 patients.&lt;/p&gt;
&lt;p&gt;&lt;/p&gt;
&lt;p&gt;SLIMBRAIN database. The available data are:&lt;/p&gt;
&lt;p&gt;&lt;/p&gt;
&lt;p&gt;- CalibrationFiles: 5 .zip files to calibrate hyperspectral data for the different SLIMBRAIN prototypes and 1 .zip file containing the intrinsic and extrinsic parameters for some cameras.&lt;/p&gt;
&lt;p&gt;&lt;/p&gt;
&lt;p&gt;- Datasets: 2 .zip files containing the patient's datasets for the snapshot and linescan hyperspectral cameras.&lt;/p&gt;
&lt;p&gt;&lt;/p&gt;
&lt;p&gt;- GroundTruthMaps: 2 .zip files containing the patient's ground-truths folders for the snapshot and linescan hyperspectral cameras.&lt;/p&gt;
&lt;p&gt;&lt;/p&gt;
&lt;p&gt;- PaperExperiments: 1 .zip files containing several files that store the patient IDs used for the results shown in the paper.&lt;/p&gt;
&lt;p&gt;&lt;/p&gt;
&lt;p&gt;- preProcessedImages: Several .zip files containing the hyperspectral pre-processed cubes for the snapshot and linescan hyperspectral cameras.&lt;/p&gt;
&lt;p&gt;&lt;/p&gt;
&lt;p&gt;- RawFiles: 193 .zip files containing the raw files acquired in the operating room for each of the 193 patients. These files contains the raw images from different cameras, videos and depth images.&lt;/p&gt;
&lt;p&gt;&lt;/p&gt;
&lt;p&gt;---------------------&lt;/p&gt;
&lt;p&gt; Notes&lt;/p&gt;
&lt;p&gt;---------------------&lt;/p&gt;
&lt;p&gt;&lt;/p&gt;
&lt;p&gt;To access the SLIMBRAIN Database, you need to fill, accept and sign the Data Usage Agreement terms. Then, you need to send it to us, using the emails included at the end of the document. We will evaluate your application and, if you are accepted, you will receive a confirmation email with the necessary steps to access the data.&lt;/p&gt;
&lt;p&gt;&lt;/p&gt;
&lt;p&gt;You can either find the Data Usage Agreement within this page or at https://slimbrain.citsem.upm.es. Then, you could access https://slimbrain.citsem.upm.es/search to filter the patients using the available online service provided by Research Center on Software Technologies and Multimedia Systems for Sustainability (CITSEM) and Fundación para la Investigación Biomédica del Hospital Universitario 12 de Octubre (FIBH12O).&lt;/p&gt;
&lt;p&gt;&lt;/p&gt;
&lt;p&gt;You could also use https://slimbrain.citsem.upm.es/files to see the raw data online without the need of downloading it.&lt;/p&gt;
&lt;p&gt;&lt;/p&gt;
&lt;p&gt;For further information, you can visit the official SLIMBRAIN database website at https://slimbrain.citsem.upm.es, where you can find Python software to manage the hyperspectral data provided.&lt;/p&gt;
&lt;p&gt;&lt;/p&gt;
&lt;p&gt;---------------------&lt;/p&gt;
&lt;p&gt; Files&lt;/p&gt;
&lt;p&gt;---------------------&lt;/p&gt;
&lt;p&gt;&lt;/p&gt;
&lt;p&gt;- CalibrationFiles:&lt;/p&gt;
&lt;p&gt;&lt;/p&gt;
&lt;p&gt;These files store the calibration files necessary for the hyperspectral data and depth cameras.&lt;/p&gt;
&lt;p&gt;&lt;/p&gt;
&lt;p&gt;Specifically, folders starting with a number indicate a hyperspectral calibration library with dark&lt;/p&gt;
&lt;p&gt;&lt;/p&gt;
&lt;p&gt;and white references at different working distances and tilt angles:&lt;/p&gt;
&lt;p&gt;&lt;/p&gt;
&lt;p&gt;- 1_Tripod_popoman: For the Ximea snapshot camera. Illumination done with the Dolan Jenner lamp and ambient fluorescent lamps turned on. Obtained in the operating room when empty.&lt;/p&gt;
&lt;p&gt;&lt;/p&gt;
&lt;p&gt;- 2_Prototype_laser: For the Ximea snapshot camera. Illumination done with the Dolan Jenner lamp and ambient fluorescent lamps turned on. Obtained in the operating room when empty.&lt;/p&gt;
&lt;p&gt;&lt;/p&gt;
&lt;p&gt;- 3_Protoype_lidar: For the Ximea snapshot and Headwall linescan cameras. Illumination done with the Dolan Jenner lamp and ambient fluorescent lamps turned on. Obtained in the operating room when empty.&lt;/p&gt;
&lt;p&gt;&lt;/p&gt;
&lt;p&gt;- 4_Prototype_lidar: For the Ximea snapshot and Headwall linescan cameras. Illumination done with the Osram lamp and ambient fluorescent lamps turned on. Obtained in the operating room when empty.&lt;/p&gt;
&lt;p&gt;&lt;/p&gt;
&lt;p&gt;- 5_Prototype_Kinect: For the Ximea snapshot and Headwall linescan cameras. Illumination done with the International Light lamp and ambient fluorescent lamps turned off. Obtained in the laboratory.&lt;/p&gt;
&lt;p&gt;&lt;/p&gt;
&lt;p&gt;Furthermore, the depth, RGB and HS sensor calibration files, including intrinsic, extrinsic and distortion&lt;/p&gt;
&lt;p&gt;&lt;/p&gt;
&lt;p&gt;parameters, are included as .json files in DepthCameraCalibrationFiles.&lt;/p&gt;
&lt;p&gt;&lt;/p&gt;
&lt;p&gt;- Datasets:&lt;/p&gt;
&lt;p&gt;&lt;/p&gt;
&lt;p&gt;These files stores each patient dataset with the spectral information of every labelled pixel. These are obtained from the coordinates of its corresponding ground-truth map and pre-processed cube, which have been labeled by the neurosurgeons using a labelling tool based on the Spectral Angle Map (SAM) metric. Patient datasets are available for the Ximea snapshot and Headwall linescan hyperspectral cameras.&lt;/p&gt;
&lt;p&gt;&lt;/p&gt;
&lt;p&gt;- GroundTruthMaps:&lt;/p&gt;
&lt;p&gt;&lt;/p&gt;
&lt;p&gt;These files stores each patient ground-truth map labeled by the neurosurgeons. The labelling tool is based on the Spectral Angle Map (SAM) metric as already used in existing hyperspectral in-vivo human brain databases. Patient ground-truth maps are available for the Ximea snapshot and Headwall linescan hyperspectral cameras.&lt;/p&gt;
&lt;p&gt;&lt;/p&gt;
&lt;p&gt;- PaperExperiments.zip:&lt;/p&gt;
&lt;p&gt;&lt;/p&gt;
&lt;p&gt;Contains 2 .txt files with the patient's IDs used for the experiments shown in the paper.&lt;/p&gt;
&lt;p&gt;&lt;/p&gt;
&lt;p&gt;- preProcessedImages:&lt;/p&gt;
&lt;p&gt;&lt;/p&gt;
&lt;p&gt;These files stores each patient hyperspectral pre-processed cube. These are obtained from the raw data included in the RawFiles folder and the described pre-processing chain applied to them. Patient pre-processed cubes are available for the Ximea snapshot and Headwall linescan hyperspectral cameras.&lt;/p&gt;
&lt;p&gt;&lt;/p&gt;
&lt;p&gt;- RawFiles:&lt;/p&gt;
&lt;p&gt;&lt;/p&gt;
&lt;p&gt;These files stores the raw files obtained in each of the operations. It can include hyperspectral data, RGB data and depth information for each patient ID. All data is anonimized to keep the privacy of each human patient.&lt;/p&gt;
description: Python
description: Files for this record are password protected. To request this password and access the SLIMBRAIN Database you must:
1) Fill, accept and sign the Data Usage Agreement terms.
2) Send the Data Usage Agreement document to us, using the emails included at the end of the document or by using the "Contact the owner" option, which appears in the upper right part of the interface.
3) Wait until we evaluate your application. This might take some days, but we will try to be as quick as possible.
4) If you are accepted, you will receive a confirmation email with the necessary steps to access the data.

You can either find the Data Usage Agreement within this page or at https://slimbrain.citsem.upm.es.

If you have been granted access, you can use two online services provided by Research Center on Software Technologies and Multimedia Systems for Sustainability (CITSEM) and Fundación para la Investigación Biomédica del Hospital Universitario 12 de Octubre (FIBH12O).
1) Filter the patients using: https://slimbrain.citsem.upm.es/search
2) See the raw data and images of brains online without the need of downloading it accessing: https://slimbrain.citsem.upm.es/files

For further information, you can visit the official SLIMBRAIN database website at https://slimbrain.citsem.upm.es, where you can find Python software to manage the hyperspectral data provided.