DOI: 10.5281/zenodo.4774190
title: QUARTET DATASET

description: <strong>About the dataset</strong> The dataset contains 96 multimodal recordings of string quartet performance. Acquired data includes the audio of each performance in separate tracks: up to two ambient tracks and individual tracks acquired through contact microphones. In addition, each recording includes instrumental motion capture and a set of derived instrumental bowing descriptors for each performer, upper body movement for each performer, as well as high-quality video. The recordings were carried out as part of the experiments on ensemble performance inter-dependence reported in the following doctoral dissertation: Papiotis, P. (2015). A computational approach to studying interdependence in string quartet performance. <em>Ph.D. Thesis</em>, Universitat Pompeu Fabra. For further information about the multimodal representation refer to: Maestre, Esteban and Papiotis, Panagiotis and Marchini, Marco and Llimona, Quim and Mayor, Oscar and Pérez, Alfonso and Wanderley, Marcelo M, "Enriched Multimodal Representations of Music Performances: Online Access and Visualization," in <em>IEEE MultiMedia</em>, vol. 24, no. 1, pp. 24-34, Jan.-Mar. 2017, doi: 10.1109/MMUL.2017.3. <strong>License</strong> Dataset compiled and authored by Esteban Maestre, Panos Papiotis, Marco Marchini and Alfonso Perez. Copyright © 2015 Music Technology Group, Universitat Pompeu Fabra. All Rights Reserved.<br> <br> The QUARTET dataset is offered free of charge for internal non-commercial use only. You may not redistribute, publically communicate or modify it, unless expressly permitted by the Universitat Pompeu Fabra (UPF) or by applicable law. The individual contents of the dataset may be protected by copyright, and a non-transferrable limited license to reproduce and use the same is granted for the indicated purpose only.<br> <br> The dataset and its contents are made available on an “as is” basis and without warranties of any kind, including without limitation satisfactory quality and conformity, merchantability, fitness for a particular purpose, accuracy or completeness, or absence of errors. Subject to any liability that may not be excluded or limited by law, the UPF is not liable for, and expressly excludes, all liability for loss or damage however and whenever caused to anyone by any use of the QUARTET dataset or any part of it. <strong>Structure of the dataset</strong> Initially, we created a RepoVizz datapack for each of the recordings which can be browsed at: http://repovizz.upf.edu. We strongly recommend using RepoVizz for sensor visualization. Both in the RepoVizz platform and in this zenodo repository each datapack/subdirectory has an XML file where all the included files are described. To use all of the advanced functionalities of RepoVizz (including WebGL 3D visualization), it is recommended to use Chrome. For further information about the RepoVizz platform see the tutorial. Each recording contains a number of data files corresponding to the various data modalities captured in the experiment. The files are organized inside the datapack structure (sub-directories) in the following nodes: An <em>AudioGroup</em> node, containing the recorded audio from each of the utilized microphones (a cardioid microphone, a binaural microphone, and one bridge pickup microphone per performer) Each audio recording is accompanied by an AudioDesc node, containing the audio features extracted using the Essentia library. A <em>VideoGroup</em> node, containing the recorded HQ video A <em>Score</em> node, containing the note onset and offset times for the audio of each instrument as they were obtained by the score-performance alignment A <em>DescriptorGroup</em> node, containing the instrumental gesture features for each instrument computed from data acquired using the wired motion capture system A <em>MoCapGroup</em> node, containing the raw 6DOF (position & orientation) data acquired using the Polhemus wired motion capture system A <em>MoCapGroup</em> node, containing the upper body marker data, instrument marker data, and bow marker data acquired using the Qualisys optical motion capture system As a result of errors during the recording (especially in regard to the optical motion capture software and the video camera), some datapacks may not contain all of the above nodes. Audio recordings, score-performance alignment, instrumental gesture features and raw motion capture data from the wired system are present in all datapacks. In the list of recording below, we denote the contents of each recording as follows: <strong>A</strong> for audio, <strong>S</strong> for score-performance alignment, <strong>P</strong> for wired motion capture data, <strong>Q</strong> for wireless motion capture data, and <strong>V</strong> for video. By accessing the database, you accept the conditions of use. The datapacks can be found in the list below. <strong>List of recordings</strong> I1S1 - Intonation Exercise 1 Solo violin 1 [<strong>A</strong>|<strong>S</strong>|<strong>P</strong>|<strong>Q</strong>|V] I1S2 - Intonation Exercise 1 Solo violin 2 [<strong>A</strong>|<strong>S</strong>|<strong>P</strong>|<strong>Q</strong>|V] I1S3 - Intonation Exercise 1 Solo viola [<strong>A</strong>|<strong>S</strong>|<strong>P</strong>|Q|V] I1S4 - Intonation Exercise 1 Solo cello [<strong>A</strong>|<strong>S</strong>|<strong>P</strong>|Q|V] I1E1 - Intonation Exercise 1 Ensemble (no annotations) [<strong>A</strong>|<strong>S</strong>|<strong>P</strong>|Q|V] I1E2 - Intonation Exercise 1 Ensemble (with annotations) [<strong>A</strong>|<strong>S</strong>|<strong>P</strong>|Q|V] IP1S1 - Intonation Piece excerpt 1 Solo violin 1 [<strong>A</strong>|<strong>S</strong>|<strong>P</strong>|<strong>Q</strong>|<strong>V</strong>] IP1S2 - Intonation Piece excerpt 1 Solo violin 2 [<strong>A</strong>|<strong>S</strong>|<strong>P</strong>|<strong>Q</strong>|V] IP1S3 - Intonation Piece excerpt 1 Solo viola [<strong>A</strong>|<strong>S</strong>|<strong>P</strong>|Q|<strong>V</strong>] IP1S4 - Intonation Piece excerpt 1 Solo cello [<strong>A</strong>|<strong>S</strong>|<strong>P</strong>|<strong>Q</strong>|<strong>V</strong>] IP1E - Intonation Piece excerpt 1 Ensemble [<strong>A</strong>|<strong>S</strong>|<strong>P</strong>|<strong>Q</strong>|<strong>V</strong>] IP2S1/DP2S1 - Intonation / Dynamics Piece excerpt 2 Solo violin 1 [<strong>A</strong>|<strong>S</strong>|<strong>P</strong>|Q|V] IP2S2/IP2S2 - Intonation / Dynamics Piece excerpt 2 Solo violin 2 [<strong>A</strong>|<strong>S</strong>|<strong>P</strong>|<strong>Q</strong>|V] IP2S3/DP2S3 - Intonation / Dynamics Piece excerpt 2 Solo viola [<strong>A</strong>|<strong>S</strong>|<strong>P</strong>|<strong>Q</strong>|V] IP2S4/DP2S4 - Intonation / Dynamics Piece excerpt 2 Solo cello [<strong>A</strong>|<strong>S</strong>|<strong>P</strong>|<strong>Q</strong>|<strong>V</strong>] IP2E/DP2E - Intonation / Dynamics Piece excerpt 2 Ensemble [<strong>A</strong>|<strong>S</strong>|<strong>P</strong>|<strong>Q</strong>|V] D1S1 - Dynamics Exercise 1 Solo violin 1 [<strong>A</strong>|<strong>S</strong>|<strong>P</strong>|<strong>Q</strong>|V] D1S2 - Dynamics Exercise 1 Solo violin 2 [<strong>A</strong>|<strong>S</strong>|<strong>P</strong>|<strong>Q</strong>|V] D1S3 - Dynamics Exercise 1 Solo viola [<strong>A</strong>|<strong>S</strong>|<strong>P</strong>|<strong>Q</strong>|V] D1S4 - Dynamics Exercise 1 Solo cello [<strong>A</strong>|<strong>S</strong>|<strong>P</strong>|<strong>Q</strong>|V] D1E - Dynamics Exercise 1 Ensemble [<strong>A</strong>|<strong>S</strong>|<strong>P</strong>|<strong>Q</strong>|V] D2S1 - Dynamics Exercise 2 Solo violin 1 [<strong>A</strong>|<strong>S</strong>|<strong>P</strong>|<strong>Q</strong>|V] D2S2 - Dynamics Exercise 2 Solo violin 2 [<strong>A</strong>|<strong>S</strong>|<strong>P</strong>|<strong>Q</strong>|V] D2S3 - Dynamics Exercise 2 Solo viola [<strong>A</strong>|<strong>S</strong>|<strong>P</strong>|<strong>Q</strong>|V] D2S4 - Dynamics Exercise 2 Solo cello [<strong>A</strong>|<strong>S</strong>|<strong>P</strong>|<strong>Q</strong>|V] D2E - Dynamics Exercise 2 Ensemble [<strong>A</strong>|<strong>S</strong>|<strong>P</strong>|Q|<strong>V</strong>] DP1S1 - Dynamics Piece excerpt 1 Solo violin 1 [<strong>A</strong>|<strong>S</strong>|<strong>P</strong>|<strong>Q</strong>|V] DP1S2 - Dynamics Piece excerpt 1 Solo violin 2 [<strong>A</strong>|<strong>S</strong>|<strong>P</strong>|Q|V] DP1S3 - Dynamics Piece excerpt 1 Solo viola [<strong>A</strong>|<strong>S</strong>|<strong>P</strong>|<strong>Q</strong>|<strong>V</strong>] DP1S4 - Dynamics Piece excerpt 1 Solo cello [<strong>A</strong>|<strong>S</strong>|<strong>P</strong>|<strong>Q</strong>|<strong>V</strong>] DP1E - Dynamics Piece excerpt 1 Ensemble [<strong>A</strong>|<strong>S</strong>|<strong>P</strong>|<strong>Q</strong>|V] T1S1 - Timbre exercise Solo violin 1 [<strong>A</strong>|<strong>S</strong>|<strong>P</strong>|<strong>Q</strong>|V] T1S2 - Timbre exercise Solo violin 2 [<strong>A</strong>|<strong>S</strong>|<strong>P</strong>|<strong>Q</strong>|V] T1S3 - Timbre exercise Solo viola [<strong>A</strong>|<strong>S</strong>|<strong>P</strong>|<strong>Q</strong>|V] T1S4 - Timbre exercise Solo cello [<strong>A</strong>|<strong>S</strong>|<strong>P</strong>|<strong>Q</strong>|V] T1E - Timbre exercise Ensemble [<strong>A</strong>|<strong>S</strong>|<strong>P</strong>|<strong>Q</strong>|<strong>V</strong>] R1S1 - Rhythm exercise 1 Solo violin 1 [<strong>A</strong>|<strong>S</strong>|<strong>P</strong>|<strong>Q</strong>|V] R1S2 - Rhythm exercise 1 Solo violin 2 [<strong>A</strong>|<strong>S</strong>|<strong>P</strong>|<strong>Q</strong>|V] R1S3 - Rhythm exercise 1 Solo viola [<strong>A</strong>|<strong>S</strong>|<strong>P</strong>|<strong>Q</strong>|V] R1S4 - Rhythm exercise 1 Solo cello [<strong>A</strong>|<strong>S</strong>|<strong>P</strong>|<strong>Q</strong>|V] R1E - Rhythm exercise 1 Ensemble [<strong>A</strong>|<strong>S</strong>|<strong>P</strong>|<strong>Q</strong>|<strong>V</strong>] R2S1 - Rhythm exercise 2 Solo violin 1 [<strong>A</strong>|<strong>S</strong>|<strong>P</strong>|<strong>Q</strong>|V] R2S2 - Rhythm exercise 2 Solo violin 2 [<strong>A</strong>|<strong>S</strong>|<strong>P</strong>|<strong>Q</strong>|V] R2S3 - Rhythm exercise 2 Solo viola [<strong>A</strong>|<strong>S</strong>|<strong>P</strong>|<strong>Q</strong>|V] R2S4 - Rhythm exercise 2 Solo cello [<strong>A</strong>|<strong>S</strong>|<strong>P</strong>|<strong>Q</strong>|V] R2E - Rhythm exercise 2 Ensemble [<strong>A</strong>|<strong>S</strong>|<strong>P</strong>|Q|<strong>V</strong>] RP1S1 - Rhythm excerpt 1 Solo violin 1 [<strong>A</strong>|<strong>S</strong>|<strong>P</strong>|<strong>Q</strong>|<strong>V</strong>] RP1S2 - Rhythm excerpt 1 Solo violin 2 [<strong>A</strong>|<strong>S</strong>|<strong>P</strong>|<strong>Q</strong>|V] RP1S3 - Rhythm excerpt 1 Solo viola [<strong>A</strong>|<strong>S</strong>|<strong>P</strong>|<strong>Q</strong>|V] RP1S4 - Rhythm excerpt 1 Solo cello [<strong>A</strong>|<strong>S</strong>|<strong>P</strong>|<strong>Q</strong>|<strong>V</strong>] RP1E - Rhythm excerpt 1 Ensemble [<strong>A</strong>|<strong>S</strong>|<strong>P</strong>|Q|V] RP2S1 - Rhythm excerpt 2 Solo violin 1 [<strong>A</strong>|<strong>S</strong>|<strong>P</strong>|<strong>Q</strong>|<strong>V</strong>] RP2S2 - Rhythm excerpt 2 Solo violin 2 [<strong>A</strong>|<strong>S</strong>|<strong>P</strong>|<strong>Q</strong>|V] RP2S3 - Rhythm excerpt 2 Solo viola [<strong>A</strong>|<strong>S</strong>|<strong>P</strong>|<strong>Q</strong>|V] RP2S4 - Rhythm excerpt 2 Solo cello [<strong>A</strong>|<strong>S</strong>|<strong>P</strong>|<strong>Q</strong>|<strong>V</strong>] RP2E - Rhythm excerpt 2 Ensemble [<strong>A</strong>|<strong>S</strong>|<strong>P</strong>|Q|V] U1S1 - Unity of Execution exercise 1 Solo violin 1 [<strong>A</strong>|<strong>S</strong>|<strong>P</strong>|<strong>Q</strong>|V] U1S2 - Unity of Execution exercise 1 Solo violin 2 [<strong>A</strong>|<strong>S</strong>|<strong>P</strong>|<strong>Q</strong>|V] U1S3 - Unity of Execution exercise 1 Solo viola [<strong>A</strong>|<strong>S</strong>|<strong>P</strong>|Q|V] U1S4 - Unity of Execution exercise 1 Solo cello [<strong>A</strong>|<strong>S</strong>|<strong>P</strong>|<strong>Q</strong>|V] U1E - Unity of Execution exercise 1 Ensemble [<strong>A</strong>|<strong>S</strong>|<strong>P</strong>|Q|<strong>V</strong>] U2S1 - Unity of Execution exercise 2 Solo violin 1 [<strong>A</strong>|<strong>S</strong>|<strong>P</strong>|<strong>Q</strong>|V] U2S2 - Unity of Execution exercise 2 Solo violin 2 [<strong>A</strong>|<strong>S</strong>|<strong>P</strong>|<strong>Q</strong>|V] U2S3 - Unity of Execution exercise 2 Solo viola [<strong>A</strong>|<strong>S</strong>|<strong>P</strong>|<strong>Q</strong>|V] U2S4 - Unity of Execution exercise 2 Solo cello [<strong>A</strong>|<strong>S</strong>|<strong>P</strong>|<strong>Q</strong>|V] U2E - Unity of Execution exercise 2 Ensemble [<strong>A</strong>|<strong>S</strong>|<strong>P</strong>|<strong>Q</strong>|<strong>V</strong>] UP1S1 - Unity of Execution excerpt 1 Solo violin 1 [<strong>A</strong>|<strong>S</strong>|<strong>P</strong>|<strong>Q</strong>|<strong>V</strong>] UP1S2 - Unity of Execution excerpt 1 Solo violin 2 [<strong>A</strong>|<strong>S</strong>|<strong>P</strong>|<strong>Q</strong>|V] UP1S3 - Unity of Execution excerpt 1 Solo viola [<strong>A</strong>|<strong>S</strong>|<strong>P</strong>|<strong>Q</strong>|V] UP1S4 - Unity of Execution excerpt 1 Solo cello [<strong>A</strong>|<strong>S</strong>|<strong>P</strong>|<strong>Q</strong>|<strong>V</strong>] UP1E - Unity of Execution excerpt 1 Ensemble [<strong>A</strong>|<strong>S</strong>|<strong>P</strong>|Q|V] UP2S1 - Unity of Execution excerpt 2 Solo violin 1 [<strong>A</strong>|<strong>S</strong>|<strong>P</strong>|<strong>Q</strong>|<strong>V</strong>] UP2S2 - Unity of Execution excerpt 2 Solo violin 2 [<strong>A</strong>|<strong>S</strong>|<strong>P</strong>|<strong>Q</strong>|V] UP2S3 - Unity of Execution excerpt 2 Solo viola [<strong>A</strong>|<strong>S</strong>|<strong>P</strong>|<strong>Q</strong>|V] UP2S4 - Unity of Execution excerpt 2 Solo cello [<strong>A</strong>|<strong>S</strong>|<strong>P</strong>|<strong>Q</strong>|<strong>V</strong>] UP2E - Unity of Execution excerpt 2 Ensemble [<strong>A</strong>|<strong>S</strong>|<strong>P</strong>