SlowGuess/NeurIPS_2023_OCR huggingface dataset:
Yes, the raw data, including the raw recordings of the sine sweeps, the un-adjusted recordings of the music, and the recorded loopback signals, are provided alongside the main preprocessed dataset at https://masonlwang.com/soundcam/.
Is the software used to preprocess/clean/label the instances available?
Yes, the online repository for the source code is reachable by a link from the project page https://masonlwang.com/soundcam/
E.5 Uses
We have only used the dataset for the tasks described in this paper.
Once others begin to use this dataset and cite it, we will maintain a list of selected uses at https: //masonlwang.com/soundcam/
Although we have documented the most apparent use cases, the dataset could be used for other tasks. For instance, it should be noted that the data collection process was conducted such that each data point collected with recorded music is paired with a room impulse response, where the human is standing at the same location. This could potentially be used to estimate room impulse responses from natural signals, like music. Furthermore, as mentioned in the Limitations and Conclusions, we collect scans of each room such that the dataset could be used to validate frameworks which simulate room acoustics from their 3D geometry.
Is there anything about the composition of the dataset or the way it was collected and preprocessed/cleaned/labeled that might impact future uses? For example, is there anything that a future
user might need to know to avoid uses that could result in unfair treatment of individuals or groups (e.g., stereotyping, quality of service issues) or other undesirable harms (e.g., financial harms, legal risks). If so, please provide a description. Is there anything a future user could do to mitigate these undesirable harms?
Users of the dataset should be aware of the distribution of shapes and sizes of the humans used to collect the data. Scans of each human are provided in the dataset itself, which should provide information about the sizes and shapes of the individuals in the dataset. As a brief summary, the humans used in the dataset are between the ages of 22 and 30, between  $157\mathrm{cm}$  and  $183\mathrm{cm}$  tall, and represent a diverse set of genders and ethnicities. However, there are only five humans, inescapably limiting the diversity from representing the human population. The dataset should be considered a starting point for developing methods to track, identify, and detect humans, but methods developed using SOUNDCAM should not be assumed to generalize perfectly to the wide variety of human shapes in the world.
Yes, as mentioned in our Introduction, our dataset should not be used for tasks which involve covert tracking of non-consenting individuals for any applications in surveillance, etc. We believe that releasing this dataset to the academic community will inform more people to be cognizant of this potential misuse. Furthermore, we believe that we and the rest of the academic community can use our data to develop some robust defenses against such misuses.
E.6 Distribution
Yes, the dataset is publicly available and on the internet.
The dataset can be reached from the project page https://masonlwang.com/soundcam/. It also has a DOI and can alternatively be reached at https://doi.org/10.25740/xq364hd5023.
The dataset is available for download at https://masonlwang.com/soundcam/. We will await reviewer feedback before announcing this more publicly.
We distribute it under the MIT License, as described at https://opensource.org/licenses/MIT/.
We collect all data ourselves and therefore have no third parties with IP-based restrictions on the data.
E.7 Maintenance
Who is supporting/hosting/maintaining the dataset?
The dataset is hosted/maintained indefinitely in the Stanford Digital Repository at https://doi.org/10.25740/xq364hd5023, where both Mason Wang and Samuel Clarke have listed their contact information for inquiries.
Mason Wang can be contacted at ycda@stanford.edu, and Samuel Clarke can be contacted at spclarke@stanford.edu.
There is currently no erratum, but if there are any errata in the future, we will publish them on the website at https://masonlwang.com/soundcam/
To the extent that we notice errors, they will be fixed and the dataset will be updated.
There are no limits on the retention of the data associated with the instances.
We will maintain older versions of the dataset for consistency with the figures in this paper. These will be posted on a separate section on our website, in the event that older versions become necessary.
We will accept extensions to the dataset as long as they follow the procedures we outline in this paper. We will check recordings to make sure that recordings and room impulse responses are properly time-adjusted and have a good signal to noise ratio. We will label these extensions as such from the rest of the dataset and credit those who collected the data. The authors of SOUNDCAM should be contacted about incorporating extensions.
The dataset will be maintained indefinitely on the Stanford Digital Repository.