SlowGuess/NeurIPS_2023_OCR huggingface dataset:
7. Did you collect the data from the individuals in question directly, or obtain it via third parties or other sources (e.g., websites)?
- We collected data from Spotify and YouTube, not from artists directly.
8. Were the individuals in question notified about the data collection? If so, please describe (or show with screenshots or other information) how notice was provided, and provide a link or other access point to, or otherwise reproduce, the exact language of the notification itself.
- We did not notify any individuals about the data collection.
9. Did the individuals in question consent to the collection and use of their data? If so, please describe (or show with screenshots or other information) how consent was requested and provided, and provide a link or other access point to, or otherwise reproduce, the exact language to which the individuals consented.
- We link to publicly available music on Spotify and YouTube. We allow every artist contained in our dataset to have their entries removed upon request.
10. If consent was obtained, were the consenting individuals provided with a mechanism to revoke their consent in the future or for certain uses If so, please provide a description, as well as a link or other access point to the mechanism (if appropriate).
- Artists have the possibility to search our dataset for their YouTube video links, and their Spotify artist IDs and track IDs. If artists wish to remove their content from YouTube or Spotify, they can contact those parties or remove it themselves; this would result in our links becoming invalid. Additionally, we allow artists to contact us at disco.dataset@ethz.ch to request the removal of their datapoints.
11. Has an analysis of the potential impact of the dataset and its use on data subjects (e.g., a data protection impact analysis) been conducted? If so, please provide a description of this analysis, including the outcomes, as well as a link or other access point to any supporting documentation.
- Yes, we discuss the implications of our data collection pipeline and of our dataset in Appendix I.
12. Any other comments?
1. Was any preprocessing/cleaning/labeling of the data done (e.g., discretization or bucketing, tokenization, part-of-speech tagging, SIFT feature extraction, removal of instances, processing of missing values)?
- We performed preprocessing by filtering, as described in Section 3.2. We do not process videos that are marked as age-restricted by YouTube, and we provide the explicit content flag from Spotify.
3. Is the software that was used to preprocess/clean/label the data available? If so, please provide a link or other access point.
- We use spotipy to access the Spotify API, youtuearchpython to query the YouTube search, and pytube to access the video on YouTube.
1. Has the dataset been used for any tasks already? If so, please provide a description.
2. Is there a repository that links to any or all papers or systems that use the dataset? If so, please provide a link or other access point.
3. What (other) tasks could the dataset be used for?
- We encourage the research community to use the dataset for music analysis, video analysis, music information retrieval, generative models for music, music genre recognition, as well as other possible downstream tasks enabled by the provided embeddings.
- Yes, as discussed in Section 5.
- We strongly advise to use DISCO-10M only for research purposes and not for commercial applications.
- Yes, the dataset will be open-source.
2. How will the dataset will be distributed (e.g., tarball on website, API, GitHub)?Does the dataset have a digital object identifier (DOI)?
- The dataset will be available on Hugging Face Datasets. DOI: 10.57967/hf/0754
Starting from 14.06.2023.
- We do not own the copyright of the music accessible through the provided links.
- Hugging Face Datasets will host the dataset and we will maintain the dataset.
- The authors can be contacted via disco.dataset@ethz.ch.
3. Is there an erratum? If so, please provide a link or other access point.
- Not initially, will be started when necessary, and will be documented with future releases.
- No, except for updates due to removal of dataset entries. Updates will be communicated on Hugging Face Datasets.
- Artists may contact us to have entries excluded from our dataset.
- There are no older versions of DISCO-10M.
- Updating and extending the dataset will be done on a case-by-case basis.