Package: shift15m
[arXiv]The main motivation of the SHIFT15M project is to provide a dataset that contains natural dataset shifts collected from a web service IQON, which was actually in operation for a decade.
In addition, the SHIFT15M dataset has several types of dataset shifts, allowing us to evaluate the robustness of the model to different types of shifts (e.g., covariate shift and target shift).We provide theDatasheet for SHIFT15M.
This datasheet is based on theDatasheets for Datasets[1] template.SystemPython 3.6Python 3.7Python 3.8Linux CPULinux GPUWindows CPU / GPUStatus Currently UnavailableStatus Currently UnavailableStatus Currently UnavailableMac OS CPUSHIFT15M is a large-scale dataset based on approximately 15 million items accumulated by the fashion search service IQON.InstallationFrom PyPi$pipinstallshift15mFrom source$gitclonehttps://github.com/st-tech/zozo-shift15m.git
$cdzozo-shift15m
$poetrybuild
$pipinstalldist/shift15m-xxxx-py3-none-any.whlDownload SHIFT15M datasetUse Dataset classYou can download SHIFT15M dataset as follows:fromshift15m.datasetsimportNumLikesRegressiondataset=NumLikesRegression(root="./data",download=True)Download directly by using download scriptsPlease download the dataset as follows:$bashscripts/download_all.shTasksThe following tasks are now available:TasksTask typeShift type# of input dim# of output dimNumLikesRegressionregressiontarget shift(N, 25)(N, 1)SumPricesRegressionregressioncovariate shift, target shift(N, 1)(N, 1)ItemPriceRegressionregressiontarget shift(N, 4096)(N, 1)ItemCategoryClassificationclassificationtarget shift(N, 4096)(N, 7)Set2SetMatchingset-to-set matchingcovariate shift(N, 4096)x(M, 4096)(1)BenchmarksAs templates for numerical experiments on the SHIFT15M dataset, we have publishedexperimental results for each task with several models.Original Dataset StructureThe original dataset is maintained in json format, and a row consists of the following:{
  "user":{"user_id":"xxxx", "fav_brand_ids":"xxxx,xx,..."},
  "like_num":"xx",
  "set_id":"xxx",
  "items":[
    {"price":"xxxx","item_id":"xxxxxx","category_id1":"xx","category_id2":"xxxxx"},
    ...
  ],
  "publish_date":"yyyy-mm-dd",
  "tags": "tag_a, tag_b, tag_c, ..."
}ContributingTo learn more about making a contribution to SHIFT15M, please see the following materials:Developers GuideTask Proposal GuideBenchmark Proposal GuideLicenseThe dataset itself is provided under aCC BY-NC 4.0 license.
On the other hand, the software in this repository is provided under theMIT license.Dataset metadataThe following table is necessary for this dataset to be indexed by search engines such asGoogle Dataset Search.propertyvaluenameSHIFT15M DatasetalternateNameSHIFT15MalternateNameshift15m-dataseturlhttps://github.com/st-tech/zozo-shift15msameAshttps://github.com/st-tech/zozo-shift15mdescriptionSHIFT15M is a multi-objective, multi-domain dataset which includes multiple dataset shifts.providerpropertyvaluenameZOZO ResearchsameAshttps://ja.wikipedia.org/wiki/ZOZOlicensepropertyvaluenameCC BY-NC 4.0urlhttps://github.com/st-tech/zozo-shift15m/blob/main/LICENSE.CCErrata01/08/2022, added tags info (#187)Papers using this datasetPapadopoulos, Stefanos I., et al. "Multimodal Quasi-AutoRegression: Forecasting the visual popularity of new fashion products." arXiv preprint arXiv:2204.04014 (2022).Papadopoulos, Stefanos, et al. Fashion Trend Analysis and Prediction Model. 1, Zenodo, 2021, doi:10.5281/zenodo.5795089.References[1] Gebru, Timnit, et al. "Datasheets for datasets." arXiv preprint arXiv:1803.09010 (2018).