DOI: 10.57760/sciencedb.16988
title: Zibo BBQ 20230401-20230520 Weibo retrieval data set
title: 淄博烧烤20230401-20230520微博检索数据集

description: This data set crawls the search results on Weibo using "Zibo" as the keyword from April 1, 2023 to May 20, 2023, and stores the main data in single Weibo units. Incidentally, this data set crawls the visual information such as pictures and videos involved, and can be used for multi-modal data analysis. On this basis, we crawled the relevant information of the users involved and their historical Weibo accounts from March 1 to April 1 (if there are more than 100, only the latest 100 will be recorded).This data set can mainly be used in the fields of computer science and technology and information science-related fields.Document introduction:weibo.jsonl: The main file of this data set, which stores all search results.img: The image attached to the Weibo content in weibo.jsonl.media: videos and headline articles attached to Weibo content in weibo.jsonl.comment: The comment data of Weibo in weibo.jsonl is stored separately with mblogid as the file name.repost: The repost data of Weibo in weibo.jsonl is stored separately with mblogid as the file name.user.jsonl: user data in weibo.jsonl.history: Nearly 100 historical original Weibo posts by all users in user.jsonl from March 1st to April 1st.his_img: Pictures attached to Weibo content in history.Attention:Historical data does not crawl videosThis data set has not been labeledThe storage file name of the picture in history is the sha1 sum of the URL. For example, if the URL of a picture is "https://wx4.sinaimg.cn/orj1080/0089Iwyyly1hchn2d8m5fj30go137wjj.jpg", then its file name is "2d2bf9842cb1c0f8656709470abb1e20a08c13a7.jpg". Using in python like this: hashlib.sha1(str.encode(k)).hexdigest()+'.jpg'.
description: This data set crawls the search results on Weibo using "Zibo" as the keyword from April 1, 2023 to May 20, 2023, and stores the main data in single Weibo units. Incidentally, this data set crawls the visual information such as pictures and videos involved, and can be used for multi-modal data analysis. On this basis, we crawled the relevant information of the users involved and their historical Weibo accounts from March 1 to April 1 (if there are more than 100, only the latest 100 will be recorded).This data set can mainly be used in the fields of computer science and technology and information science-related fields.Document introduction:weibo.jsonl: The main file of this data set, which stores all search results.img: The image attached to the Weibo content in weibo.jsonl.media: videos and headline articles attached to Weibo content in weibo.jsonl.comment: The comment data of Weibo in weibo.jsonl is stored separately with mblogid as the file name.repost: The repost data of Weibo in weibo.jsonl is stored separately with mblogid as the file name.user.jsonl: user data in weibo.jsonl.history: Nearly 100 historical original Weibo posts by all users in user.jsonl from March 1st to April 1st.his_img: Pictures attached to Weibo content in history.Attention:Historical data does not crawl videosThis data set has not been labeledThe storage file name of the picture in history is the sha1 sum of the URL. For example, if the URL of a picture is "https://wx4.sinaimg.cn/orj1080/0089Iwyyly1hchn2d8m5fj30go137wjj.jpg", then its file name is "2d2bf9842cb1c0f8656709470abb1e20a08c13a7.jpg". Using in python like this: hashlib.sha1(str.encode(k)).hexdigest()+'.jpg'.