A Random Digit Search (RDS) Method for Sampling of Blogs and Other User-Generated Content
Blogs are arguably the most popular genre of user-generated content (UGC), which make blogs a gold mine for social science research. However, existing research on blogs has suffered from nonprobability samples collected either manually or by computerized crawling based on random walks method. The current article presents a probability sampling method for blogs, called random digit search (RDS), that is modified from the popular "random digit dialing" (RDD) method used in telephone surveys. The RDS method was tested in a study of Sina Blog, a popular blog service provider (BSP) in China. The results show that, while "random walks" sampling tends to oversample popular/active blogs, probability samples generated by RDS yield consistent and precise estimates of population parameters. Although the RDS takes advantage of the numeric identification (ID) system used on Sina Blog, the general principles may be applicable to other BSPs and many other genres of UGC.
random digit search random walks web sampling web crawling