DOI: 10.6084/m9.figshare.31361668
title: crowdsourcing-data

description: Dataset Overview: User Task Participation and Social Fraud DetectionThis dataset contains records of user task participation, social network relationships, and related fraud detection information. It is designed for analyzing user behavior patterns, social network influences, and task completion outcomes. The data is stored in CSV format across 7 files.1. File Descriptions and Roles<b>final_data_all_with_result.csv (Master Data):</b> This is the final integrated dataset. It contains all user task participation information consolidated into a single file, along with outcome labels such as fraud indicators and completion status.<b>friend.csv (Social Relationship):</b> This file maps the friendship connections between users. It typically includes user IDs and their corresponding friend IDs, which are essential for constructing social network graphs.<b>msg.csv (Communication Log):</b> This contains the message exchange records between users. It includes details such as sender IDs, receiver IDs, and timestamps to track interaction frequency and timing.<b>nx_participation_temp.csv (Intermediate Data):</b> This is a temporary file generated using the NetworkX library. It is likely used for graph analysis or as a cache for specific feature engineering steps.<b>nx_task_fraud.csv (Task Fraud):</b> This file focuses on task-level fraud detection results. It contains task IDs paired with specific fraud metrics or risk scores.<b>participation.csv (Participation Record):</b> These are the core records of user activity. Each entry tracks a user’s involvement in a specific task, including the user ID, task ID, and the time of participation.<b>task.csv (Task Information):</b> This file defines the attributes of the tasks themselves, such as the task name, release time, and the reward amount offered for completion.2. Data Relationships and Integration<b>Task Linking:</b> The <code>participation.csv</code> file can be linked with <code>task.csv</code> via the Task ID to retrieve detailed attributes for every user action.<b>Social Network Construction:</b> <code>friend.csv</code> and <code>msg.csv</code> are used to build the user social graph. When combined with participation records, this allows for the analysis of social influence and group behavior.<b>Consolidated Variables:</b> <code>final_data_all_with_result.csv</code> serves as the primary integrated source, likely derived from merging the other files to include all final target variables (labels).<b>Graph Computation:</b> Files prefixed with <code>nx_</code> are intermediate processing files, specifically optimized for graph algorithm computations or temporary storage of network-based features.3. Usage Suggestions and Tools<b>Initial Analysis:</b> It is recommended to start your analysis with <code>final_data_all_with_result.csv</code>, as it provides the most comprehensive view of the data immediately.<b>Graph Modeling:</b> To build a user social network graph or detect "collusion" clusters, utilize <code>friend.csv</code> or <code>msg.csv</code>.<b>Task-Level Insights:</b> For analyzing which tasks are most prone to fraud, link <code>task.csv</code> with <code>nx_task_fraud.csv</code>.<b>Technical Stack:</b> We suggest using the <b>Python pandas</b> library for data manipulation and merging, and the <b>NetworkX</b> library for conducting complex social network analysis.