DOI: 10.5281/zenodo.7742659
title: EOAD (Egocentric Outdoor Activity Dataset)

description: EOAD is a collection of videos captured by wearable cameras, mostly of sports activities. It contains both visual and audio modalities. It was initiated by the HUJI and FPVSum egocentric activity datasets. However, the number of samples and diversity of activities for HUJI and FPVSum were insufficient. Therefore, we combined these datasets and populated them with new YouTube videos. The selection of videos was based on the following criteria: The videos should not include text overlays. The videos should contain natural sound (no external music) The actions in videos should be continuous (no cutting the scene or jumping in time) Video samples were trimmed depending on scene changes for long videos (such as <em>driving</em>, <em>scuba diving</em>, and <em>cycling</em>). As a result, a video may have several clips depicting egocentric actions. Hence, video clips were extracted from carefully defined time intervals within videos. The final dataset includes video clips with a single action and natural audio information. Statistics for EOAD: <strong>30</strong> activities <strong>303</strong> distinct videos <strong>1392</strong> video clips <strong>2243</strong> minutes labeled videos clips The detailed statistics for the selected datasets and the crawled videos clips from YouTube are given below: <strong>HUJI</strong>: 49 distinct videos - 148 video clips for 9 activities (<em>driving</em>, <em>biking</em>, <em>motorcycle</em>, <em>walking</em>, <em>boxing</em>, <em>horse riding</em>, <em>running</em>, <em>skiing</em>, <em>stair climbing</em>) <strong>FPVSum</strong>: 39 distinct videos - 124 video segments for 8 activities (<em>biking</em>, <em>horse riding</em>, <em>skiing</em>, <em>longboarding</em>, <em>rock climbing</em>, <em>scuba</em>, <em>skateboarding</em>, <em>surfing</em>) <strong>YouTube</strong>: 216 distinct videos - 1120 video clips for 27 activities (<em>american football</em>, <em>basketball</em>, <em>bungee jumping</em>, <em>driving</em>, <em>go-kart</em>, <em>horse riding</em>, <em>ice hockey</em>, <em>jet ski</em>, <em>kayaking</em>, <em>kitesurfing</em>, <em>longboarding</em>, <em>motorcycle</em>, <em>paintball</em>, <em>paragliding</em>, <em>rafting</em>, <em>rock climbing</em>, <em>rowing</em>, <em>running</em>, <em>sailing</em>, <em>scuba diving</em>, <em>skateboarding</em>, <em>soccer</em>, <em>stair climbing</em>, <em>surfing</em>, <em>tennis</em>, <em>volleyball</em>, <em>walking</em>) The video clips used for training, validation and test sets for each activity are listed in <em>Table 1</em>. Multiple video clips may belong to a single video because of trimming it for some reasons (i.e., scene cut, temporary overlayed text on videos, or video parts unrelated to activities). While splitting the dataset, the minimum number of videos for each activity was selected as 8. Additionally, the video samples were divided as 50%, 25%, and 25% for training (minimum four videos), validation (minimum two videos), and testing (minimum two videos), respectively. On the other hand, videos were split according to the raw video footage to prevent the mixing of similar video clips (having the same actors and scenes) into training, validation, and test sets. Therefore, we ensured that the video clips trimmed from the same videos were split together into training, validation, or test sets to satisfy a fair comparison. Some activities have continuity throughout the video, such as <em>scuba</em>, <em>longboarding</em>, or <em>riding horse</em>, which also have an equal number of video segments with the number of videos. However, some activities, such as skating, occurred in a short time, making the number of video segments higher than the others. As a result, the number of video clips for training, validation, and test sets was highly imbalanced for the selected activities (i.e., <em>jet ski</em> and <em>rafting</em> have 4; however, <em>soccer</em> has 99 video clips for training). <strong> Table 1 - Dataset splitting for EOAD</strong> <strong>Train</strong> <strong>Validation</strong> <strong>Test</strong> <strong>Action Label</strong> <strong>#Clips</strong> <strong>Total Duration</strong> <strong>#Clips</strong> <strong>Total Duration</strong> <strong>#Clips</strong> <strong>Total Duration</strong> <strong>AmericanFootball</strong> 34 00:06:09 36 00:05:03 9 00:01:20 <strong>Basketball</strong> 43 01:13:22 19 00:08:13 10 00:28:46 <strong>Biking</strong> 9 01:58:01 6 00:32:22 11 00:36:16 <strong>Boxing</strong> 7 00:24:54 11 00:14:14 5 00:17:30 <strong>BungeeJumping</strong> 7 00:02:22 4 00:01:36 4 00:01:31 <strong>Driving</strong> 19 00:37:23 9 00:24:46 9 00:29:23 <strong>GoKart</strong> 5 00:40:00 3 00:11:46 3 00:19:46 <strong>Horseback</strong> 5 01:15:14 5 01:02:26 2 00:20:38 <strong>IceHockey</strong> 52 00:19:22 46 00:20:34 10 00:36:59 <strong>Jetski</strong> 4 00:23:35 5 00:18:42 6 00:02:43 <strong>Kayaking</strong> 28 00:43:11 22 00:14:23 4 00:11:05 <strong>Kitesurfing</strong> 30 00:21:51 17 00:05:38 6 00:01:32 <strong>Longboarding</strong> 5 00:15:40 4 00:18:03 4 00:09:11 <strong>Motorcycle</strong> 20 00:49:38 21 00:13:53 8 00:20:30 <strong>Paintball</strong> 7 00:33:52 4 00:12:08 4 00:08:52 <strong>Paragliding</strong> 11 00:28:42 4 00:10:16 4 00:19:50 <strong>Rafting</strong> 4 00:15:41 3 00:07:27 3 00:06:13 <strong>RockClimbing</strong> 6 00:49:38 2 00:21:59 2 00:18:50 <strong>Rowing</strong> 5 00:47:05 3 00:13:21 3 00:03:26 <strong>Running</strong> 21 01:21:56 19 00:46:29 11 00:42:59 <strong>Sailing</strong> 7 00:39:30 4 00:14:39 6 00:15:43 <strong>Scuba</strong> 5 00:35:02 3 00:23:43 2 00:18:52 <strong>Skate</strong> 91 00:15:53 30 00:07:01 10 00:02:03 <strong>Ski</strong> 14 01:48:15 17 01:01:59 7 00:39:15 <strong>Soccer</strong> 102 00:48:39 52 00:13:17 16 00:06:54 <strong>StairClimbing</strong> 6 01:05:32 6 00:17:18 5 00:20:22 <strong>Surfing</strong> 23 00:12:51 17 00:06:52 10 00:07:04 <strong>Tennis</strong> 34 00:27:04 9 00:06:03 9 00:03:14 <strong>Volleyball</strong> 87 00:19:14 35 00:07:46 7 00:18:58 <strong>Walking</strong> 49 00:43:02 36 00:38:25 10 00:10:23 <strong>Total</strong> 30 740 20:22:37 452 09:20:23 200 08:00:08 <strong>EOAD Code Repository</strong> Scripts for downloading raw videos and trim them in to video clips are provided in this GitHub repository. Regarding the questions, please contact <strong><em>mali.arabaci@gmail.com.</em></strong>