# Haptic Glove TV Device for People with Visual Impairment
## 5 Integration of the Haptic Glove with the Television  
The main objective of this work is to validate the utility that the glove can have. However, without deviating from the objective, we want to propose at least three possible solutions to achieve the TV video's integration with the vibrations generated by the haptic glove. The main challenge in this part is to achieve correct synchronization between the video sequence and the glove's vibrations.  
The first solution would be to include the vector information with the ball location as metadata within the Transport Stream (TS). Using a special encoder, create an Elementary Stream (ES) that explicitly contains the vector information with the ball's location. Assign a Packet Identifier (PID) for these data, package them into fixed 188 byte packets and then multiplex them along with the other audio, video, and data streams. A diagram of this process is shown in Figure 13.  
Figure 11: Haptic glove final product.  
Figure 12: Haptic glove being used by a blind person.  
The opposite process would occur at the receiver, where we would have to work on a special decoder that understands that metadata. It would identify the PID of the packets containing the ball location information and extract them in vector form so that later it could be integrated in some way with the WIFI network and the haptic controller. In Section 2 we presented some works that can serve as reference [46; 47; 48].  
The second solution, and it is possible the easiest for its integration, would transmit this vector's information with the ball's location through the interactive platforms that have the digital television systems. For example, GINGA for ISDB-Tb (Integrated Services Digital Broadcasting-Terrestrial Built-) or HbbTV (Hybrid broadcast broadband TV) for DVB-T (Digital Video Broadcasting-Terrestrial). For HbbTV, the integration already exists because there is always a web server connection. It could be updated with real-time information and stored in a database, even to access this information at any time. This would be a great advantage since the user could observe a sports meeting that is not live. Another advantage that brings the HbbTV 2.0.1. version is the CSS (Companion Screen Sync) protocol that allows synchronization with other monitoring devices, which would practically solve the integration with the haptic glove device [55].  
Finally, we can propose an alternative approach for conventional video HTTP web servers setting up adaptive streaming media sources. It would be including the vibration info as metadata within the standardized MPEG-DASH events through a media presentation description (MPD) file.  
The other challenge, and it is likely more complicated, is generating this vector automatically and in real-time. This could be done using different technologies such as computer vision, through stereo vision using the stadium's cameras, through a network of microphones on the field [56]. It is installing a global positioning system (GPS), a radio frequency identification (RFID), a near-field communication (NFC), or other technologies inside the soccer ball and forming a network of sensors inside the field, among other alternatives. However, it remains a new line of research that could be proposed to analyze and determine which would be the most feasible and efficient. On Section 2 we mentioned two related works [49; 50].  
In order to fulfill our main objective of finding the usefulness of the haptic glove; initially as detailed in Section 3, the vectors of the location of the ball within the regions of the field were obtained using manual sampling. That is to say, visually the video of a soccer match was paused, and its location was written in the form of vectors within an editable text document (Excel). Later, this file was used as a local database and synchronized with the video also manually.