# Multimedia Vision for the Visually Impaired through 2D Multiarray Braille Display
## 4 Implementation and Results  
This study developed an efficient 2D multiarray braille display that can replace heavy and inefficient devices and express the content simply and clearly for the VI users. We attempted to eliminate the disadvantages of the existing devices for the VI and provide convenient use while maintaining the as many features as possible of the regular devices for VI users. We also paid close attention to the interaction between VI users and their assistants/guardians, and to enable smooth information sharing. Thus, we developed a braille display software that can share information with a smartphone. However, we could explain the implementation only through the images of the braille display screen because of the design copyright issues of the braille device that is under development. In addition, we obtained much practical feedback from the VI for developing the proposed system [19; 20; 21]. Thus, we focused on the braille display software only and presented this system thoughtfully. In this study, we used a combination of a tablet and smartphone to replace the braille display, as shown in Figures 6 and 7. The tablets used were Samsung Galaxy Tab S and Galaxy Tab S2 8.0, and the smartphones used were Samsung Galaxy S7 Edge, S6, Note 5, and LG G4. Their operating systems were all Android 6.0 Marshmallow, and the development was carried out using the minSDKVersion of 19 of the Android API. For the SDK, Android Studio was used. In addition, the development was carried out on a laptop computer with Intel i3 CPU, 4 GB RAM, and SSD of 500 MB/sec read/write speed. The sample files used for the DAISY books were provided by DAISY Consortium and the EPUB sample files were provided by PRESSBOOK [36; 43]. Figure 13 shows the text and its corresponding braille translation while exchanging data through the Braille OS via a Bluetooth connection between the tablet and smartphone. Figure 13 shows the braille contents that a user reads on the tablet, which is a text from DAISY v2.02 translated to braille, and the tablet screen is modified to show only the contents of the multiarray braille. Figure 13 shows screenshots of the tablet and smartphone screens, which is an example of the previously explained braille pad and Korean contents translated into braille. Figure 14 shows examples using an eBook of EPUB format. Figure 14 shows examples using an eBook in the EPUB format. In Figure 14, we see that all chapter lists of the sample eBooks are normally outputted. In addition, Figure 14 shows that a text content of the eBook is normally outputted via the text player. Figure 15, using a smartphone for easy understanding, shows the sequence of the processes performed when a VI user is reading a book. In the main page, search for books, open last book, or favorites can be selected. When open last book or favorites is selected, the text player is executed immediately; and when search for books is selected, the book list is opened, and this shows the list of books in the smartphone storage. Moreover, if the searched book contains audio files, the MP3/text mode can be selected, and the respective mode is executed. In this study, they are operated based on chapters (usually MP3 files are divided chapter-wise). According to the selected part of the book, the book content is played. [PERSON] and [PERSON] et al. [5; 19; 20; 21; 22; 23], who are co-researchers of this study, performed investigations pertaining to the processing of images in books: when a user presses a certain key in the image viewer, the book image list is displayed in response. In this study, a tag is attached to an image file in a chapter that a user is currently reading, it is tagged and extracted, and an image file list is created. When the user enters the image viewer through the list, image-oriented objects are extracted and displayed. As shown in Figure 16, there are a/an graph, illustration, and photograph displayed with high-resolution 2D multiarray braille display. Table 5 compares related works.