System and method for data communication based on image processing

Various aspects of a system and method for data communication based on image processing are disclosed herein. In accordance with an embodiment, the system includes a first electronic device, which control display of an image on the first electronic device. The image includes one or more other electronic devices communicatively coupled to a wireless communication network. The one or more other electronic devices are identified in the displayed image based on an identity parameter associated with the one or more other electronic devices. A second electronic device of the identified one or more other electronic devices is controlled based on device settings associated with the identified one or more other electronic devices.

FIELD

Various embodiments of the disclosure relate to a system and method for data communication. More specifically, various embodiments of the disclosure relate to a system and method for data communication based on image processing.

BACKGROUND

Advancements in the field of communication technology have enabled data communication among electronic devices in a wireless network. For example, emerging technologies like “All-joyn” or Internet-of-Things (IoT) framework have reduced certain complexities for data communication among electronic devices in a wireless network. However, still in certain scenarios, it may be difficult to establish a communication between the electronic devices to achieve a desirable result. Further simplification of the data communication process may be desirable. An enhanced system may be required that may not only simplify the data communication process among the electronic devices but also provide an intuitive experience to a user performing the data communication.

SUMMARY

A system and a method for data communication based on image processing substantially as shown in, and/or described in connection with, at least one of the figures, as set forth more completely in the claims.

DETAILED DESCRIPTION

The following described implementations may be found in disclosed system and method for data communication based on image processing. Exemplary aspects of the disclosure may comprise a method that may control display of an image on a first electronic device. The image may comprise one or more other electronic devices communicatively coupled to a wireless communication network. The one or more other electronic devices may be identified in the image based on an identity parameter associated with the one or more other electronic devices. A second electronic device of the identified one or more other electronic devices may be controlled based on device settings associated with the identified one or more other electronic devices.

In accordance with an embodiment, the first electronic device may correspond to an Internet-of-Things (IoT) device with an in-built image-capturing unit. The one or more other electronic devices that includes the second electronic device may correspond to one or more other IoT devices, connected to the wireless communication network.

In accordance with an embodiment, one or more visual cues associated with the one or more other electronic devices may be detected in the image by use of an image processing technique. The one or more visual cues may correspond to a device mark, a device texture, a shape, a size, a device configuration, and/or other device identifiers.

In accordance with an embodiment, a device-type may be identified based on the detected one or more visual cues, the identity parameter, a location of the first electronic device, an orientation of the first electronic device with respect to the one or more other electronic devices, a distance of the one or more other electronic devices from the first electronic device that displays the image. In accordance with an embodiment, the identity parameter of the one or more other electronic devices may correspond to an Internet Protocol (IP) address, a Media Access Control (MAC) address, a unique device identifier, and/or a Service Set Identifier (SSID).

In accordance with an embodiment, a connection may be established with the identified one or more other electronic devices in the wireless communication network based on the identity parameter. An augmented-reality (AR) view may be generated on the first electronic device to enable the control of the identified one or more other electronic devices. The AR view may comprise a field-of-view (FOV) of the one or more other electronic devices, one or more graphical controls associated with the identified one or more other electronic devices displayed within the FOV, and/or one or more content items compatible as per the device-type of the identified one or more other electronic devices.

In accordance with an embodiment, one or more graphical controls may be generated on the AR view according to the device-type of each of the identified one or more other electronic devices within the FOV. A content item may be selected from the AR view on the first electronic device. The selected content item may be dragged towards a specific electronic device on the AR view to communicate the selected content item to the specific electronic device among the identified one or more other electronic devices. A video component of a media item may be communicated to the second electronic device and an audio component of the media item (same media item) may be communicated to a third electronic device of the identified one or more other electronic devices based on a user input (or action) on the generated AR view on the first electronic device. One or more operations as discussed above, such as the selection of the content item and/or dragging of the selected content items towards a specific electronic device on the AR view to initiate communication, may occur based on user action(s) and/or input.

In accordance with an embodiment, the device settings may be set for a plurality of electronic devices connected to the wireless communication network. The plurality of electronic devices may include the one or more other electronic devices. The device settings may be set based on a user-preference associated with an operation to be performed on the plurality of electronic devices and/or a device-type of each of the plurality of electronic devices. The device settings may be dynamically updated based on a temporal analysis of operations previously performed with respect to the plurality of electronic devices by application of a machine learning technique.

In accordance with an embodiment, a specific device setting may be selected from the device settings to control the second electronic device. The specific device setting may be selected based on a current operation state, a data type of a content item to be communicated, and/or one or more compatible content items or control functions supported by the second electronic device. The second electronic device of the identified one or more other electronic devices may be controlled by the first electronic device further based on control information retrieved from the wireless communication network.

In accordance with an embodiment, the first electronic device may be controlled to display visually perceptible graphical effects on the AR view to indicate continuous transfer of data from the first electronic device to the one or more other electronic devices. The display of visually perceptible graphical effects may be performed in a real-time or near real-time in accordance with the type of data that is communicated.

In accordance with an embodiment, a list of compatible media types may be identified for each of the identified one or more other electronic devices based on control information retrieved from the wireless communication network. The control information may include device specification information, a device-type, and/or mapping information of one or more visual cues with a corresponding unique device identifier of each connected device in the wireless communication network. In accordance with an embodiment, the wireless communication network may be a wireless local area network or other wireless communication network.

FIG. 1is a block diagram that illustrates a network environment for data communication based on image processing, in accordance with an embodiment of the disclosure. With reference toFIG. 1, there is shown a network environment100. The network environment100may include a first electronic device102and one or more other electronic devices104, such as a second electronic device104a, a third electronic device104band a fourth electronic device104c. There is further shown a wireless communication network106, a User Interface (UI)108, and one or more users, such as a user110.

In accordance with an embodiment, the first electronic device102may be connected to the wireless communication network106. The one or more other electronic devices104may also be connected to the wireless communication network106. The first electronic device102may be associated with the user110.

The first electronic device102may comprise suitable logic, circuitry, interfaces, and/or code that may be configured to control the one or more other electronic devices104that may be displayed on a viewfinder of the UI108rendered on the first electronic device102. The first electronic device102may be further configured to store an image-capturing application. The image-capturing application may render the UI108on the first electronic device102. The first electronic device102may correspond to an Internet-of-Things (IoT) device with an in-built image-capturing unit. Examples of the first electronic device102may include, but are not limited to, a smartphone, a wearable device, such as a smart-glass or a smartwatch, ma camera, a tablet computer, a laptop, and/or a portable electronic device with an inbuilt camera.

The one or more other electronic devices104may comprise suitable logic, circuitry, interfaces, and/or code that may be configured to communicate control information to the first electronic device102via the wireless communication network106. The one or more other electronic devices104may correspond to one or more other IoT devices connected to the wireless communication network106. Examples of the one or more other electronic devices104may include, but are not limited to, a television, a speaker system, a car info-entertainment system, a smartphone, a laptop, an IoT device, such as lighting unit, a household consumer electronic appliance, and/or other IoT compatible electronic devices.

The wireless communication network106may include a medium through which the first electronic device102may communicate with one or more other electronic devices104, such as the second electronic device104a, the third electronic device104b, and the fourth electronic device104c. Examples of the wireless communication network106may include, but are not limited to, a Digital Living Network Alliance (DLNA) based network, a wireless local area network (WLAN), the Internet, or other wireless communication networks. Various devices in the network environment100may be configured to connect to the wireless communication network106, in accordance with various wireless communication protocols. Examples of such wireless communication protocols may include, but are not limited to, Transmission Control Protocol and Internet Protocol (TCP/IP), User Datagram Protocol (UDP), Hypertext Transfer Protocol (HTTP), File Transfer Protocol (FTP), ZigBee, EDGE, infrared (IR), IEEE 802.11, 802.16, cellular communication protocols, such as Long Term Evolution (LTE), and/or Bluetooth (BT) communication protocols.

The UI108may be an application interface rendered on a display screen of the first electronic device102. The UI108may comprise one or more UI elements that may enable the user110to control one or more other electronic devices104. The UI108may be further configured to display content items to be transmitted to the one or more other electronic devices104. The UI108may be adapted to display an augmented reality (AR) view on the first electronic device102. The UI108may be adapted to display one or more graphical controls on the AR view in accordance with a device-type of each of the one or more other electronic devices104.

In operation, the user110may provide an input at the first electronic device102, via the UI108. In response to the input received from the user110, the first electronic device102may be configured to display a viewfinder on at least a portion of the UI108to enable capture of one or more images or video by use of the image-capturing unit of the first electronic device102. The user110may then point the image-capturing unit of the first electronic device102towards the one or more other electronic devices104to visualize the one or more other electronic devices104via the viewfinder of the UI108.

The first electronic device102may be configured to control display of an image on the first electronic device102. The image may include the one or more other electronic devices104based on a current field-of-view (FOV) of the image-capturing unit of the first electronic device102. In accordance with an embodiment, the first electronic device102may be configured to detect a location of the first electronic device102and/or an orientation of the first electronic device102with respect to the one or more other electronic devices104. Further, a distance of the one or more other electronic devices104from the first electronic device102that displays the image may be determined.

In accordance with an embodiment, the first electronic device102may be configured to detect the one or more other electronic devices104in the displayed image based on one or more image-processing techniques. The first electronic device102may be configured to detect one or more visual cues associated with the one or more other electronic devices104in the displayed image. The one or more visual cues may be a device mark, a device texture, a shape, a size, a device configuration, and/or other device identifiers.

The first electronic device102may be configured to retrieve an identity parameter associated with the one or more other electronic devices104from the wireless communication network106. The identity parameter of the one or more other electronic devices104may correspond to an Internet Protocol (IP) address, a Media Access Control (MAC) address, a unique device identifier, and/or a Service Set Identifier (SSID). The identity parameter associated with a plurality of electronic devices may be pre-mapped with a corresponding unique device identifier of each connected device in the wireless communication network106. The plurality of electronic devices connected in the wireless communication network106may include the one or more other electronic devices104and the first electronic device102. The identity parameter associated with each of the detected one or more visual cues in the displayed image may be retrieved from the wireless communication network106. The mapping information may be pre-stored in the first electronic device102or retrievable from the wireless communication network106. In certain scenarios, new devices may be added (communicatively coupled) to the wireless communication network106. In such scenarios, identity parameter associated with such new devices may also be retrieved. The mapping information for such devices may be dynamically updated in the wireless communication network106. Thus, both pre-mapped devices and the newly added devices to the wireless communication network106may be functional to enable retrieval of corresponding identity parameter(s).

In accordance with an embodiment, the one or more other electronic devices104may be identified by the first electronic device102based on at least the retrieved identity parameter associated with the one or more other electronic devices104. The first electronic devices may be configured to establish a connection with the identified one or more other electronic devices104in the wireless communication network106, based on the identity parameter.

In accordance with an embodiment, the first electronic device102may be configured to identify a device-type of the one or more other electronic devices104. The device-type may be identified based on the detected visual cues and the retrieved identity parameter. The device-type may be further identified or validated based on the detected location of the first electronic device102with respect to the one or more other electronic devices104. For instance, each of the plurality of electronic devices may occupy a certain known position in a home space. Thus, an indoor positioning of the first electronic device102may indicate its proximity to certain electronic devices for the detected location.

In accordance with an embodiment, the device-type may be further identified based on the detected orientation of the first electronic device102that may indicate a direction of pointing of the image-capturing unit of the first electronic device102towards the one or more other electronic devices104. The device-type may be further identified based on a distance of the one or more other electronic devices104from the first electronic device102. For example, when the one or more other electronic devices104occupy a large area in the displayed image on the UI108, it may indicate that the one or more other electronic devices104are located in close proximity to the first electronic device102. The large area may be an area greater than a preset threshold area on the UI108. Similarly, when the one or more other electronic devices104occupy a small area in the displayed image on the UI108, it may indicate that the one or more other electronic devices104are distantly located from the first electronic device102. The small area may be an area less than a preset threshold area on the UI108.

In accordance with an embodiment, device settings may be set for a plurality of electronic devices connected to the wireless communication network106. The plurality of electronic devices may include the one or more other electronic devices104. The device settings may be set based on a user-preference associated with an operation to be performed by each of the plurality of electronic devices and/or a device-type of each of the plurality of electronic devices. The device settings may be dynamically updated based on a temporal analysis of operations previously performed with respect to the plurality of electronic devices. The update may be performed by application of a machine learning technique.

In accordance with an embodiment, the first electronic device102may be configured to control a desired electronic device, such as the second electronic device104a, from the identified one or more other electronic devices104based on the device settings associated with the identified one or more other electronic devices104. The first electronic device102may be configured to select a specific device setting from device settings for the control of the second electronic device104a. The selection may be performed based on the identified device-type, a current FOV of the image-capturing unit as displayed on the UI108, and/or a current operation state of the identified one or more other electronic devices104that may be displayed in the current FOV (or image) on the UI108. For example, the fourth electronic device104cmay be in the current FOV as captured by the image-capturing unit of the first electronic device102. An image that may include only the fourth electronic device104cof the one or more other electronic devices104. The device-type of the fourth electronic device104cmay be identified as lighting device and the operation state of the third electronic device104bmay be determined to be in “OFF” state. Thus, the control in this example may be to change the current state of the third electronic device104b, such as to communicate a control command to the third electronic device104bto switch “ON” the third electronic device104b. Similarly, if the device-type is identified as a media renderer, such as for the second electronic device104a, and the current state of the second electronic device104a(a media renderer) is determined to be in “ON” state, a corresponding action may be taken by the first electronic device102. For example, one or more content items compatible to the second electronic device104aand/or control functions supported by the second electronic device104a, may be displayed on the first electronic device102, via the UI108.

In accordance with an embodiment, the first electronic device102may be configured to generate and display an AR view on the first electronic device102, via the UI108. The AR view displayed on the first electronic device102may comprise a FOV of the one or more other electronic devices104, one or more graphical controls associated with the identified one or more other electronic devices104displayed within the FOV, and/or one or more content items compatible with the identified device-type of the identified one or more other electronic devices104. The graphical controls may be generated on the AR view according to the device-type of each of the identified one or more other electronic devices104displayed within the FOV of the image-capturing unit of the first electronic device102. The FOV may be displayed on a certain portion of the UI108, such as first portion of the UI108. The FOV may correspond to the displayed image.

In accordance with an embodiment, the one or more other electronic devices may be controlled by a selection of the displayed graphical controls on the UI108. In accordance with an embodiment, the first electronic device102may be configured to display the image of the one or more other electronic devices104on the first portion of the UI108. In accordance with an embodiment, various selection operations, such as selection of an object, electronic device, or graphical controls may be performed using a wearable device or a smartglass. On a second portion of the UI108, the first electronic device102may be configured to display a plurality of icons or selectable links. The plurality of icons or selectable links may correspond to one or more content items compatible with the device-type or one or more control functions supported by the identified one or more other electronic devices104, such as the second electronic device104a, to which the content item is to be transmitted. The first electronic device102may be configured to select a specific electronic device (such as the second electronic device104a) from the identified one or more other electronic devices104based on the content item to be communicated from the first electronic device102to the selected electronic device.

In accordance with an embodiment, the user110may select a content item from a list of compatible content items displayed on the first electronic device102. The user110may drag the selected content item towards a specific electronic device displayed in the FOV on the AR view to communicate the selected content item to the specific electronic device among the identified one or more other electronic devices104. For instance, the first electronic device102may be configured to communicate a video component of a content item compatible with the second electronic device104aand an audio component of the content item to the third electronic device104bof the identified one or more other electronic devices104using the generated AR view on the first electronic device102. Such decision for separation of the audio component and video component from a single content item (such as a movie) may occur dynamically based on a user action or input. Thus, a user, such as the user110, may decide whether to perform the separation or not. An example of the bifurcated transmission of audio and video component of the same media item is illustrated and described inFIGS. 3B and 3C.

FIG. 2is a block diagram that illustrates an exemplary electronic device, in accordance with an embodiment of the disclosure.FIG. 2is explained in conjunction with elements fromFIG. 1. With reference toFIG. 2, there is shown the first electronic device102. The first electronic device102may comprise one or more processors, such as a processor202, a memory204, one or more input/output (I/O) devices, such as I/O device206, a sensing device208, a transceiver210, and an image-capturing unit212. The I/O device206may include a display214. With reference toFIG. 2, there is further shown the wireless communication network106ofFIG. 1.

The processor202may be communicatively coupled to the memory204, and the I/O device206, the sensing device208, the transceiver210, and the image-capturing unit212. The transceiver210may be configured to communicate with the plurality of electronic devices, such as the identified one or more other electronic devices104, via the wireless communication network106.

The processor202may comprise suitable logic, circuitry, interfaces, and/or code that may be configured to execute a set of instructions stored in the memory204. The processor202may be implemented based on a number of processor technologies known in the art. Examples of the processor202may be an X86-based processor, X86-64-based processor, a Reduced Instruction Set Computing (RISC) processor, an Application-Specific Integrated Circuit (ASIC) processor, a Complex Instruction Set Computing (CISC) processor, a central processing unit (CPU), an Explicitly Parallel Instruction Computing (EPIC) processor, a Very Long Instruction Word (VLIW) processor, and/or other processors or circuits.

The memory204may comprise suitable logic, circuitry, and/or interfaces that may be configured to store a set of instructions executable by the processor202. The memory204may be configured to store a database, which may include device-types of the plurality of electronic devices associated with their corresponding visual cues. The memory204may be further configured to store the device settings for the plurality of electronic devices connected to the wireless communication network106. The device-types may be stored in an associative relationship with corresponding visual cues, list of compatible content items, functions supported and/or device settings of the plurality of electronic devices. The plurality of electronic devices may include the one or more other electronic devices104. The memory204may be further configured to store operating systems and associated applications. Examples of implementation of the memory204may include, but are not limited to, Random Access Memory (RAM), Read Only Memory (ROM), Electrically Erasable Programmable Read-Only Memory (EEPROM), Hard Disk Drive (HDD), a Solid-State Drive (SSD), a CPU cache, and/or a Secure Digital (SD) card.

The I/O device206may comprise suitable logic, circuitry, interfaces, and/or code that may be configured to receive an input from and provide an output to the user110. The I/O device206may include various input and output devices that may be configured to facilitate a communication between the processor202and the user110. Examples of the input devices may include, but are not limited to, a button on the first electronic device102to activate the image-capturing unit212, a software button on the UI108, the image-capturing unit212, a camcorder, a touch screen, a microphone, a motion sensor, and/or a light sensor. Examples of the output devices may include, but are not limited to, the display214, a projector screen, and/or a speaker.

The sensing device208may comprise one or more sensors that include a suitable logic, circuitry, interfaces, and/or code to detect physical or quantitative attributes and provide corresponding output as sensor data. The physical or quantitative attributes may include, but are not limited to, orientation, motion, contact, proximity, geo-magnetic field, indoor positioning, and/or ambient lighting. The one or more sensors in the sensing device208may be configured to detect an orientation and a geo-location of the first electronic device102. The one or more sensors in the sensing device208may be further configured for tap detection and/or gesture detection. The one or more sensors in the sensing device208may be further configured to aid in controlling of the one or more other electronic devices104, such as the second electronic device104aand the third electronic device104b, based on the input detected by the sensing device208. Examples of the one or more sensors may include, but are not limited to, an accelerometer, a global positioning system (GPS) sensor, an indoor positioning system, a compass or magnometer, an ambient light sensor, a tricorder, a gyroscope, a proximity sensor, an image sensor, a lux meter, a touch sensor, and/or an infrared sensor.

The transceiver210may comprise suitable logic, circuitry, interfaces, and/or code that may be configured to communicate with the plurality of electronic devise, such as the identified one or more other electronic devices104, via the wireless communication network106(as shown inFIG. 1). The transceiver210may implement known technologies to support wireless communication of the first electronic device102with the wireless communication network106. The transceiver210may include, but is not limited to, an antenna, a radio frequency (RF) transceiver, one or more amplifiers, a tuner, one or more oscillators, a digital signal processor, a coder-decoder (CODEC) chipset, a GSM/GPRS module, and/or a local buffer.

The transceiver210may communicate via wireless communication with the wireless communication network106. The wireless communication may use one or more of the communication standards, protocols and technologies, such as Bluetooth, Wireless Fidelity (Wi-Fi) (such as various IEEE 802.11 standards, IEEE 802.11a, IEEE 802.11b, IEEE 802.11g and/or IEEE 802.11, IEEE 802.11n), voice over Internet Protocol (VoIP), Wi-MAX, a protocol for email, instant messaging, and/or Short Message Service (SMS), the Internet, Message Queue Telemetry Transport (MQTT), Extensible Messaging and Presence Protocol (XMPP), Data Distribution Service (DDS), Advanced Message Queuing Protocol (AMQP), Constrained Application Protocol (CoAP), and/or cellular communication protocols.

The image-capturing unit212may comprise suitable logic, circuitry, interfaces, and/or code that may be configured to capture one or more images, such as the image that includes the one or more other electronic devices104. The image-capturing unit212may refer to an in-built camera or an image sensor of the first electronic device102, such as a smartphone. The image-capturing unit212may be configured to store the visual cues of the identified one or more other electronic devices104in a local buffer and/or the memory204, under the control of the processor202. In accordance with an embodiment, the visual cues may be extracted from the displayed image and identified based on image processing techniques.

The display214may comprise suitable logic, circuitry, interfaces, and/or code that may be configured to render the UI108of the first electronic device102. The display214may be realized through several known technologies, such as Cathode Ray Tube (CRT) based display, Liquid Crystal Display (LCD), Light Emitting Diode (LED) based display, Organic LED display technology, Retina display technology, and/or the like. In accordance with an embodiment, the display214may be capable of receiving input from the user110. In such a scenario, the display214may be a touch screen that enables the user110to provide the input. The touch screen may correspond to at least one of a resistive touch screen, a capacitive touch screen, or a thermal touch screen. In accordance with an embodiment, the display214may receive the input through a virtual keypad, a stylus, a gesture-based input, and/or a touch-based input. In such a case, the input device may be integrated within the display214. In accordance with an embodiment, the first electronic device102may include a secondary input device apart from the display214that may be a touch-based display screen.

In operation, the processor202may be configured to detect an orientation or a direction of pointing of the image-capturing unit212of the first electronic device102. The user110may point the image-capturing unit212of the first electronic device102to capture a field-of-view (FOV) that may include the one or more other electronic devices104within the FOV. The processor202may be configured to control display of an image on the first electronic device102. The image may include the one or more other electronic devices104based on the current FOV of the image-capturing unit212of the first electronic device102. The processor202may be configured to identify the one or more other electronic devices104displayed in the displayed image (or the FOV). The recognition process may be initiated when the user110continues to hold or point the image-capturing unit212to capture the FOV for a pre-specified duration. The processor202may be configured to identify the one or more other electronic devices104based on at least the identity parameter associated with the one or more other electronic devices104. The identity parameter may be retrieved from the wireless communication network106, via the transceiver210.

In accordance with an embodiment, the processor202may be configured to identify the device-type based on image processing, such as detection of visual cues (as discussed inFIG. 1), the retrieved identity parameter or a location, the detected orientation or a distance of the one or more other electronic devices104from the first electronic device102. The device-type for each of the plurality of electronic devices that may include the one or more other electronic devices104, may be pre-stored in a database. In the database, the device-type may be mapped with corresponding one or more visual cues in an associated relationship.

In accordance with an embodiment, one or more device settings may be set for each of the plurality of electronic devices connected to the wireless communication network106. The plurality of electronic devices may include the one or more other electronic devices104. The device settings may be set based on a user-preference associated with an operation to be performed by each of the plurality of electronic devices and/or a device-type of each of the plurality of electronic devices. The configuration of the one or more device settings may be a one-time activity.

In accordance with an embodiment, the processor202may be configured to dynamically generate one or more device settings for each of the plurality of electronic devices as recommended device settings. The one or more device settings for each of the plurality of electronic devices may be generated based one or more criteria associated with each of the plurality of electronic devices. The one or more criteria may include the identified device-type and/or control functions supported by each of the plurality of electronic devices, such as the identified one or more other electronic devices104. The user110may then select one of the recommended device settings to be set for a specific device or a number of devices that may be classified under a particular category of devices, such as the device-type. The selected device setting(s) may then be further configured or changed (a fine tuning) as per a user-preference of the user110. This may reduce time used to set or configure the one or more device settings.

In accordance with an embodiment, the one or more device settings may be dynamically updated based on a temporal analysis of operations previously performed with respect to the plurality of electronic devices. The update may be performed by application of a machine learning technique. The one or more device settings of the plurality of electronic devices connected to the wireless communication network106may be stored in the memory204, or at another network device connected to the wireless communication network106. The one or more device settings of the plurality of electronic devices may be set and applied by the processor202under different operational scenarios as per processing of the current FOV or displayed image on the first electronic device102.

In accordance with an embodiment, the processor202may be configured to control the identified one or more other electronic devices104based on the device settings associated with the identified one or more other electronic devices104. For example, a specific IoT device, such as the second electronic device104a, of the identified one or more other electronic devices104may be controlled remotely via the wireless communication network106.

In accordance with an embodiment, the processor202may be configured to select a specific device setting from the pre-stored device settings to control the second electronic device104a. The control may be performed based on the identified device-type, a current operation state of the second electronic device104a, and/or control functions supported by the second electronic device104a. The control functions supported by the second electronic device104amay be retrieved from the wireless communication network106or directly from the second electronic device104a.

In a first example, a device setting-1may be selected and applied in a scenario where the processor202may identify that the second electronic device104aand the third electronic device104bare captured within a FOV and displayed in the image rendered on the display214, via the UI108. The device setting-1for such scenario may correspond to determination of compatible content items or control menu (such as control buttons) as per device-type, and communication of a first component of a selected media item to the second electronic device104aand a second component of the same media item to the third electronic device104b. For example, the media item may be divided into a video component and an audio component. The video component may be casted on a video renderer (such as the second electronic device104a) and the audio component may be casted on an audio renderer (such as the third electronic device104b).

In a second example, a device setting-2may be selected and applied in a scenario where the processor202may identify that a single device, such as the second electronic device104a, may be captured within the FOV and displayed in the image rendered on the display214, via the UI108. The device setting-2for such scenario may correspond to determination of compatible content items or control menu as per device-type, and communication of a selected content item having both the video component and the audio component to the second electronic device104a. The processor202may detect and retrieve certain content items stored either in the memory204or from the wireless communication network106that may be compatible to be communicated to the second electronic device104a, based on identification of device-type of the second electronic device104a. For example, a media item may be a video having both video component and audio component. The media item may be casted on the second electronic device104a(such as a smart TV) that may play both the video component and the audio component.

In a third example, a device setting-3may be selected and applied in a scenario where the processor202may recognize that only the third electronic device104bis captured within the FOV and displayed in the image rendered on the display214, via the UI108. The device setting-3for such a scenario may be set to communicate the audio component of the media item to the third electronic device104b. The processor202may further detect that the content item to be communicated to the third electronic device104bis compatible to play an audio component of the content item based on identification of device-type. For example, a media item may be a video having both video component and audio component. The audio component may be casted on the third electronic device104b(such as a music system or a home theatre) that may be detected to be compatible with the audio component. In accordance with an embodiment, the video component may be displayed on the first electronic device102.

In a fourth example, a device setting-4may be selected and applied in a scenario where the processor202may recognize that the fourth electronic device104cis captured within the FOV and displayed in the image rendered on the display214, via the UI108. The processor202may identify the device-type to be a lighting device. The device setting-4may correspond to determination of a current operation state of the fourth electronic device104c, followed by a change in the detected current operation state. The processor202may then communicate a control signal to the fourth electronic device104cto power “ON” the fourth electronic device104cthat may be previously in an “OFF” operation state. Thus, the device settings may be automatically or manually set and updated with different conditions as described above.

It is to be understood that the device settings and conditions described in the above examples are exemplary device settings, and the scope of the disclosure may not be limited to the disclosed device settings or conditions for their application. Various device settings may be set for various devices, as per the device-type and other criteria as discussed above. Further device-type may not be limited to a lighting device, a media renderer, and/or an audio player. Other device-type, such as a heating device, a cooling device, or a user-specified device-type or device category may be set and utilized for the control purpose. In accordance with an embodiment, the functionalities or operations performed by the first electronic device102, as described inFIG. 1may be performed by the processor202. Other operations performed by the processor202may be understood from the description in theFIGS. 3A, 3B, 3C, 4A, 4B, 4C, and 5.

FIGS. 3A, 3B, and 3Cillustrate a first exemplary scenario for the implementation of the disclosed system and method for data communication based on image processing, in accordance with an embodiment of the disclosure.FIGS. 3A to 3Chave been explained in conjunction with elements fromFIG. 1andFIG. 2. With reference toFIG. 3A, there is shown a smartphone302, a user interface (UI)304, a schematic representation of a layout on the UI304, which comprises a FOV306, a plurality of icons308ato308h, and a first set of control buttons310, rendered at the UI304. The plurality of icons308ato308hmay correspond to the content items compatible with the second electronic device104aand the third electronic device104b. There is further shown the second electronic device104a, the third electronic device104b, and the image-capturing unit212(FIGS. 1 and 2). The user110may be associated with the smartphone302.

In accordance with the first exemplary scenario, the smartphone302may have functionalities similar to that of the first electronic device102. The smartphone302, the second electronic device104a, and the third electronic device104bmay correspond to the IoT devices connected to the wireless communication network106. The UI304may correspond to the UI108of the first electronic device102(FIGS. 1 and 2). The smartphone302may be configured to store certain number of the device settings. The user110may want to control an IoT device, such as the second electronic device104aor the third electronic device104b, from the smartphone302, such as playing a media item on the desired IoT device.

For the control of the IoT device, identification of the device-type displayed in the FOV306and the content items that may be compatible to be played on the identified device-type of the IoT device may be required. Some content item may not be compatible with the second electronic device104aor the third electronic device104b. For example, a file with extension .doc may not be compatible with an IoT device, such as the second electronic device104a, the third electronic device104b, or a lighting device (such as an IoT light bulb). Hence, the plurality of icons308ato308h, as rendered on the smartphone302, via the UI304, may correspond to links to retrieve the content items compatible with the identified second electronic device104aor the third electronic device104bwithin the FOV306.

In operation, the user110may point the smartphone302towards one or more IoT devices, such as the second electronic device104aand the third electronic device104b, connected to the wireless communication network106, such as a wireless home network. The smartphone302may be configured to control display of an image, such as the FOV306, on a display of the smartphone302, via the UI304, as shown.

The smartphone302may recognize the second electronic device104aand the third electronic device104bin the FOV306based on an identity parameter associated with the second electronic device104aand the third electronic device104b. The smartphone302may identify the second electronic device104ato be a television (TV), and identify a device-type of the identified second electronic device104ato be a media renderer capable to play a video or an audio. Based on the recognition, the smartphone302may display the plurality of icons308ato308h, which may be casted on (or communicated to) the identified second electronic device104a(the TV).

The smartphone302may generate the first set of control buttons310in accordance with the identified device-type of the second electronic device104aand the third electronic device104b. For instance, the first set of control buttons310, such as play, stop, pause, rewind, forward operations, may be suitable as per the identified device-type of the second electronic device104aand the third electronic device104b. The user110may use the generated set of control buttons310to control playing of the content items compatible with the identified second electronic device104aor the third electronic device104b, by selection of the plurality of icons308ato308h.

With reference toFIG. 3B, there is shown a drag operation312to depict a sequence of operations of the first exemplary scenario, as described inFIG. 3A. There is further shown a first portion314, a second portion316, and a third portion318within the FOV306. In accordance with an embodiment, the user110may select the content item, which may be a movie “efg.mp4”, shown as the icon308b. The user110may drag the selected content item, such as the icon308b, towards a specific electronic device displayed in the FOV306and drop the content item on the specific electronic device. This may enable the selected content item to be played on the specific electronic device.

For example, the user110may select the content item, such as the icon308b, displayed on the UI304. The user110may then drag (shown as the drag operation312) the selected icon308band drop it on the first portion314of the FOV306that includes the third electronic device104b(such as the music system) to play the audio component of the selected content item (the movie “efg.mp4”) to be played on the third electronic device104b. The video component may not be played. In accordance with an embodiment, the video component may be played on the smartphone302. Further, the user110, after a certain time interval, may drag the selected icon308band further drop it on the second portion316of the FOV306that includes the second electronic device104a(such as the TV), as shown. The smartphone302may then also communicate the video component of the selected content item (the movie “efg.mp4”) to be played on the second electronic device104a(the TV) while the audio component of the selected content item (the movie “efg.mp4”) may be played on the third electronic device104b(the music system).

In accordance with an embodiment, the user110may select the content item, such as the icon308b, displayed on the UI304. The user110may then drag the selected icon308band drop it on the third portion318of the FOV306that includes both the second electronic device104aand the third electronic device104b. The third portion318may be a common portion that includes both the second electronic device104aand the third electronic device104bor a free portion of the FOV that may not include any identified device. In this case, the smartphone302may understand what the next corresponding action is for the smartphone302to perform based on the preset device settings. Accordingly, the smartphone302may simultaneously communicate the video component of the selected content item (the movie “efg.mp4”) to be played on the second electronic device104a(the TV) and the audio component of the same content item (the movie “efg.mp4”) to be played on the third electronic device104b(the music system).

With reference toFIG. 3C, there is further shown an AR view320on the UI304. In accordance with the first exemplary scenario, the first electronic device102may be configured to communicate the content item compatible with the specific electronic device by use of the generated AR view320on the smartphone302. The UI304may be configured to display visually perceptible graphical effects, such as arrows, waveforms, symbols, parabolic paths, emoticons, on the AR view320to indicate that the content item or a control signal is currently transferred from the smartphone302to the specific electronic device. Based on the flow of the visually perceptible graphical effects on the AR view320, the user110may monitor transfer of the data while the data is being transferred.

As discussed inFIG. 3B, when the smartphone302communicates the dvideo component of the selected content item (the movie “efg.mp4”) to the second electronic device104a(the TV) and the audio component of the same content item (the movie “efg.mp4”) to the third electronic device104b(the music system), the AR view320may be rendered on the UI304in the smartphone302. In the AR view320, the visually perceptible graphical effects322and324may be rendered on the UI304to indicate a real time transfer of selected content item in accordance to data-type of the content item that is transferred or individual components of the content item currently transferred. For example, a first visually perceptible graphical effect, such as a film strip322, as shown, may denote transfer of a compatible video component of the selected content item to the second electronic device104a(such as the TV). A second visually perceptible graphical effect, such as a flow of music tunes324, as shown, may denote transfer of a compatible audio component of the selected content item to the third electronic device104b(such as the music system). The AR view320with visually perceptible graphical effects, such as the flow of film strip322and the music tunes324, may provide an intuitive experience to a user, such as the user110, while performing the data communication between the smartphone302and the identified electronic devices, such as the second electronic device104aand the third electronic device104b.

FIGS. 4A, 4B and 4C, collectively, illustrate a second exemplary scenario for the implementation of the disclosed system and method for data communication based on image processing, in accordance with an embodiment of the disclosure.FIGS. 4A, 4B, and 4Chave been explained in conjunction with elements fromFIGS. 1, 2, 3A, 3B, and 3C. With reference toFIG. 4A, there is shown the smartphone302, the UI304, a schematic representation of a layout on the UI304, which comprises a first FOV402, and a plurality of control buttons404ato404h. There is further shown a plurality of IoT light bulbs406ato406d. The plurality of control buttons404ato404hmay be a second set of control buttons different from the first set of control buttons310, as described in theFIGS. 3A to 3C.

In accordance with the second exemplary scenario, the plurality of IoT light bulbs406ato406dmay correspond to the one or more other electronic devices104. The plurality of IoT light bulbs406ato406dand the smartphone302may be connected to the wireless home network, such as the wireless communication network106. The IoT light bulbs406a,406cand406dmay be in “ON” operation state, whereas the IoT light bulb406bmay be in “OFF” operation state.

In operation, the user110may point the image-capturing unit212of the smartphone302towards the plurality of IoT light bulbs406ato406d. A simple pointing of the smartphone302may automatically change the current operation state of the IoT light bulb406bsuch that the IoT light bulb406bis turned “ON”, while other IoT light bulbs406a,406c, and406d, may continue to be in “ON” operation state. The smartphone302may intelligently take an action to selectively control the IoT light bulb406bfrom the plurality of IoT light bulbs406ato406dbased on a selected device setting associated with the identified plurality of IoT light bulbs406ato406d.

For example, based on the image processing of the displayed image that corresponds to the first FOV402, the smartphone302may detect one or more visual cues, such as texture, shape, size, and/or a device mark, of the detected plurality of IoT light bulbs406ato406din the displayed image. The detected one or more visual cues may then be used to retrieve an identity parameter associated with the detected plurality of IoT light bulbs406ato406dfrom the wireless home network, such as the wireless communication network106. The smartphone302may identify the detected plurality of IoT light bulbs406ato406dbased on the retrieved identity parameter, such as a unique device identifier, associated with the plurality of IoT light bulbs406ato406d. In accordance with an embodiment, the position of the smartphone302and IoT devices, such as the IoT light bulbs406ato406d, may be further used as one of the parameters to identify the IoT device(s) to be controlled. The sensing devices208, such as gyroscope, GPS, compass, accelerometer, depth sensor, and the like, may be used to identify the position of the smartphone302.

The smartphone302may be configured to control one or more of the identified plurality of IoT light bulbs406ato406dbased on device settings associated with the identified plurality of IoT light bulbs406ato406d. When the device-type of each of the plurality of IoT light bulbs406ato406dis identified as lighting device in the displayed image and the operation state of one or more of the plurality of IoT light bulbs406ato406dis determined to be in “OFF” state, the control (based on a device setting for lighting device) in this example may be to communicate a control command, via the wireless home network, to the IoT light bulb406bto power “ON” the IoT light bulb406b.

In accordance with an embodiment, the user110may manually select and change the operation state of the identified plurality of IoT light bulbs406ato406dby use of the plurality of control buttons404ato404h. The plurality of control buttons404ato404hmay be generated and displayed on the UI304, as per the identified device-type and device capability of the plurality of IoT light bulbs406ato406d. In accordance with an embodiment, the generation of the plurality of control buttons404ato404hmay occur after an initial automatic and intelligent change of the operation state of the plurality of IoT light bulbs406ato406dhave been performed based on the pre-set device settings or machine learning. The plurality of control buttons408ato408hmay correspond to an “ON” and “OFF” graphical controls to control an operation state of each of the plurality of IoT light bulbs406ato406d, as shown. The user110may manually select a control button from the plurality of control buttons404ato404hto select and change a current operation state of each of the plurality of IoT bulbs406ato406d.

In accordance with an embodiment, the pre-set device settings may be reconfigured by the smartphone302by use of machine learning based on a temporal analysis of the operations previously performed, such as historical actions taken by the user110via the UI304, with respect to the the plurality of IoT light bulbs406ato406d. For example, based on time of present day, the operation state of the IoT bulb406amay be turned OFF when the time is detected as day time or may be turned ON when the time is detected as night time. In accordance with an embodiment, luminance of the plurality of IoT light bulbs406ato406dmay also be controlled.

With reference toFIG. 4B, there is further shown a second FOV408and a slider control button410rendered on the UI304. The user110may point the image-capturing unit212of the smartphone302towards the IoT light bulb406asuch that the current FOV (that is the second FOV408) including a single device, such as the IoT light bulb406a, as shown. In this case, a simple pointing of the smartphone302may automatically change the operation state of the IoT light bulb406a. For example, when a single lighting device is identified in the second FOV408, the smartphone302may be configured to control the identified IoT light bulb406ato power “OFF” the IoT light bulb406aif the IoT light bulb406ais “ON” or vice-versa.

Further, the slider control button410may be rendered in accordance with identified device-type and device capability of the device, such as the IoT light bulb406a, in the second FOV408. The user110may provide an input via the UI304, to slide the slider control button410to “OFF” state. The smartphone302may then communicate a control command to the IoT light bulb406ato change the current operation state of the IoT light bulb406ato “OFF” operation state.

With reference toFIG. 4C, there is further shown a third FOV412, a third set of control buttons414, and a new IoT device, such as a IoT-enabled fan416, as viewed via a viewfinder of the image-capturing unit212. The user110may point the image-capturing unit212of the smartphone302towards the IoT light bulbs406cand406dand the IoT-enabled fan416. Accordingly, an image that corresponds to the third FOV412may be displayed on the UI304, as shown. The smartphone302may be configured to generate the third set of control buttons414, in accordance with the identified device-type and device capability of the devices in the third FOV412. For example, in addition to the “ON” and “OFF” control buttons generated for the control of the identified IoT light bulbs406cand406d, new control buttons414aand414b(represented as “HIGH” and “LOW”) may be generated and rendered on the UI304to enable speed regulation of the IoT-enabled fan416. A selection of the control button414afrom the UI304may increase the speed of the IoT-enabled fan416in real-time. Similarly, a selection of the control button414bfrom the UI304may decrease the speed of the IoT-enabled fan416. Thus, the smartphone302may intelligently control the identified devices in a simplified manner by just pointing of the image-capturing unit212of the smartphone302towards the identified devices in the wireless home network. Further, an intuitive experience may be provided to the user110to effectuate the communication and control via the UI304rendered on the smartphone302.

It should be understood by one skilled in the art that the various embodiments are not limited to specific type of electronic devices, such as the IoT light bulbs406ato406dor the IoT-enabled fan416. Accordingly, other suitable electronic devices or IoT devices, such as smart microwaves or refrigerators, may be controlled by performing similar operations as described with regards to the second electronic device104a, the third electronic device104b, the IoT light bulbs406ato406d, and/or the IoT-enabled fan416without departing from the spirit and scope of the disclosure. Thus, the smartphone302may intelligently control the identified devices in a simplified manner by just pointing of the image-capturing unit212of the smartphone302towards the identified devices in the wireless home network. For example, regulating temperature and time to cook in case of controlling of microwaves, and regulating cooling or power “ON” or “OFF” in case of refrigerators as per identified device type.

FIG. 5is a flow chart that illustrates an exemplary method for data communication based on image processing, in accordance with an embodiment of the disclosure. With reference toFIG. 5, there is shown a flow chart500. The flow chart500is described in conjunction with elements fromFIGS. 1, 2, 3A. The method starts at step502and proceeds to step504.

At step504, display of an image on the first electronic device102, may be controlled. The image may comprise one or more other electronic devices104. At step506, one or more visual cues associated with one or more other electronic devices104in the displayed image, may be detected.

At step508, an identity parameter associated with the one or more other electronic devices104may be retrieved from the wireless communication network106. The identity parameter of the one or more other electronic devices104may correspond to the IP address, the MAC address, the unique device identifier, and/or the SSID. The retrieval of the identity parameter may be performed based on pre-mapped data that includes a unique device identifier of each connected device in the wireless communication network106in an associative relationship with corresponding one or more visual cues associated with a plurality of electronic devices connected to the wireless communication network106. The plurality of electronic devices may include the one or more other electronic devices104. At step510, the one or more other electronic devices104, may be identified based on the retrieved identity parameter associated with the one or more other electronic devices104.

At step512, a device-type of the identified one or more other electronic devices104may be identified. The device-type may be identified based on the detected one or more visual cues, the retrieved identity parameter, a location of the first electronic device102, an orientation of the first electronic device102with respect to the one or more other electronic devices104, and/or a distance of the one or more other electronic devices104from the first electronic device102that displays the image. At step514, a connection with the identified one or more other electronic devices104may be established in the wireless communication network106.

At step516, a specific device setting from preset device settings associated with the plurality of electronic devices connected to the wireless communication network106, may be selected. The device settings may be preset based on a user-preference associated with an operation to be performed for the plurality of electronic devices that includes the one or more other electronic devices104, and/or a device-type of each of the plurality of electronic devices. At step518, a specific electronic device, such as the second electronic device104a, of the identified one or more other electronic devices104may be controlled. The second electronic device104amay be controlled based on the device settings associated with the identified one or more other electronic devices104. The control of the second electronic device104aor the identified one or more other electronic devices104may be based on one or more criteria. The one or more criteria may be the identified device-type, a current operation state, a data-type of a content item to be communicated, one or more compatible content items, and/or control functions supported by the second electronic device104aor the identified one or more other electronic devices104. The selection of the specific device setting may also be performed based on similar criteria, such as the one or more criteria, discussed above.

At step520, an augmented-reality (AR) view, such as the AR view320, may be generated on the first electronic device102to enable control of the identified one or more other electronic devices104. In other words, the AR view320may be an intuitive view that may facilitate a user to control the identified one or more other electronic devices104. However, the actual communication between various devices may occur in the backend and may be based on user action or input for such control. In accordance with an embodiment, the AR view may include a field-of-view (FOV) of the one or more other electronic devices104, one or more graphical controls associated with the identified one or more other electronic devices104that may be displayed within the FOV, and/or one or more content items compatible with the identified device-type of the identified one or more other electronic devices104. The one or more graphical controls may be generated on the AR view in accordance to the identified device-type of each of the identified one or more other electronic devices104within the FOV (a currently displayed FOV or image) for the control. The control may pass to end step522.

In accordance with an embodiment of the disclosure, a system for data communication based on image processing is disclosed. The system (such as the first electronic device102(FIG. 1) may comprise one or more circuits (hereinafter referred to as the processor202(FIG. 2)). The processor202may be configured to control display of an image on the first electronic device102. The image may include the one or more other electronic devices104. The one or more other electronic devices104in the displayed image may be identified based on an identity parameter associated with the one or more other electronic devices104. The second electronic device104aof the identified one or more other electronic devices104may be controlled based on device settings associated with the identified one or more other electronic devices104.

Various embodiments of the disclosure may provide a non-transitory computer readable medium and/or storage medium, and/or a non-transitory machine readable medium and/or storage medium having stored thereon, a machine code and/or a set of instructions executable by a machine and/or a computer to perform data communication based on image processing. The set of instructions may cause the machine and/or computer to perform the steps that comprise control of an image on the first electronic device102. The image may include one or more other electronic devices104communicatively coupled to the wireless communication network106. The one or more other electronic devices104may be identified in the displayed image based on an identity parameter associated with the one or more other electronic devices104. An IoT device, such as the second electronic device104a, of the identified one or more other electronic devices104may be controlled based on pre-defined device settings. The pre-defined device settings may be associated with the one or more other electronic devices104.