Patent Description:
Many vehicle manufacturers provide nowadays their manufactured vehicles with a built-in media center, which includes, inter-alia, a touch screen. Such touch screen is typically installed in the dashboard of the vehicle, so as to allow the driver and the passenger seated next to the driver to operate the media center by inputting operation commands using the touch screen.

Typically media centers offer the driver and the passengers of the vehicle information and entertainment (often called in short "infotainment"). This may include presenting various driving and/or vehicle parameters, such as the pressure status of the tires, gear status, etc., providing video (e.g. presenting rear camera view upon shifting the gear to reverse the vehicle), displaying navigational information, such as a map with navigational indications, etc..

Various arrangements were introduced to allow connectivity between a mobile phone and the media center of a vehicle, and in particular connectivity between a mobile phone and the screen of such a media center.

For example, <CIT>), disclosed a communication system of a motor vehicle that includes a vehicle operating unit, a vehicle output unit, and an interface computer. The interface computer is connected to the vehicle operating unit and the vehicle output unit. The interface computer is implemented for the purpose of connecting a mobile terminal to the vehicle operating unit and the vehicle output unit such that information from the mobile terminal is displayable on the vehicle output unit and the mobile terminal is operable via the vehicle operating unit.

In <CIT>), there was disclosed a connection device for applying functions of a mobile phone to a vehicle, which embodies a connection configuration for interconnecting a mobile device and an audio-video (A/V) system of the vehicle such that the functions of the mobile device, such as image output, hands-free communication, the camera, and navigation (GPS) can be interlinked to the A/V system of the vehicle, a driver may easily operate each function of the mobile phone using a vehicle monitor, and functions of the camera, navigation and the like may be performed by the mobile phone even when such functions are not installed in the vehicle. To this end, a connection device for applying the functions of a mobile phone to a vehicle involves interconnecting the mobile phone and an A/V device of the vehicle so as to relay content to one another, operate the functions of the mobile phone in the vehicle, and enable the content being displayed on the mobile phone to be displayed on a monitor installed in the vehicle. The connection device includes a cradle in which the mobile phone having a touch-switching function is placed; an electromagnetic-wave touch module, which is arranged within the cradle in which the mobile phone is placed, such that the electromagnetic-wave touch module faces the touch-switching display of the mobile phone, wherein the electromagnetic- wave touch module converts, upon the occurrence of a touch signal on the monitor installed in the vehicle, a value of touch coordinates of the monitor of the vehicle to the value of touch coordinates corresponding to the size of the display of the mobile phone, and emits electromagnetic waves to the corresponding point on the display of the mobile phone placed in the cradle so as to perform the touch-switching function of the mobile phone; and a data-processing unit electrically connected to the mobile phone and to the A/V device of the vehicle so as to convert, when the switching function is performed in the mobile phone placed in the cradle by the electromagnetic-wave touch module, the drive data to be processed in the mobile phone into data that can be processed in the A/V device of the vehicle, and output the converted data to check a state of operating and driving the mobile phone via the monitor of the vehicle.

In <CIT> of Japan) a display duplication apparatus for a vehicle was disclosed, such that regions of a display of a mobile device may be replicated to one or more display of a vehicle. The apparatus includes an input connected to receive a display signal from a portable device (e.g. a mobile phone, smart phone or PDA) and a first display configured to display an invitation for input to define a selected interface region from a display output of the portable device. The first display is further configured to display an invitation for input to define a target display location of the vehicle and the apparatus can further include a number of displays, configured to display a selected interface region at a defined target display location of the vehicle. Regions of the portable device's display may be selected by touch (defining the region), though a template, by cursor control or by voice control. A target display such as a head-up display may then be selected.

<CIT>) there was disclosed a touch screen for use in motor vehicle to control e.g. navigational function. The screen has a touch surface for displaying data and for inputting commands by a user. An interface having a Bluetooth <NUM> type wireless connection connects the screen to a mobile phone. A processing unit transfers the commands that are input on the surface to the mobile phone for controlling the mobile phone. The processing unit displays the data displayed by the mobile phone, on the touch surface. An audio output connects the screen to an audio device of a motor vehicle.

In <CIT> there was disclosed a method for driving a mobile telecommunication device using a navigation apparatus to use a mobile telecommunication device conveniently in various ways by using a monitor of a heterogeneous device as an input unit. Data for the cell coordinates of a navigation touch screen is matched with the cell coordinates of a mobile phone touch screen. When the touch input happens on a navigation touch screen, the cell coordinates of the touched point is transmitted to a cellular phone through an input/output interface. The received cell coordinate is recognized as the cell coordinates of the mobile phone touch screen and is displayed through the navigation monitor.

<CIT>) discloses methods and apparatus particularly suited for applications in a vehicle, to provide a wide range of information, and the safe input of data to a computer controlling the vehicle subsystems or "Telematic" communication using for example GM's "ONSTAR" or cellular based data sources. Preferred embodiments utilize new programmable forms of tactile touch screens and displays employing tactile physical selection or adjustment means which utilize direct optical data input. A revolutionary form of dashboard or instrument panel results which is stylistically attractive, lower in cost, customizable by the user, programmable in both the tactile and visual sense, and with the potential of enhancing interior safety and vehicle operation. Non-automotive applications of the invention are also disclosed, for example means for general computer input using touch screens and home automation systems.

The closest prior art document <CIT> discloses a vehicle user interface systems and methods having a processing circuit configured to receive, process, transmit and provide information regarding a vehicle operational mode (e.g., from a vehicle subsystem), and to provide information to a portable electronic device.

The invention is defined in the independent method claim <NUM>.

There is thus provided method steps for promoting connectivity between a mobile communication device having a touch screen and a vehicle touch screen installed in a vehicle as defined in the annexed claims <NUM> to <NUM>.

In the following detailed description, numerous specific details are set forth in order to provide a thorough understanding of the methods and systems. However, it will be understood by those skilled in the art that the present methods and systems may be practiced without these specific details. In other instances, well-known methods, procedures, and components have not been described in detail so as not to obscure the present methods and systems.

Although the examples disclosed and discussed herein are not limited in this regard, the terms "plurality" and "a plurality" as used herein may include, for example, "multiple" or "two or more". The terms "plurality" or "a plurality" may be used throughout the specification to describe two or more components, devices, elements, units, parameters, or the like. Unless explicitly stated, the method examples described herein are not constrained to a particular order or sequence. Additionally, some of the described method examples or elements thereof can occur or be performed at the same point in time.

Unless specifically stated otherwise, as apparent from the following discussions, it is appreciated that throughout the specification, discussions utilizing terms such as "adding", "associating" "selecting," "evaluating," "processing," "computing," "calculating," "determining," "designating," "allocating" or the like, refer to the actions and/or processes of a computer, computer processor or computing system, or similar electronic computing device, that manipulate, execute and/or transform data represented as physical, such as electronic, quantities within the computing system's registers and/or memories into other data similarly represented as physical quantities within the computing system's memories, registers or other such information storage, transmission or display devices.

Embodiments of the present invention relate to a method for promoting connectivity between a mobile communication device and a touch screen of a vehicle (hereinafter - "vehicle touch screen"). In the context of the present invention a "mobile communication device" refers to any portable communication device that has a touch screen on which a graphical user interface is displayed, and on which a user may input information and/or commands (hereinafter - "commands" for short), such as, for example a smartphone (e.g. iphone™ operated by iOS, manufactured and distributed by Apple™, and Android based smartphones, such as, for example, Galaxy™ manufactured and distributed by Samsung™, and the like).

Typically a vehicle touch screen is a component of a media center unit that is provided as a standard in many vehicles (particularly in high-end cars, but increasingly in many other mid-range and even low-end cars and other vehicles). The vehicle touch screen is typically designed by vehicle makers to present the driver and passengers of the vehicle with infotainment, such as, for example, navigation information, local and/or driving conditions (e.g. outside temperature, inside temperature, air-condition status, inflation pressure of tires, etc.). In some vehicles that include, as standard, a rear (and/or front) camera, the vehicle touch screen is used for displaying video acquired by that camera, either upon receiving a user induced command (e.g. user operating a selector button and selecting viewing video using the camera) or automatically upon detection of setting the gear in reverse mode.

Embodiments of the present invention include methods for promoting connectivity between a mobile communication device (hereinafter - "smartphone" for brevity) and a vehicle touch screen.

In essence, a controller is used as a mediator between the vehicle touch screen and the smartphone. The controller is designed to forward video signal that includes a current screen video image shown on the touch screen of the smartphone so as to present that video image on the vehicle touch screen. The controller is also designed to receive signals from the vehicle touch screen indicative of touch actions sensed on that screen and forward these signals to the smartphone such that the smartphone is made to respond to these touch actions as if they were performed on the touch screen of that smartphone.

A touch action, in the context of the present specification, refers to, unless specifically indicated otherwise, any action performed over the touch screen, e.g. pressing, sliding, tapping, etc..

In some embodiments of the present disclosure any other action that was performed by a user on any button associated with the vehicle the touch screen, or associated with another element of the vehicle electronic system, may be sensed by the controller and interpreted by the controller as an operation command to activate the smartphone in a predetermined manner. An "operation command" in the context of the present specification may refer to any operation command in the broadest scope of that term, e.g. an activation of a program, input of a command or data, displaying of information or graphical data on the screen of the smartphone, generating an audio signal, etc..

The controller may be designed to convert the format and/or resolution of the video signal received from the smartphone to the appropriate video format and/or resolution that the vehicle touch screen can use.

The controller would typically include a switching unit that would be installed on a communication line between the media computer of the vehicle and the vehicle touch screen, so as to allow the controller to switch a live link to the vehicle touch screen between the media computer and the smartphone (via the controller).

<FIG> illustrates a system <NUM> in which the claimed invention is implemented for promoting connectivity between a smartphone <NUM><NUM> and a touch screen <NUM> of a vehicle, in accordance with an embodiment of the present invention. Vehicle touch screen <NUM> may include a touch sensitive surface <NUM> which is sensitive to touching. When the touch sensitive surface <NUM> is touched, a signal is generated which may be interpreted by a controller <NUM> of the vehicle touch to determine the exact position on the touch sensitive surface <NUM> that was touched. Vehicle touch screen <NUM> may include Human-Machine Interface (HMI) devices, such as, for example, buttons, switches, selectors and/or other HMI devices 108a-108d (hereinafter - "buttons", e.g. physical, mechanical buttons or virtual touch sensitive areas that are designated to act as buttons).

Touch screen <NUM> is typically connected by wiring <NUM><NUM><NUM> (e.g. a wire or a plurality of wires) to a video source of the vehicle (e.g. media computer <NUM> of the vehicle).

System <NUM> typically includes a controller <NUM><NUM> and a switching unit <NUM><NUM> connected to controller <NUM><NUM>.

Controller <NUM><NUM> is designed to allow a user to connect their smartphone <NUM><NUM> to the controller via communication cable <NUM><NUM> (e.g. a USB cable, which may also serve to charge the smartphone's rechargeable power source).

Switching unit <NUM><NUM> is designed to be connected to wiring <NUM><NUM><NUM> that links media computer <NUM> to vehicle touch screen <NUM>. This requires severing wiring <NUM><NUM><NUM> (e.g. cutting of the wiring) and connecting switching unit <NUM><NUM> in between so that it may switch a live link to vehicle touch screen <NUM> between media computer <NUM> and smartphone <NUM><NUM> via controller <NUM><NUM> so as to determine the feed source for the vehicle touch screen. Controller <NUM><NUM> is designed to issue switching commands to switching unit <NUM><NUM> to select the feed source for vehicle touch screen <NUM> (either media computer <NUM> or controller <NUM><NUM>). In some embodiments of the present invention the switching unit <NUM><NUM> would concurrently provide live video link from both sources (media computer <NUM> or controller <NUM><NUM>) to be displayed on the vehicle touch screen (e.g. using picture in picture - PIP - video method).

The controller <NUM><NUM> may be designed to select a live link between smartphone <NUM><NUM> and vehicle touch screen <NUM>, when smartphone <NUM><NUM> is connected to controller <NUM><NUM> (e.g. when communication cable <NUM><NUM> connected to controller <NUM><NUM> is plugged to the smartphone). The user may manually select to activate a live link between smartphone <NUM><NUM> and vehicle touch screen <NUM>.

Many smartphones (e.g. iphones, many Android based smartphones) are designed to automatically generate a video signal containing video image of a current screen display content of that smartphone when connected to a communication cable. Other smartphone may require setting up to facilitate the generation of such video signal. The video signal is transmitted from smartphone <NUM><NUM> to controller <NUM><NUM> via communication cable <NUM><NUM>.

The controller <NUM><NUM> may be designed to convert the video signal of the current smartphone screen generated by smartphone <NUM><NUM> to the appropriate video format or formats and/or the appropriate video resolution using a video processor.

For that aim, the controller <NUM><NUM> is designed to automatically determine the type of touch screen of the vehicle. This may be facilitated, for example by listening or otherwise sensing the communications between media computer <NUM> and vehicle touch screen <NUM> and identifying the vehicle model and determining the type of touch screen based on the identification of the vehicle model, or otherwise identifying the touch screen type and the video formats and/or video resolution suitable for that screen. A user may be required to set up the controller or otherwise select the appropriate video format or formats appropriate for that particular vehicle touch screen <NUM>.

Controller <NUM><NUM> may cause switching unit <NUM><NUM> to maintain a live link between smartphone <NUM><NUM> and vehicle touch screen <NUM>, so that the video of the current smartphone screen is displayed on the vehicle touch screen <NUM>.

In order to facilitate operation of the smartphone via the vehicle touch screen signals indicative of a location touched on the touch sensitive surface <NUM> of vehicle touch screen <NUM>, which are generated by controller <NUM>, may be interpreted by controller <NUM><NUM> to a corresponding position on the touch screen <NUM><NUM> of smartphone <NUM><NUM> and forwarded to smartphone <NUM><NUM>. The interpreted corresponding location on the touch screen <NUM><NUM> of smartphone <NUM><NUM> may be used by the operating system of smartphone <NUM><NUM> to activate the smartphone as if the corresponding location on the touch screen <NUM><NUM> of smartphone <NUM><NUM> was actually pressed. A dedicated application would be designed to run on smartphone <NUM><NUM> to facilitate that activation.

A corresponding mapping of the smartphone screen <NUM><NUM> and of the vehicle touch screen <NUM> may be required. In some embodiments a transformation function would be used to match the position pressed on the vehicle touch screen <NUM> with the corresponding position on the smartphone touch screen <NUM><NUM>. The orientation of the vehicle touch screen <NUM> and of the touch screen of the smartphone may be considered and correlated. While it is likely that vehicle touch screen <NUM> be fixed and its reorientation impossible, the orientation of the smartphone may be determined and changed by the user. Thus information on the orientation of the smartphone screen may be useful in transforming the location on the vehicle touch screen that was pressed to the corresponding location on the smartphone screen.

The orientation of the smartphone may be determined and taken in account in the transformation function. In other embodiments the user may be instructed to place the smartphone in a specific orientation (e.g. landscape or portrait) so as to facilitate simpler transformation.

Using wired connections as described in the present specification, and employing simple yet accurate transformation function may result in a very efficient and fast operation of the smartphone via the vehicle touch screen. Practically on-line operation may be achieved, as a result of very fast response times (typically of one or a few milliseconds), as opposed to slower wireless communication formats.

The switching between media computer <NUM> and smartphone <NUM><NUM> via controller <NUM><NUM>, carried out by switching unit <NUM><NUM>, may be designed to be automatic, when certain predetermined condition or conditions are met. For example, controller <NUM><NUM> may be designed to maintain a live link between smartphone <NUM><NUM> and vehicle touch screen <NUM>, and override that live link by switching the live link to media computer <NUM> when the gear of the vehicle is shifted to reverse mode, so as to allow video from a rear camera that is provided via media computer <NUM> to be displayed on vehicle touch screen <NUM>. The controller <NUM><NUM> may be designed to hide the smartphone screen that is displayed on the vehicle touch screen to prevent driver distraction. In some such embodiments the hiding of the smartphone screen may be carried out manually (e.g. by the driver or a passenger). The smartphone screen would be hidden automatically by controller <NUM><NUM>, for example, when specific predetermined driving scenario and/or vehicle state is determined (e.g. sensed or otherwise determined). For example, if the vehicle is braked urgently once or a plurality of times (indicating a possible negligence of the driving conditions by the driver), the controller may be designed to detect this state and hide the smartphone screen from the vehicle touch screen.

The witching may be manual. The switching unit may be designed to facilitate both manual and automatic switching.

The controller <NUM><NUM> may be designed to interpret pressing or otherwise operating an HMI device, e.g. a button or a plurality of buttons of buttons 108a-108d as a predetermined command. Thus, for example, pressing and holding the volume button (e.g. button 108b) of touch screen for a minimal period of time (e.g. <NUM> seconds) may be interpreted to increase (or decrease) the volume of audio signal generated by smartphone <NUM><NUM>, or to activate the mute state of the smartphone. Similarly other functions associated with the smartphone operation may be assigned to one or a plurality of buttons of the vehicle touch screen. In some embodiments of the present invention user customization of such buttons may be offered.

Moreover, operation of other buttons of the vehicle (e.g. window control buttons, mirror adjustment buttons, air-conditioning operation buttons, etc.) may be detected by controller <NUM><NUM> (for example by listening, or otherwise sensing communications associated with one or a plurality of VC buses) and interpreted in a predetermined manner. In some embodiments user customization of these buttons may be offered.

Controller <NUM><NUM> may be designed to listen to or otherwise sense communications between various vehicle communication (VC) buses (e.g. <NUM>, <NUM>) of the electronic system of the vehicle.

Example of VC buses may include Controller Area Network (CAN) buses that are typically present in a vehicle. CAN bus is a vehicle bus standard designed to allow microcontrollers and other devices to communicate with each other within a vehicle, without the need of a host computer. CAN bus operates as a message-based protocol, specifically designed for automotive applications (although other applications may be found that use CAN buses). A vehicle may typically have dozens of processors - usually referred to as Electronic Control Units (ECUs) - designed for various subsystems. Typically the biggest processor is the Engine Control Module (ECM). Other processors may be used for transmission, airbags, antilock braking systems (ABS), cruise control, electric power steering, audio systems, windows, doors, mirror adjustment, battery and recharging systems in hybrid or electric vehicles, etc. Some ECUs form independent subsystems, but for most communications among them are essential. A subsystem may require controlling actuators or receiving sensor signals. The CAN standard was primarily developed to meet that need.

The controller <NUM><NUM> is designed to listen to communications of a single or a plurality of VC buses so as to be able to receive and/or determine various parameters, states and/or any information associated with the vehicle (hereinafter - information associated with the vehicle). For example, controller <NUM><NUM> may be designed to identify shifting between various vehicle gear states, identify closing and/or opening of a window or windows and or door or doors of the vehicle. Identifying or determining the current state or values of parameters associated with the vehicle may be used in an algorithm for operating controller <NUM><NUM> and/or switching unit <NUM><NUM>.

The information associated with the vehicle may be processed or otherwise used by the smartphone. For example, the information associated with the vehicle may be displayed on the screen of the smartphone and/or on the vehicle touch screen. An application running on the smartphone may process or otherwise use the information associated with the vehicle.

The information associated with the vehicle may include HMI device inputs, vehicle diagnostics, vehicle energy and fuel consumption, driver behavior, sensors information (for example, from tire pressure to number and identity of passengers in the vehicle), GPS location data, vehicle operational parameters , such as, for example, velocity, breaking, steering wheel angle, gear, etc..

<FIG> illustrates a method of promoting connectivity between a mobile communication device having a touch screen and a vehicle touch screen installed in a vehicle, according to an embodiment of the present invention.

Method <NUM> includes connecting <NUM> a controller to the mobile communication device and to the vehicle touch screen. Method <NUM> also includes receiving <NUM> video signal of a current screen video image shown on the touch screen of the mobile communication device and transmitting the current video image via the controller to the vehicle touch screen, causing a corresponding video image of the current screen video image to be displayed on the vehicle touch screen. Method <NUM> further includes receiving <NUM> by the controller a signal indicative of a touch action that was performed on the vehicle touch screen, and causing the mobile communication device to respond as if a touch action corresponding to the touch action that was performed on the vehicle touch screen was performed on the touch screen of the mobile communication device.

<FIG> illustrates a controller <NUM> of a system for promoting connectivity between a smartphone and a touch screen of a vehicle.

Controller <NUM> may include a processing unit <NUM> (e.g. one or a plurality of processors, on a single machine or distributed on a plurality of machines) for executing a method according to embodiments of the present invention. Processing unit <NUM> may be linked with memory <NUM> on which a program implementing a method according to embodiments of the present invention and corresponding data may be loaded and run from, and video processor <NUM>, for processing the video signal received via the input interface <NUM> (e.g. convert video format and/or resolution if the input video signal to a suitable video format and/or resolution for the vehicle touch screen).

A non-transitory computer readable medium (or mediums) such as, for example, one or a plurality of hard disks, flash memory devices, etc. may include data (e.g. dynamic object information, values of fields, etc.) and a program implementing a method according to examples and corresponding data may be stored. System <NUM> may further include switching unit <NUM> configured to be connected between a media bus of the vehicle and the vehicle touch screen. System <NUM> may also include input device <NUM> , such as, for example, one or a plurality of keyboards, pointing devices, touch sensitive surfaces (e.g. touch sensitive screens), etc. for allowing a user to input commands and data.

Examples may be embodied in the form of a system, a method or a computer program product. Similarly, examples may be embodied as hardware, software or a combination of both. Examples may be embodied as a computer program product saved on one or more non-transitory computer readable medium (or media) in the form of computer readable program code embodied thereon. Such non-transitory computer readable medium may include instructions that when executed cause a processor to execute method steps in accordance with examples. In some examples the instructions stores on the computer readable medium may be in the form of an installed application and in the form of an installation package.

Such instructions may be, for example, loaded by one or more processors and get executed.

For example, the computer readable medium may be a non-transitory computer readable storage medium. A non-transitory computer readable storage medium may be, for example, an electronic, optical, magnetic, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof.

Computer program code may be written in any suitable programming language. The program code may execute on a single computer system, or on a plurality of computer systems.

Examples are described hereinabove with reference to flowcharts and/or block diagrams depicting methods, systems and computer program products.

Claim 1:
A method of promoting connectivity in a vehicle between a mobile communication device (<NUM>) having a touch screen (<NUM>) and a vehicle touch screen (<NUM>) installed in the vehicle and connected by wiring to a video source (<NUM>) of the vehicle, the video source of the vehicle being a built-in media computer of the vehicle, the method comprising:
connecting a controller (<NUM>) to the mobile communication device (<NUM>) and to the vehicle touch screen (<NUM>);
receiving video signal of a current screen video image shown on the touch screen (<NUM>) of the mobile communication device (<NUM>) and transmitting the current video image via the controller to the vehicle touch screen (<NUM>), causing a corresponding video image of the current screen video image to be displayed on the vehicle touch screen (<NUM>),
receiving by the controller a signal indicative of a touch action that was performed on the vehicle touch screen, and causing the mobile communication device to respond as if a touch action corresponding to the touch action that was performed on the vehicle touch screen was performed on the touch screen of the mobile communication device, wherein the method further comprises
connecting a switching unit to the wiring (<NUM>) that links the video source (<NUM>) to the vehicle touch screen (<NUM>), wherein the switching unit is configured to switch a live video link to the vehicle touch screen between the mobile communication device and the video source (<NUM>) of the vehicle;
configuring the controller to operate the switching unit, and
providing the live video link to the vehicle touch screen (<NUM>) concurrently from the mobile communication device and the video source of the vehicle, using the switching unit (<NUM>),
wherein connecting the switching unit comprises severing the wiring (<NUM>) and connecting the switching unit (<NUM>) between the video source (<NUM>) and the vehicle touch screen (<NUM>).