Patent Description:
In recent years, technology has been developed for a driver in a traveling vehicle to remotely control target in-vehicle devices such as an air conditioner and a navigation system with the use of a portable terminal and/or a remote controller (hereinafter, collectively referred to as a "control terminal"). Radio wave communication or infrared communication is often used as a means of the communication between the target in-vehicle device and the control terminal, in addition to ultrasonic communication using ultrasonic waves.

Note that ultrasonic waves are susceptible to radio disturbance when disturbance such as an environmental sound occurs in the inaudible sound range (about <NUM> or more) to be used for the ultrasonic communication. For example, the sound of rubbing a vinyl bag contains a frequency component in the inaudible range, and such a sound deteriorates the communication quality of the ultrasonic communication. Patent Document <NUM> (<CIT>) discloses conventional technique.

In order for the user to check whether the contents of the ultrasonic communication are correctly received by the receiving terminal or not, there is a demand for technology to visualize the communication quality of the ultrasonic signal by displaying, for example, an icon.

In particular, due to the characteristics of ultrasonic waves, the communication quality of the ultrasonic communication changes from moment to moment depending on the environment around the vehicle, as exemplified by the traffic conditions at that time, the outside temperature, the weather, and the driving mode. Thus, it is preferred that the display of communication quality also reflects change in communication environment immediately and accurately.

<CIT> relates to a mobile terminal and method for controlling the same. <CIT> relates to a dialogue system, vehicle and method for controlling the vehicle.

An object of the present invention is to provide a remote controller, a communication-environment sending device, a communication-environment check method, and a communication-environment sending method, each of which can keep the display of communication quality accurately reflecting change in communication environment of the ultrasonic communication.

A communication-environment sending device according to an aspect of the present invention includes a detector, an in-vehicle controller, and a sender. The detector is provided in a vehicle and acquires information related to noise sound in the vehicle. The in-vehicle controller is provided in the vehicle and converts the information related to noise sound into an environment notification signal. The sender sends the environment notification signal to a remote controller disposed in the vehicle. The in-vehicle controller is configured to make the sender send the environment notification signal when a vehicle parameter of the vehicle changes within a predetermined range or in a predetermined manner.

A remote controller according to an aspect of the present invention includes a speaker, an information receiver, a controller, a display, and a memory. The speaker sends an ultrasonic signal that controls an operation of an in-vehicle device. The information receiver detects information related to noise sound inside a vehicle. The controller calculates a propagability index of the ultrasonic signal from the information related to noise sound. The display displays the propagability index as communication quality level of the ultrasonic signal. The memory stores a provision regarding an operable state. The controller is configured to calculate the propagability index when the remote controller shifts to the operable state.

A communication-environment check method that controls an operation of an in-vehicle device by an ultrasonic signal, the communication-environment check method according to an aspect of the present invention includes a receiving step, a calculating a propagability step, a displaying step, and a calculating an operable state step. At the receiving step, information related to noise sound in a vehicle is received. At the calculating the propagability step, the propagability index of the ultrasonic signal from the information related to noise sound is calculated. At the displaying step, the propagability index as a communication quality level of the ultrasonic signal is displayed. At the calculating the operable state step, the propagability index when a state of the in-vehicle device changes to the predetermined operable state is calculated.

A communication-environment sending method achieved by cooperating with a remote controller disposed in a vehicle, and the communication-environment sending method according to an aspect of the present invention includes an acquiring step, a converting step, and a sending step. At the acquiring step, information related to noise sound in the vehicle is acquired. At the converting step, the information related to noise sound into an environment notification signal are converted. At the sending step, the environment notification signal is sent to the remote controller disposed in the vehicle when a vehicle parameter in the vehicle is changed within a predetermined range or in a predetermined manner.

The present invention provides a remote controller, a communication-environment sending device, a communication-environment check method, and a communication-environment sending method, each of which can keep the display of communication quality accurately reflecting change in communication environment of the ultrasonic communication.

Hereinbelow, embodiments of the present invention will be described by referring to the accompanying drawings.

First, a description will be given of a remote controller <NUM> and in-vehicle devices <NUM>, <NUM>, <NUM>, and <NUM> (hereinafter, referred to as "target in-vehicle devices <NUM> to <NUM>"), which are operated by this remote controller <NUM> with the use of an ultrasonic signal Ω, by referring to <FIG>.

<FIG> is a conceptual configuration diagram illustrating a vehicle <NUM> in which the remote controller <NUM> according to the first embodiment and the target in-vehicle devices <NUM> to <NUM> are installed.

<FIG> are schematic diagrams illustrating a smartphone 10a that is one aspect of the remote controller <NUM> according to the first embodiment.

<FIG> is a schematic view of the inside of the vehicle <NUM> provided with a communication-environment sending device <NUM> (hereinafter, simply referred to as "the sending device <NUM>") according to the first embodiment and the target in-vehicle devices <NUM> to <NUM>, when viewed from the roof side.

<FIG> is a schematic view of the periphery of an inner panel <NUM> provided with the sending device <NUM> according to the first embodiment.

The remote controller <NUM> is a portable terminal (i.e., mobile terminal) 10a owned by a user <NUM>, as exemplified by a smartphone shown in <FIG>.

The remote controller <NUM> may also be a PC (Personal Computer), a wearable device, a public terminal, a specially designed and manufactured remote controller, and/or an in-vehicle operation terminal 10b installed around the rear seat 53c.

In the following embodiments, a description will be given of a case where the smartphone (i.e., portable terminal) 10a is used as the remote controller <NUM> by installing an application program developed for remote control in the smartphone 10a.

The remote controller <NUM> includes a speaker <NUM>, a microphone <NUM>, a display <NUM>, a memory <NUM>, and processing circuitry <NUM> as shown in <FIG>.

The memory <NUM> is configured as, for example, a ROM (Read Only Memory), a RAM (Random Access Memory), and/or an HDD (Hard Disk Drive).

The processing circuitry <NUM> implements respective functions of a transmitter/receiver <NUM>, an information receiver <NUM>, a controller <NUM>, and an input/output interface <NUM> by executing the programs stored in the memory <NUM>.

The transmitter/receiver <NUM> transmits an ultrasonic signal Ω (hereinafter, referred to as "the control signal Ω") which controls the operation of the target in-vehicle devices <NUM> to <NUM> via the speaker <NUM>. The speaker <NUM> may be an existing speaker provided for audio or may be a dedicated speaker separately provided for ultrasonic communication. The target in-vehicle devices <NUM> to <NUM> to be remotely controlled by this control signal Ω are, for example, an air conditioner <NUM>, a lighting device <NUM>, a seat <NUM>, and an IVI (In-Vehicle Infotainment) <NUM>. The target in-vehicle devices are not particularly limited to the above aspects as long as they are electronically controllable in-vehicle accessories such as a locking mechanism of a door opening/closing lever, an in-vehicle camera, a conventional navigation system, and an audio device.

The IVI <NUM> is, for example, a system that provides various functions such as a navigation function, a location information service function, a multimedia reproduction function of music and video, a voice communication function, a data communication function, and an Internet connection function in a complex manner.

The IVI <NUM> will be described in detail in the description of the vehicle <NUM> described below.

Each of the target in-vehicle devices <NUM> to <NUM> is connected by a communication network <NUM> in the vehicle such as a CAN (Controller Area Network) and a LIN (Local Interconnect Network). For example, the IVI <NUM> is provided with an ultrasonic receiver <NUM>, and the ultrasonic receiver <NUM> receives the control signal Ω emitted by the remote controller <NUM>. Further, the IVI <NUM> serves as a repeater (i.e., relay device) so as to transmit an operation instruction to the target in-vehicle devices <NUM> to <NUM> via the communication network <NUM>.

The entire system may be configured such that each of the target in-vehicle devices <NUM> to <NUM> is provided with its own ultrasonic receiver <NUM> and is directly and remotely controlled by the remote controller 10a so as to exert its function. In response to remote control, for example, in the case of the multimedia reproduction function of the IVI <NUM>, the functions of start, stop, volume increase/decrease, media reproduction, fast-forward or fast-rewind are executed.

In the following, a description will be given of a case where the IVI <NUM> is used as the representative device of the target in-vehicle devices and a microphone <NUM> capable of detecting ultrasonic waves is provided on the display <NUM> of the IVI <NUM>. Normally, the display <NUM> of the IVI <NUM> is disposed between the driver's seat 53a and the passenger seat 53b on the inner panel <NUM> as shown in <FIG> and <FIG>, i.e., between the speedometer <NUM> and the dashboard <NUM>.

The command of the ultrasonic communication may be acquired from a server <NUM> connected by the Internet <NUM>. In addition, the entire system may be configured such that basic commands are stored and provided by the memories <NUM> and <NUM> of the respective devices <NUM> and <NUM> and additional commands are acquired from the server <NUM>.

Returning to the description of transmitter/receiver <NUM>, the transmitter/receiver <NUM> also sends a notification request signal Σ to the sending device <NUM> when the portable terminal 10a is changed to an operable state.

The notification request signal Σ is a signal that requests the portable terminal 10a to transmit an environment notification signal ε. This environment notification signal ε is a signal in which information related to noise sound (hereinafter, referred to as "noise-related information") is included.

The operable state is defined in advance and stored in the memory <NUM> as a state in which the target in-vehicle devices <NUM> to <NUM> may be remotely controlled by the portable terminal 10a.

For example, the operable state is defined as a state in which the operation restriction of the portable terminal 10a is released, a state in which the display <NUM> is ON, a state in which the remote-control application is started, or a state in which the orientation of the portable terminal 10a matches a predetermined orientation.

For example, even when the remote-control application is running in the background, the portable terminal 10a is placed in the bag or the pocket of the cloth of the user in some cases. If the environment notification signal ε is received when the user <NUM> does not need it, the charge of the portable terminal 10a is wasted. For this reason, the environment notification signal ε is sent to check the communication quality when the portable terminal 10a shifts to the operable state, and thereby, battery usage of the portable terminal 10a is suppressed. Although many timings may be included as the timings of sending the environment notification signal ε, at least one of the sending timings may be defined as a timing in the operable state. For example, every time the operation page <NUM> of the remote-control application changes from the inactive state to the active state, the sending device <NUM> is requested to send the environment notification signal ε.

The noise-related information is information on disturbance that hinders the ultrasonic communication, as exemplified by the traveling speed (i.e., velocity) of the vehicle <NUM>, the traveling acceleration of the vehicle <NUM>, the operating mode of the motor, the operating mode of the engine, the opening degree of the window <NUM>, and the air-flow volume of the air conditioner <NUM>.

For example, in the vehicle <NUM> as shown in <FIG>, an air outlet 51a for the front-seat air conditioner is provided around the inner panel <NUM> and an air outlet 51b for the rear-seat air conditioner is provided in the center of the roof.

The conditioned air σ blown from these air outlets 51a and 51b flows between the IVI <NUM> and the portable terminal 10a held by the user <NUM> seated in the rear seat 53c.

A temperature interface is formed at the boundary between the conditioned air σ and the surrounding air due to the temperature difference. When the control signal Ω enters this temperature interface, it reflects and refracts at the temperature interface and is disturbed by the convection generated by the conditioned air σ. Thus, the conditioned air σ is considered to have a great influence on the ultrasonic communication.

Further, when the air conditioner <NUM> is operated, the operating sound of the air conditioner <NUM> is also generated, as exemplified by the motor sound and the sound of conditioned air σ that contacts the fins of the air outlets 51a and 51b at the time of blowing out of the air outlets 51a and 51b. Since these operating sounds may include ultrasonic waves that cause disturbance in the frequency band to be used for the control signal Ω, such an operating sound of an in-vehicle device is also included in the noise-related information.

Ultrasonic waves can also be generated from, for example, the inflow and outflow of air due to opening of the window <NUM>, the opening and closing sound of the window <NUM>, and the switching noise to be generated from the driving source of the vehicle <NUM> and the battery. Since these noises may also hinder the ultrasonic communication, such noises are also included in the noise-related information.

The transmitter/receiver <NUM> transmits the notification request signal Σ so as to make the sending device <NUM> send the environment notification signal ε in which such noise-related information is included.

The information receiver <NUM> receives the environment notification signal ε from the sending device <NUM> and acquires the noise-related information detected by the sending device <NUM>.

It is also preferred that the information receiver <NUM> itself acquires the noise sound around the portable terminal 10a as the noise-related information via the microphone <NUM>.

Even in the case where the microphone <NUM> cannot detect ultrasonic waves, when a special learning method such as machine learning is applied to the information receiver <NUM> for learning how to estimate ultrasonic waves from the operating sound, the information receiver <NUM> can estimate the ultrasonic components with high accuracy by using the existing microphone <NUM>.

The controller <NUM> uses the acquired noise-related information to calculate degree of smoothness of wireless communication (i.e., probability of successfully transmitting the wireless signal to the receiving side in terms of disturbance factors, and hereinafter, referred to as a "propagability index") for the control signal Ω.

For example, when the blowing noise is loud, it can be estimated that the air circulation inside the vehicle is strong and the propagability index of the control signal Ω is low. When the ultrasonic wave contained in this blowing noise has a frequency far from the frequency of the control signal Ω, the influence on the propagability index is small.

The display <NUM> is, for example, a touch panel having both of an input device for inputting data according to an action of the user <NUM> and a display device such as a liquid crystal display device for displaying data.

As shown in <FIG>, for example, the operation page <NUM> of "IVI", "air conditioner", "lighting", and "seat" are displayed on the display <NUM> in a switchable manner by the tab 22e.

For example, <FIG> illustrates the operation page <NUM> for operating the air conditioner <NUM>, and <FIG> illustrates the operation page <NUM> for operating the IVI <NUM>. On the operation page <NUM> of the air conditioner <NUM> in <FIG>, the air conditioner <NUM> is adjusted by remote operation with the use of eight buttons 23a to <NUM> such as a circulation switching button 23a, an AUTO button 23b, an air-flow volume button 23c, and a compressor drive button 23d.

When the tab <NUM> of "IVI" is touched, the screen is switched to the operation page <NUM> of the IVI <NUM> of <FIG>, and the IVI <NUM> is remotely controlled with the use of various buttons 24a to <NUM> such as the channel buttons 24a and 24b.

Although it is not shown, the brightness adjustment and ON/OFF of the lighting device <NUM> are remotely controlled. For the seat <NUM>, the reclining angle adjustment and the front-rear position adjustment are remotely controlled.

On the status bar <NUM> at the upper end of the display <NUM> (i.e., display screen <NUM>), various icons <NUM> indicating the remaining battery level of the portable terminal 10a and the state of the radio field strength for wireless communication are displayed.

In the portable terminal 10a according to the first embodiment, the display <NUM> displays the calculated propagability index as the communication quality level of the control signal Ω, for example, on the status bar <NUM>.

The communication quality level is represented in four stages by zero to three arcs <NUM> as shown in <FIG>, for example.

When the communication environment of the control signal Ω is satisfactory and the propagability index is high, three arcs <NUM> are displayed by the icon <NUM> as shown in <FIG>. When the propagability index declines by one level from the state of <FIG>, two arcs <NUM> are displayed as shown in <FIG>.

The display format of the communication quality level is not limited to the fan-shaped icon <NUM> in which the arcs <NUM> shown in <FIG> are arranged concentrically, and the communication quality level may be represented by, for example, the number of antenna bars or numbers.

The display position of the communication quality level is not particularly limited to the status bar <NUM>, and may be anywhere on the display <NUM> (i.e., display screen <NUM>) as long as the user <NUM> can visually recognize it.

In accordance with the propagability index, notification of specific actions for improving the propagability index may be given to the user <NUM>. In detail, the display <NUM> may display instruction words such as "Please direct the portable terminal toward the in-vehicle receiver" and/or "Please bring the portable terminal closer to the in-vehicle receiver". Instead of displaying the notification on the display screen <NUM>, the notification may be made by voice, and the notification aspect is not limited to a specific method. When the specific action is notified in this manner, the user can grasp that the communication quality level is low and can also take specific measures to raise the communication quality level by himself/herself.

Since the portable terminal 10a has such a communication environment checking function, the user <NUM> can check the communication quality level on the remote controller <NUM> before or during the remote control and can grasp whether the ultrasonic communication can be used or not.

Next, a description will be given of the sending device <NUM>, which cooperates with the remote controller <NUM>, and the vehicle <NUM> provided with this sending device <NUM> by referring to <FIG> and <FIG>.

The vehicle <NUM> is provided with a vehicle controller (i.e., ECU or Electronic Control Unit) <NUM>, various sensors <NUM> to <NUM>, the IVI <NUM>, and the target in-vehicle devices <NUM> to <NUM>.

These devices <NUM> to <NUM> are interconnected by the communication network <NUM> to exchange information.

The ECU <NUM> is configured as a plurality of in-vehicle computers provided in various places in the vehicle <NUM>, and has, for example, an engine control function, a handle control function, a brake control function, and a data security function. For example, the ECU <NUM> for brake control receives information on the operation of the accelerator pedal and the brake pedal and the running speed via the pedal stroke sensor <NUM> and the vehicle speed sensor <NUM>, converts the received information into a vehicle controlling signal, and applies driving force or braking force to the front wheels or the rear wheels by the vehicle controlling signal.

The IVI <NUM> includes an in-vehicle microphone <NUM>, an in-vehicle memory <NUM>, an in-vehicle speaker <NUM>, and in-vehicle processing circuitry <NUM>.

In the description of the IVI <NUM>, in order to distinguish the IVI <NUM> from the components of the portable terminal 10a (i.e., the speaker <NUM>, the microphone <NUM>, the display <NUM>, the memory <NUM>, and the processing circuitry <NUM>), the term "in-vehicle" is added to the beginning of each component name of the IVI <NUM> as required.

The above-described display <NUM> of the IVI <NUM> is, for example, a touch panel having both of an input device for inputting data according to the operation by the user <NUM> and a display device such as a liquid crystal display for displaying data.

The in-vehicle memory <NUM> is composed of, for example, a ROM, a RAM, or an HDD.

When the in-vehicle processing circuitry <NUM> executes and processes instructions on the basis of the programs stored in the in-vehicle memory <NUM>, the IVI <NUM> implements various functions such as the above-described navigation function and location information service function.

As described above, the plurality of air outlets 51a and 51b of the air conditioner <NUM> are provided in the vehicle <NUM> so as to be positioned appropriately with respect to the target to which the conditioned air σ is sent.

The air outlet 51a provided for the front seats 53a and 53b is near the display <NUM> of the IVI <NUM> while being far from the rear seat 53c. Thus, even when the conditioned air σ is blown from the air outlet 51a, the conditioned air σ is not sufficiently detected by the portable terminal 10a of the user <NUM> seated in the rear seat 53c. However, even when it is not detected by the portable terminal 10a, this conditioned air σ forms a temperature interface near the IVI <NUM> and becomes a factor that hinders the ultrasonic communication.

Since the portable terminal 10a is not connected to the communication network <NUM>, the portable terminal 10a cannot directly acquire the vehicle parameters to be obtained from the communication network <NUM>.

Thus, the IVI <NUM> is provided with a transmission function and acquires the noise-related information in the vehicle, especially around the IVI <NUM> so as to notify the portable terminal 10a of the noise-related information as the environment notification signal ε, because such a noise lowers the communication quality of the control signal Ω.

Specifically, the IVI <NUM> (<NUM>) further includes the functions of a detector <NUM>, a positional information receiver <NUM>, an in-vehicle controller <NUM>, and a sender <NUM>.

The detector <NUM> receives the noise-related information from the ECU <NUM> and the various sensors <NUM> to <NUM> connected at respective location to the IVI <NUM> by the communication network <NUM>. The noise-related information to be received by the detector <NUM> includes the vehicle parameters.

The vehicle parameters are, for example, the traveling speed of the vehicle <NUM>, the traveling acceleration of the vehicle <NUM>, the driving state of the motor, the driving state of the engine, the opening degree of the window <NUM>, and/or air-flow volume of the air conditioner. Further, the vehicle parameters may be other physical quantity which is related to the vehicle <NUM> and is derived by combining the above-described parameters such as the traveling speed.

The speed or acceleration to be detected by the detector <NUM> is detected via the vehicle speed sensor <NUM>. The speed and acceleration may be acquired by the positional information receiver <NUM> via the GPS (Global Positioning System) sensor <NUM>, which is a satellite positioning system.

The detector <NUM> detects the opening degree of the window <NUM> via the window sensor <NUM> for the following reason. When the window <NUM> is fully opened, the amount of air flowing into the vehicle is large, and it is considered that the disturbance affecting the control signal Ω is also large. Further, the sending device <NUM> may directly detect the noise, which is actually being generated, through the in-vehicle microphone <NUM>, similarly to the portable terminal 10a so as to include it in the vehicle parameters.

Even in the case where the in-vehicle microphone <NUM> cannot detect ultrasonic waves, when a special learning method such as machine learning is applied to the detector <NUM> or the in-vehicle controller <NUM> for learning how to estimate ultrasonic waves from the operating sound, the detector <NUM> or the in-vehicle controller <NUM> can estimate the ultrasonic components with high accuracy by using the existing in-vehicle microphone <NUM>.

The in-vehicle controller <NUM> is provided in the vehicle <NUM> and converts the noise-related information in the vehicle <NUM> into the environment notification signal ε.

At this time, the in-vehicle controller <NUM> makes the sender <NUM> send the environment notification signal ε when at least one of the vehicle parameters changes within a predetermined range or changes in a predetermined manner.

For example, regarding the traveling speed of the vehicle <NUM>, the in-vehicle memory <NUM> holds a plurality of speed zones divided by a plurality of thresholds, as exemplified by the first speed zone indicative of <NUM> to <NUM> [km/h], the second speed zone indicative of <NUM> to <NUM> [km/h], the third speed zone indicative of <NUM> to <NUM> [km/h], and the fourth speed zone indicative of speed faster than <NUM> [km/h]. The in-vehicle controller <NUM> sends the environment notification signal ε to the remote controller <NUM> every time the speed zone of the traveling speed changes.

As the traveling speed of the vehicle <NUM> increases, the noise to be generated from the driving source and the tires increases, and the noise in the frequency band of the ultrasonic communication also increases. For example, the frequency and intensity of the ultrasonic waves to be generated are different for each driving mode such as when the vehicle <NUM> is traveling on the coast, when the vehicle <NUM> is accelerating rapidly, and when the vehicle <NUM> is traveling electrically. For this reason, the in-vehicle controller <NUM> sends the updated (i.e., newest or latest) environment notification signal ε in order to make the controller <NUM> of the portable terminal 10a recalculate the propagability index at the timing when the ultrasonic noise fluctuates.

A provision (i.e., rule or definition) for generating a trigger to send the environment notification signal ε is also provided for each of the vehicle parameters as appropriate.

The trigger to send the environment notification signal ε includes not only change of the section defined on the number line but also the switching of the operation of the vehicle parameter such as "the air outlet has been changed", "the driving mode has been changed", and "the audio has been activated".

The communication form of the noise-related information around the IVI <NUM> to be sent to the portable terminal 10a may be ultrasonic communication, wireless communication, or infrared communication.

The sending device <NUM> does not have to be built into the IVI <NUM>. Regarding the location of the sending device <NUM>, as shown in <FIG>, the sending device <NUM> may be externally attached to the surface 97a of the IVI <NUM>, may be provided in the peripheral area 97b of the room mirror <NUM>, or may be mounted on the handle 97c, for example.

The respective functions (<NUM> to <NUM>, <NUM> to <NUM>) of the processing circuitry <NUM> and <NUM> of the remote controller <NUM> and the target in-vehicle devices <NUM> to <NUM> can be achieved by hardware processing such as an ASIC (Application Specific Integration Circuit) and an FPGA instead of software processing.

Further, these functions can be achieved by combining software processing and hardware processing.

Next, a description will be given of the operation of the remote controller <NUM> and the sending device <NUM> according to the first embodiment on the basis of the step number in the flowchart of <FIG> by referring to <FIG> as required.

First, in the step S11, the user <NUM> starts a remote-control application on the portable terminal 10a in order to remotely control the target in-vehicle devices <NUM> to <NUM>.

When the remote-control application is started, the operation page <NUM> for each of the target in-vehicle devices <NUM> to <NUM> shown in <FIG> is displayed on the display screen <NUM> of the portable terminal 10a.

The transmitter/receiver <NUM> of the portable terminal 10a transmits the notification request signal Σ so as to notify the sending device <NUM> that the remote-control application has been started.

Although the flowchart of <FIG> illustrates a case of making an environment notification request only when the remote-control application is started, the environment notification request is also executed when the state changes to the other operable state described above.

Next, in the step S12, the detector <NUM> of the sending device <NUM> having received the notification request signal Σ detects the noise-related information.

The vehicle parameters are acquired through the communication network <NUM>, and the noise in the vehicle is also acquired by the detector <NUM> as the noise-related information.

The in-vehicle controller <NUM> converts the noise-related information in the vehicle <NUM> into the environment notification signal ε. The in-vehicle sender <NUM> sends the environment notification signal ε from the speaker <NUM> toward the portable terminal 10a.

Even after the environment notification signal ε is sent, the vehicle parameters are detected and monitoring is continued.

The information receiver <NUM> of the portable terminal 10a receives the environment notification signal ε sent by the sending device <NUM>, and acquires the noise-related information that the sending device <NUM> holds. It is preferred that the information receiver <NUM> itself acquires the noise sound around the portable terminal 10a as the noise-related information.

Next, the controller <NUM> calculates the propagability index on the basis of the noise-related information in the step S13.

In some cases, the communication environment is bad and the sending device <NUM> cannot detect the start (i.e., activation) of the remote-control application. In some cases, the sending device <NUM> cannot detect the control signal Ω having been sent to the portable terminal 10a. In both of these cases, the portable terminal 10a does not receive the control signal Ω from the sending device <NUM> even after the remote-control application is started. When the portable terminal 10a does not receive the ultrasonic signal Ω from the sending device <NUM> within a predetermined time, the portable terminal 10a determines the communication environment to be bad and calculates the propagability index on the basis of this determination.

The controller <NUM> display the communication quality level on the status bar <NUM> with the icon <NUM> on the display <NUM> in the step S14.

Until there is a predetermined change in at least one of the vehicle parameters (NO in the step S15), the in-vehicle controller <NUM> continues to monitor the vehicle parameters contained in the noise-related information.

If there is a predetermined change in at least one of the vehicle parameters (YES in the step S15), this detection of the predetermined change works as a trigger, and the in-vehicle controller <NUM> converts the noise-related information into the environment notification signal ε and sends it to the portable terminal <NUM>.

This is because if there is a change in the vehicle parameter, there is a high possibility that the propagability index changes. The in-vehicle controller <NUM> continues to monitor the vehicle parameters (YES in the step S15).

The environment notification signal ε sent from the sending device <NUM> is received by the information receiver <NUM> of the portable terminal 10a.

In addition, the information receiver <NUM> itself acquires the noise sound again through the microphone <NUM> around the portable terminal 10a.

In the step S16, the controller <NUM> of the portable terminal 10a recalculates the propagability index by using the noise-related information acquired by the information receiver <NUM>.

On the basis of this recalculated propagability index, the controller <NUM> updates the communication quality level to be displayed on the status bar <NUM> of the display <NUM> (in the step S17; END).

When the propagability index is low, it is desirable that the transmitter/receiver <NUM> transmits the control signal Ω a plurality of times.

As another countermeasure, the control signal Ω can be accurately transmitted to the IVI <NUM> by transmitting for a longer time or by strengthening the output intensity of the control signal Q.

When the propagability index is low, a notification may be outputted by display or voice to request the user <NUM> to take a measure to enhance the propagability index. For example, the display <NUM> may display instruction words such as "Please direct the portable terminal toward the in-vehicle receiver" and/or "Please bring the portable terminal closer to the in-vehicle receiver", as described above.

According to the remote controller <NUM> of the first embodiment described above, the propagability index is recalculated when a change that affects the communication quality of the control signal Ω occurs in the vehicle interior environment, and thus, the user <NUM> can check the communication quality level in response to the change in vehicle environment on a real-time basis.

Since the environment notification signal ε is sent at the timing when the portable terminal 10a shifts to the operable state, battery consumption of the portable terminal 10a can be suppressed.

Since the transmission timing of the environment notification signal ε is restricted in this manner, the ultrasonic band can be effectively utilized.

<FIG> is a flowchart illustrating the operation of the remote controller <NUM> according to the second embodiment.

The remote controller <NUM> according to the second embodiment estimates the vehicle parameters on the basis of the noise-related information acquired from the microphone <NUM>, and monitors the estimated vehicle parameters, i.e., monitors change in vehicle interior environment.

The remote controller <NUM> uses the estimated vehicle parameters for updating the display of the communication quality level at the timing when the communication environment changes, similarly to the first embodiment.

In the first embodiment, the sending device <NUM> acquires the vehicle parameters directly from the communication network <NUM> and monitors their changes.

In the second embodiment, the remote controller <NUM> determines an appropriate timing of recalculating the propagability index on the basis of the noise-related information acquired by itself and updates the display of the communication quality level. The memory <NUM> of the remote controller <NUM> holds data that defines the timing of recalculating the propagability index for the estimated vehicle parameters, similarly to the in-vehicle memory <NUM> of the first embodiment.

A detailed description will be given of the operation of the remote controller <NUM> according to the second embodiment on the basis of the step number in the flowchart of <FIG> by referring to <FIG> as required.

First, in order to remotely control the target in-vehicle devices <NUM> to <NUM>, the user <NUM> starts the remote-control application on the portable terminal 10a in the step S21.

When the remote-control application is started, the operation page <NUM> shown in <FIG> is displayed on the display screen <NUM> of the portable terminal 10a similarly to the first embodiment.

Next, in response to the change in state of the portable terminal 10a to the operable state (i.e., triggered by change in state of the portable terminal 10a to the operable state), the information receiver <NUM> detects the noise-related information in the step S22.

At this time, the information receiver <NUM> detects the noise-related information such as the blowing sound in the vehicle <NUM> and the operating sound of the devices in the vehicle through the microphone <NUM> by itself without going through the sending device <NUM>.

Further, the information receiver <NUM> may determine the moving speed of the portable terminal 10a by the GPS function installed in the portable terminal 10a and then determine the traveling mode of the vehicle <NUM>.

On the basis of this noise-related information, the in-vehicle environment is estimated through the estimation of the vehicle parameters in the step S23.

In the second embodiment, the vehicle parameters such as the opening degree of the window <NUM> are estimated from the characteristic mechanical sound and its generation direction of the in-vehicle devices. The opening-degree information of the window <NUM> and the driving state of the air conditioner <NUM> may be estimated by combining the traveling direction of the vehicle <NUM> acquired by the GPS function and the generation direction of the noise sound.

Since the outside air flowing into the vehicle and the conditioned air σ by the air conditioner <NUM> are both characterized by their strength and frequency, machine learning is applied to the controller <NUM> for learning those characteristics, and thereby, the controller <NUM> can distinguish and identify the opening degree of the window <NUM> and the driving state of the air conditioner <NUM>. In particular, when the information receiver <NUM> learns the obstacle frequency range peculiar to the vehicle <NUM> in advance, the noise sound that is generated inside the vehicle and seems to be unrelated at first glance can be used for estimating the vehicle parameters.

Afterward, the controller <NUM> calculates the propagability index and displays the communication quality level on the basis of the calculated propagability index on the display <NUM> in the steps S24 and S25, similarly to the first embodiment.

Until there is a predetermined change in at least one of the vehicle parameters (NO in the step S26), the controller <NUM> continues to monitor the vehicle parameters contained in the noise-related information.

If there is a predetermined change in at least one of the vehicle parameters (YES in the step S26), in response to this detection of the predetermined change (i.e., triggered by the detection of the predetermined change), the propagability index is recalculated on the basis of the latest noise-related information in the step S27 and the display of the communication quality level is updated in the step S28 (END), similarly to the first embodiment.

Except that the display of the communication quality level is updated on the basis of change in vehicle parameters acquired and estimated by the portable terminal 10a, the second embodiment is the same as the first embodiment in terms of configuration and operation, and duplicate description is omitted.

According to the remote controller <NUM> of the second embodiment described above, the remote controller <NUM> provides the same effects as the first embodiment without coordinating with the sending device <NUM>.

Claim 1:
A device (<NUM>) configured to send information relating to noise sound in a vehicle (<NUM>), the device comprising:
a detector (<NUM>) that is provided in the vehicle and acquires information related to noise sound that disturbs ultrasonic communication in the vehicle;
an in-vehicle controller (<NUM>) that is provided in the vehicle and converts the information related to noise sound into a notification signal; and
a sender (<NUM>) that sends the notification signal to a remote controller disposed in the vehicle,
wherein the in-vehicle controller is configured to make the sender send the notification signal when a vehicle parameter of the vehicle changes within a predetermined range or in a predetermined manner.