Patent Description:
A doorbell is a signaling device typically placed near a door to a building's entrance. When a visitor presses a button, the bell rings or otherwise generates a human discernable signal inside the building, alerting the occupant to the presence of the visitor. Although the first doorbells were mechanical, activated by pulling a cord, modem doorbells are generally electric switches; and the most recent versions may contain miniature cameras, may be connected to the Internet, and may even incorporate facial recognition technology. These doorbells permit a user to monitor doorbell activation remotely via an application user-accessible device such as a computer or smartphone.

However, modem doorbells continue to suffer from several drawbacks. For example, although such doorbells can initiate contact with a remote user, the user might not find it convenient to actually speak to the visitor at the particular time of contact. Also, if the visitor is speaking a different language than what the user is accustomed to, the user might not be able to communicate with the visitor at all. A need therefore exists for an improved doorbell system which eliminates one or more of the foregoing disadvantages. <CIT> discloses an electronic doorbell system having the features of the preamble of claim <NUM>. <CIT> discloses a portable sound generator apparatus. <CIT> discloses a mobile device disclosed, which is intended to be utilized by two people in a face-to-face situation and serves as a translation tool for the two people communicating with each other in different languages.

An electronic doorbell system and a method for electronic communication according to the invention are as specified in independent claims <NUM> and <NUM>. Preferred embodiments thereof are specified in the dependent claims. The electronic doorbell system is configured to enable remote audio communications between a visitor at the doorbell and a user of a mobile computing device by exchanging speech-to-text messages in real time. Additionally, text to speech messages can be exchanged in real time. Audio captured by the visitor is transcribed into text messages and sent to the user of the mobile device using a speech-to-text service. The user of the mobile device can send text messages to the doorbell for playback to the visitor by using a text-to-speech service. The system can also use artificial intelligence to detect the language spoken by the visitor for translating between a predetermined language of the user and the language of the visitor. The system can also include a camera for capturing video of the visitor for display to the mobile device simultaneous with exchanging text messages between the visitor and the user, such as during a live Session Initiation Protocol (SIP) communication, Web Real Time Communication (WebRTC) or any other form of Real Time Communication between the doorbell and the mobile device.

According to the invention, the electronic doorbell system includes: an electronic doorbell configured to capture an audio stream; a hub in communication with the electronic doorbell, the hub having a processor executing a program stored in a non-transient medium operable to: detect a trigger event from the electronic doorbell; after the trigger event, receive an audio stream captured by the electronic doorbell; and in response to the audio stream, produce a text message corresponding to the audio stream at an electronic device. Additionally, the hub provides the audio stream to a language-translation service to produce a translated audio stream, such as from English to Spanish, and then direct the translated audio stream to the electronic device.

According to the invention, the method for electronic monitoring includes: configuring an electronic doorbell to capture an audio stream; detecting a trigger event from the electronic doorbell; after the trigger event, receiving an audio stream captured by the electronic doorbell; and in response to the audio stream, producing a text message corresponding to the audio stream at an electronic device.

These and other objects, advantages and aspects of the invention will become apparent from the following description. The particular objects and advantages described herein can apply to only some embodiments falling within the claims and thus do not define the scope of the invention. In the description, reference is made to the accompanying drawings which form a part hereof, and in which there is shown a preferred embodiment of the invention. Such embodiment does not necessarily represent the full scope of the invention and reference is made, therefore, to the claims herein for interpreting the scope of the invention.

Preferred exemplary embodiments of the invention are illustrated in the accompanying drawings in which like reference numerals represent like parts throughout, and in which:.

Referring now to <FIG>, a diagram illustrating a system <NUM> for electronic monitoring is provided in accordance with an aspect of the invention. The system <NUM> can comprise an electronic doorbell system <NUM>, including an electronic doorbell <NUM>, one or more cameras <NUM>, such as first and second cameras 16a and 16b, respectively, a hub or base station <NUM> and/or a chime <NUM>. The base station <NUM> can communicate with the doorbell <NUM>, the cameras <NUM> and/or the chime <NUM> through a wireless local network, such as an IEEE <NUM> wireless Local Area Network (LAN). The base station <NUM>, in turn, can connect to network access equipment <NUM>, such as modem and/or router, for communicating with a backend system <NUM> through a Wide Area Network (WAN) <NUM> such as the Internet. The backend system <NUM>, which could comprise one or more servers, in turn, can communicate with an electronic device <NUM>, such a smart phone, tablet computer, or laptop or desktop computer operated by a user <NUM>.

The doorbell system <NUM> can be arranged with respect to a building <NUM>, such as a home or office building. For example, the doorbell <NUM> can be arranged proximal to a door <NUM> of the building <NUM>, in a traditional location customarily found by visitors, such as against an exterior wall or doorframe of the building <NUM> adjacent to the door <NUM> at a height just above a door knob <NUM>. Each camera <NUM> can also be arranged with respect to a building <NUM>, but advantageously at separate locations from the doorbell <NUM> to provide optimum viewing angles of visitor(s). For example, a first camera 16a can be arranged against the exterior wall of the building <NUM>, several feet above the door <NUM>, to provide an optimum angle for viewing a visitor <NUM> standing in front of the door. Also, a second camera 16b can be arranged against a different area of the building <NUM>, such as several feet above a side or back window <NUM>, distal from the first camera 16a, to provide an optimum angle for viewing any person proximal to such alternative access point. "Distal" refers to a physical separation between devices such that views and/or sounds captured by the devices far enough away from one another such that the devices are operable provide distinctly different points of observation that are useful to the user <NUM>. As yet another example, a camera (not shown) could be mounted on a post or tree located several feet away from the building with a view of the door <NUM>.

In addition, in one aspect, a computer <NUM> can be connected directly to the system, such as through the network access equipment <NUM>, for allowing a user in the building <NUM> direct access to the system <NUM>. The computer <NUM> could, for example, comprise a tablet, laptop, or desktop computer. This can serve as a back-up to the device <NUM> when the user <NUM> is in the building <NUM> for communicating over the VoIP telephone call with the visitor <NUM> as described herein.

A visitor <NUM> approaching the door <NUM> can cause a trigger event. Such trigger events could comprise, for example: the visitor <NUM> pressing or otherwise actuating a button on the doorbell <NUM>; motion of the visitor <NUM> being detected by a motion sensor of the doorbell <NUM> and/or in a floodlight, a camera, or other device located in the vicinity of the doorbell and in communication with thee base station <NUM>; and/or a sound of the visitor <NUM> being detected by a microphone of the doorbell <NUM>. Following occurrence of the trigger event, the system <NUM> is configured to immediately call the user <NUM> at a predetermined location, such as the device <NUM>. In the most typical case in which the call is an audio form, possibly accompanied by video data, enabled by the base station <NUM> making a Voice over Internet Protocol (VoIP) call to the device <NUM>. The system <NUM> reduces latency by omitting push notifications to the device <NUM>, which otherwise would require the user <NUM> to open an application program on the device <NUM> before making any calls, and instead proceeds to immediately call the user's device. The remainder of the specific example contained herein assumes such a telephone call.

In one aspect, an audio stream captured by a microphone of the doorbell <NUM>, and a video stream captured by a camera <NUM>, such as the first camera 16a, can be synchronized by the base station <NUM> to communicate a synchronized media stream in near real time to the device <NUM>. "Near real time" refers to the time delay introduced, by automated data processing and/or network transmission, between the occurrence of an event and the use of the processed data, such as for display or feedback and control purposes. For example, a near real time display depicts an event or situation as it existed at the current time minus the processing time, as nearly the time of the live event. Also, an audio stream captured by a microphone of the device <NUM> can be returned to the base station <NUM> to communicate to the doorbell <NUM> to allow a near real time VoIP conversation between the user <NUM> and the visitor <NUM> during a call.

Referring now to <FIG>, a diagram illustrating communication in the system <NUM> is provided in accordance with an aspect of the invention. The doorbell <NUM> can include a button <NUM>, a microphone <NUM>, a speaker <NUM> and/or a motion sensor <NUM>. As mentioned, some of these functionalities could be provided on or duplicated on devices located apart from the doorbell. The doorbell <NUM> can also include processing and circuitry contained in a doorbell housing configured to be arranged proximal to the door <NUM>. The button <NUM> can be a doorbell button or switch that is sensed by the base station <NUM> when actuated by the visitor <NUM>. The microphone <NUM> can be configured to capture an incoming audio stream for communication in the system and for detection of sound (such as the voice of visitor <NUM>). The speaker <NUM> can be configured to play an outgoing audio stream for communication to the visitor <NUM>. The motion sensor <NUM> could be an active or passive Infrared (IR) motion sensor for detection of motion (such as by the visitor <NUM>).

The camera <NUM> can include a lens, a microphone, a speaker and/or a motion sensor. The camera <NUM> can also include processing and circuitry contained in a camera housing configured to be arranged in diverse locations, such as against an exterior wall of the building <NUM> or even apart from but facing the building. The camera <NUM> can be configured to capture a video stream for communication in the system. The camera <NUM> can also be configured for detection of motion (such as from the visitor <NUM>).

With additional reference to a process <NUM> of <FIG> and continued reference to the system schematic of <FIG>, an operation for a VoIP telephone call to the device <NUM>, triggered by the system <NUM>, is provided in accordance with an aspect of the invention. Beginning at decision steps <NUM> and <NUM>, the system <NUM> can monitor for a trigger event near the doorbell continuously in a loop. For example, at decision step <NUM>, the base station <NUM> can monitor the button <NUM> of the doorbell <NUM> for actuation by a visitor <NUM>. If the button <NUM> is not actuated or pressed ("No"), the base station <NUM> can proceed to decision step <NUM> to monitor for another triggering event such as the detection of motion and/or sound near the doorbell, such as motion detected by the motion sensor <NUM>, sound detected by the microphone <NUM>, and/or motion or sound detected by the camera <NUM>. If another trigger event is not detected ("No"), the base station <NUM> can return to decision step <NUM> in a loop. However, if the button <NUM> is actuated or pressed at decision step <NUM> ("Yes"), and/or if another trigger event such as motion and/or sound is detected at decision step <NUM> ("Yes"), the process <NUM> can break the monitoring loop and proceed to step <NUM>. Such trigger events can be detected by an event handler <NUM> of the base station <NUM>.

Next, in response to the trigger event, the system <NUM> can proceed to take any or all of several actions near simultaneously. At step <NUM>, the base station <NUM> can control the chime <NUM> to ring in the building <NUM>, causing an audible alarm to alert occupants of the building <NUM> of the presence by the visitor <NUM>. At step <NUM>, the base station <NUM> can stream audio captured by the doorbell <NUM> and video captured by the camera <NUM> (it being understood that the camera may be any of several cameras 16a, 16b, etc. that are active at that time). In particular, an audio stream manager <NUM> of the base station <NUM> can capture the audio stream from the doorbell <NUM>, and a video stream manager <NUM> of the base station <NUM> can capture the video stream from the camera <NUM>, along with an audio stream from a microphone <NUM> of the camera <NUM>, if the camera <NUM> is so equipped. A multiplexor <NUM> of the base station <NUM> can synchronize the audio stream from the audio stream manager <NUM> with the video stream from the video stream manager <NUM> for later communicating a synchronized media stream to the device <NUM> after communication has been established.

At step <NUM>, the base station <NUM> can proceed to wake the device <NUM> for the call. In the case of the call being a telephone call, the base station <NUM> can register itself for the VoIP call, through the backend system <NUM>. In particular, the base station <NUM> can wake the device <NUM> for the telephone call by the event handler <NUM> contacting a system events service <NUM> of the backend system <NUM>. The event handler <NUM> can request, through the system events service <NUM>, an endpoint for making the call. The system events service <NUM>, in turn, can send a wake-up notification to a notify service <NUM>. The notify service <NUM>, in turn, can send the wake-up notification to a wake-up handler <NUM> executing on the device <NUM>. Also, the base station <NUM> can register for the call through the backend system <NUM> by the event handler <NUM> contacting a call registration service <NUM>.

At step <NUM>, the device <NUM> can wake via the wake-up handler <NUM>. Also, the device <NUM> can register to receive the VoIP call through the backend system <NUM>. With the call registered at each endpoint, a call manager <NUM> of the base station <NUM> can send a call invite to the device <NUM> through a signaling service <NUM>. The signaling service <NUM> can provide Session Initiation Protocol (SIP) signaling for initiating, maintaining, and terminating real-time sessions that include voice, video and messaging applications between the system <NUM> and the device <NUM>. A call manager <NUM> of the device <NUM>, in turn, can receive the invitation. This can appear to the user <NUM> as the device <NUM> spontaneously waking and ringing with an immediate incoming phone call with a caller identification (Caller ID) indicating the system <NUM> as being the caller.

At decision step <NUM>, the user <NUM> can choose to accept or decline the call, such as by tapping an appropriate selection on a touchscreen of the device <NUM>, like other incoming phone calls. If the user chooses to decline the call ("No"), the process <NUM> can proceed to step <NUM> in which the base station <NUM>, being operable to detect a failure of the electronic device to answer the call, controls the doorbell <NUM> to play a predetermined greeting and record a voice message with a defined start and stop from the visitor <NUM> in response to the greeting. For example, the doorbell <NUM> may relay "I cannot come to the door right now. " The voice message, in turn, can be sent by the base station <NUM> to device <NUM>. In other words, if at decision step <NUM> the user declines the call ("No"), then a SIP call is not initiated between the doorbell <NUM> (through the base station <NUM>) and the device <NUM>. Instead, a prerecorded audio message can be played at the doorbell <NUM>, such as: "We are not able to come to the door right now. Please leave a message.

In addition, in the process <NUM>, at step <NUM>, a loaded application program executing on the device <NUM> can receive the synchronized media stream to the device <NUM>. In particular, a hub stream manager <NUM> of the base station <NUM> can send the synchronized media stream from the multiplexor <NUM> ("mux") to a media transport tunneling service <NUM> of the backend system <NUM>. The media transport tunneling service <NUM> can provide Real Time Streaming Protocol (RTSP) signaling to control the media stream as Real-time Transport Protocol (RTP) packets between the base station <NUM> and the device <NUM>. An application stream manager <NUM> of the device <NUM>, executing as part of the application program, can receive the media stream. The user <NUM> can open the application program on the device <NUM> to see and hear the media stream in real time through the application program. Alternatively, the user <NUM> can place the device <NUM> back into sleep with the possibility of returning to the application program later for viewing the media stream as a recorded event.

However, returning to decision step <NUM>, and with additional reference to <FIG>, if the user chooses to accept the call ("Yes"), the process <NUM> can proceed to a telephone call routine ("Call Start") at process <NUM>. In other words, if at decision step <NUM> the user accepts the call ("Yes"), then a SIP call is initiated between the doorbell <NUM> (through the base station <NUM>) and the device <NUM>. By default, the microphone of the device <NUM> can be muted. At decision step <NUM>, after accepting the call, the user <NUM> can choose whether to communicate directly or indirectly with the visitor <NUM>, such as by tapping another selection on the touchscreen of the device <NUM>. If the user chooses to communicate directly with the visitor ("Yes"), such as for a more traditional phone call, the process <NUM> can proceed to step <NUM> in which the microphone of the device <NUM> is unmuted, and the base station <NUM> and the device <NUM> exchange bi-directional media streams in a VoIP call that is near real time. In one aspect, the exchange of bi-directional media streams can comprise outgoing video and audio streams from the system <NUM> (and the doorbell <NUM>) to the device <NUM>, and only an incoming audio stream from the device <NUM> to the system <NUM>. However, in another aspect, the doorbell <NUM> can be configured with a display, and the exchange of bi-directional media streams can comprise outgoing video and audio streams from the system <NUM> (and the doorbell <NUM>) to the device <NUM>, and incoming video and audio streams from the device <NUM> to the system <NUM>. The process can then proceed to decision step <NUM> in which the user <NUM> can choose to end the call at any time. If the user <NUM> does not end the call ("No"), the process can return to step <NUM> in which the base station <NUM> and the device <NUM> continue to exchange bi-directional media streams. In other words, the SIP session stays active until the user <NUM> ends the call via the device <NUM>. However, if the user <NUM> does end the call ("Yes"), the process can return to the process <NUM> of <FIG> ("Call End"), returning to decision steps <NUM> and <NUM>, monitoring for another trigger event.

However, returning to decision step <NUM> of <FIG> as well as the system diagram of <FIG>, after accepting the call, the user <NUM> can also choose to communicate indirectly with the visitor <NUM>. If the user <NUM> chooses to communicate indirectly with the visitor <NUM> ("No"), the process <NUM> can proceed instead to step <NUM> in which the microphone of the device <NUM> continues to be muted, and the device <NUM> proceeds to receive the synchronized media stream from the base station <NUM>. Despite inhibiting audio from the device <NUM>, the user <NUM> of the device <NUM> can still listen/view the media stream from the doorbell <NUM>. In addition, at decision step <NUM>, the user <NUM> can at any time decide whether to send a message to play at the doorbell <NUM>. The user <NUM> can type or dictate a custom message, and/or select any of multiple predetermined messages, including messages pre-recorded by the user <NUM> and/or "stock" messages selectable by the user from a pre-programmed list, for playing to the speaker <NUM> of the doorbell <NUM>. One exemplar message could be: "Please leave your package by the door. " Another exemplar message could be: "Sorry I cannot come to the door right now. Please contact me later. " If the user <NUM> decides to send a predetermined message ("Yes"), the process can proceed to step <NUM> in which the user <NUM> selects the message at the device <NUM> for the base station <NUM> to play at the doorbell <NUM>. However, if the user <NUM> decides not to send a predetermined message ("No"), the process can bypass step <NUM> and proceed to decision step <NUM> for ending the call at any time. If the user <NUM> does not end the call ("No"), the process can return to step <NUM>, continuing to receive at the device <NUM> the synchronized media stream from the base station <NUM>, in a loop. In other words, the SIP session stays active until the user <NUM> ends the call via the device <NUM>. In addition, during the call, the user <NUM> can continue to send messages to be played at the doorbell <NUM>. Also, at any time during the call, the user <NUM> can unmute the microphone of the device <NUM> and start talking to the visitor, with an exchange of bi-directional media streams between the base station <NUM> and the device <NUM>. However, if the user <NUM> does end the call ("Yes"), the process can return to the process <NUM> of <FIG> ("Call End"), returning to decision steps <NUM> and <NUM>, monitoring for another trigger event.

With additional reference <FIG> and <FIG>, in another aspect of the invention, the user <NUM> can control the device <NUM> to make a VoIP telephone call without waiting for a trigger event. Beginning at decision step <NUM>, the user <NUM> can choose whether to call the doorbell <NUM> from the device <NUM>. If the user <NUM> chooses not to call the doorbell <NUM> ("No"), the process <NUM> goes no further. However, if the user <NUM> does choose to call the doorbell <NUM> ("Yes"), the process <NUM> can proceed to step <NUM> in which the device <NUM> can register itself for a VoIP call and notify the base station <NUM>. In particular, the device <NUM> can register for the call by contacting the call registration service <NUM> of the backend system <NUM>. Also, the device <NUM> can notify the base station <NUM> to receive the call by contacting the system events service <NUM> of the backend system <NUM> which, in turn, contacts the event handler <NUM>. At step <NUM>, the base station <NUM> can register for the call by the event handler <NUM> contacting the call registration service <NUM>. With the call registered at each endpoint, the call manager <NUM> of the device <NUM> can send a call invitation to the base station <NUM> through the signaling service <NUM>. The call manager <NUM> of the base station <NUM>, in turn, can receive the invite and automatically accept the call. With additional reference to <FIG>, with the VoIP call connected, the process <NUM> can proceed to the telephone call routine ("Call Start") at process <NUM> as described above.

Referring now to <FIG>, a diagram illustrating an exemplar system <NUM> having the doorbell <NUM> and a text communication system <NUM> is provided in accordance with an aspect of the invention. The text communication system <NUM> can provide bi-directional speech-to-text (STT) and/or text-to-speech (TTS) services for enabling remote communications between a visitor <NUM> and the user <NUM>. In particular, the text communication system <NUM> can allow exchanging speech-to-text and/or text-to-speech messages between the doorbell <NUM> and the device <NUM> in real time, such as during a bi-directional, live Session Initiation Protocol (SIP) communication, enabled by the backend system <NUM>, as discussed above.

In one aspect, the system <NUM> can detect a trigger event from the doorbell <NUM>, such as at decision steps <NUM> and <NUM> as described above with respect to <FIG>. After the trigger event, the base station <NUM> can receive an outgoing audio stream from the visitor <NUM>, as captured by the microphone <NUM> of the doorbell <NUM>. The base station <NUM> can then provide the outgoing audio stream to the text communication system <NUM> to provide a speech-to-text translation to produce an outgoing text message corresponding to the outgoing audio stream in a preferred language of the user <NUM>. The base station <NUM> can direct the outgoing text message to the device <NUM> to be read by the user <NUM>. In other words, audio captured by the visitor <NUM> at the doorbell <NUM> can be transcribed into text messages and sent to the user <NUM> of the device <NUM> using a speech-to-text service of the text communication system <NUM>.

Similarly, the user <NUM> of the device <NUM> can type and send an incoming text message to the doorbell <NUM> for audio playback to the visitor <NUM>. This might be done, for example, at times when the user <NUM> might not find it convenient to actually speak to the visitor <NUM> at the particular time of contact, but would it find it convenient to send text messages. The base station <NUM> can direct the incoming text message (from the device <NUM>) to the text communication system <NUM> to provide a text-to-speech translation to produce an incoming audio stream corresponding to the incoming text message in a detected or predetermined language of the visitor <NUM>. The base station <NUM> can then send the incoming audio stream to the speaker <NUM> of the doorbell <NUM> to be played for the visitor <NUM>. In other words, the user <NUM> of the device <NUM> can send text messages to the doorbell <NUM> for playback to the visitor <NUM> by using a text-to-speech service of the text communication system <NUM>. In one aspect, instead of the user typing a message, to produce the incoming text message the user could simply select a predetermined text message from among multiple predetermined text messages, such as "Please leave your package by the door. " or "Sorry I cannot come to the door right now. Please contact me later. " Such incoming/outgoing text messages can continue back and forth during a chat session so long as the communication path between the device <NUM> and the doorbell <NUM> remains open.

With additional reference to <FIG>, a timing diagram <NUM> illustrates exemplar communication in the system of <FIG> in accordance with an aspect of the invention. At step <NUM>, the device <NUM> can register with the base station <NUM> for a call with the doorbell <NUM>, such as during a SIP communication, including as described above with respect to <FIG>. Following such registration, at step <NUM>, the user <NUM> can select chat as a mode for communicating with a visitor <NUM> at the doorbell <NUM>. Such selection could be made, for example, through an application program <NUM> executing on the device <NUM> (see <FIG>). At step <NUM>, the user <NUM> can communicate through the device <NUM> to the base station <NUM> to activate the chat mode ("On"). In addition, the user <NUM> can indicate a predetermined language of the user <NUM> for communicating with visitors, such as English. In addition, the user <NUM> can indicate a predetermined gender and/or accent of the predetermined language chose, such as female with an Australian accent of English. At step <NUM>, the base station <NUM> executes to activate the chat mode.

Next, at step <NUM>, a trigger event can occur at the doorbell <NUM> with an outgoing audio message from the visitor <NUM> following the trigger event. At step <NUM>, the outgoing audio message can be provided to an artificial intelligence system <NUM> operable to detect a language of the visitor <NUM>, along with gender and/or accent. In one aspect, the artificial intelligence system <NUM> could comprise a neural network implemented by the base station <NUM>. However, in another aspect, the artificial intelligence system <NUM> could be implemented by a remote system, such as server accessible through the WAN <NUM>. At step <NUM>, an indication of the language spoken by the visitor <NUM>, along with gender and/or accent, as detected by the artificial intelligence system <NUM>, is provided to the base station <NUM>. At step <NUM>, such indication of the language spoken by the visitor <NUM> is further provided from the base station <NUM> to the device <NUM>.

Next, at step <NUM>, the outgoing audio message from the visitor <NUM>, the indication of the predetermined language of the user <NUM>, and the indication of the language spoken by the visitor <NUM>, are provided from the base station <NUM> to the text communication system <NUM>. At step <NUM>, a speech-to-text translation service of the text communication system <NUM> can produce and send an outgoing text message corresponding to the outgoing audio stream back to the base station <NUM>. At step <NUM>, the base station <NUM>, in turn, can direct the outgoing text message to the device <NUM> during the SIP communication. At step <NUM>, and with additional reference to <FIG>, the outgoing text message can appear on the device <NUM> as an Instant Message (IM) or online chat <NUM> continuously updating through the application program <NUM>. At step <NUM>, the user <NUM> can type a text message, or select a predetermined text message as discussed above with respect to <FIG>, to produce an incoming text message directed back to the visitor in the online chat <NUM>.

At step <NUM>, the incoming text message, the indication of the predetermined language of the user <NUM>, and the indication of the language spoken by the visitor <NUM>, can be provided from the device <NUM> back to the text communication system <NUM>. At step <NUM>, a text-to-speech translation service of the text communication system <NUM> can produce and send an incoming audio stream corresponding to the incoming text message back to the device <NUM>. At step <NUM>, the incoming audio stream can be sent by the device <NUM> to the base station <NUM> during the SIP communication. Then, at step <NUM>, the base station <NUM> can send the incoming audio stream to the speaker <NUM> of the doorbell <NUM> to be played for the visitor <NUM>. Such incoming/outgoing text and audio messages can continue back and forth during a chat session, continuously updating in the online chat <NUM>, so long as the communication path between the device <NUM> and the doorbell <NUM> remains open. Accordingly, in addition to providing more convenient text communications between the user <NUM> and the visitor <NUM>, the system <NUM> can further use artificial intelligence to detect the language, along with gender and/or accent, spoken by the visitor <NUM> for translating between a predetermined language of the user <NUM> and the language of the visitor <NUM>.

Referring again to <FIG> and <FIG>, during such text communication, the system <NUM> can also utilize one or more cameras <NUM> for capturing a video stream <NUM> of the visitor <NUM> for display to the device <NUM>. Such display of the video stream <NUM> can be live, simultaneous with the exchange of the aforementioned text messages between the user <NUM> and the visitor <NUM> in the online chat <NUM>, together occurring in real time during the SIP communication.

Although the best mode contemplated by the inventors of carrying out the present invention is disclosed above, practice of the above invention is not limited thereto. It will be manifest that various additions, modifications and rearrangements of the features of the present invention may be made without deviating from the scope of the claims.

Claim 1:
An electronic doorbell system (<NUM>), comprising:
an electronic doorbell (<NUM>) to be used by a visitor approaching the door, a chime (<NUM>), a hub (<NUM>), a text communication system (<NUM>) and an electronic device (<NUM>) allowing the user inside the building to access the system,
the electronic doorbell (<NUM>) comprising a doorbell button (<NUM>), a microphone (<NUM>) and a speaker (<NUM>), wherein the electronic doorbell (<NUM>) is adapted to be arranged proximal to a door (<NUM>) of a building (<NUM>) and configured to generate a trigger event and to capture an audio stream;
the chime (<NUM>) is configured to ring in the building (<NUM>);
the hub (<NUM>) is in wireless communication with the electronic doorbell (<NUM>) and has a processor executing a program stored in a non-transient medium, wherein the hub (<NUM>) is operable to:
receive a notification of the trigger event from the electronic doorbell (<NUM>); and
after the trigger event, receive the audio stream captured by the electronic doorbell (<NUM>), the audio stream being in a first language, characterized in that
the hub (<NUM>) is further operable to:
transmit the audio stream in the first language to the text communication system (<NUM>) remote from the hub (<NUM>);
receive from the text communication system (<NUM>) a message in a second language, wherein the message corresponds to the audio stream transmitted from the hub (<NUM>) to the communication system (<NUM>); and
in response to receiving the message, direct the message in the second language to the electronic device (<NUM>), wherein the message is a text message produced by a speech-to-text translation service.