Vehicle camera peripheral

A vehicle camera peripheral. It has a frame having a surface for supporting a license plate, at least one compartment for containing a battery and a circuit board having a wireless transmitter and video transmission circuitry, the compartment provided in the frame and positioned behind the license plate supporting surface, a camera mounted to the frame and connected to the circuit board, and a mounting for connecting the frame to existing license plate fastening devices of a vehicle.

TECHNICAL FIELD

The present application relates to a vehicle camera peripheral system, such as a rear view camera for automobiles, trucks or buses. The present application also relates to such peripheral systems that use a smartphone as the video display device.

BACKGROUND

Vehicle cameras are commonly used for viewing an area immediately behind a rear bumper to see what might be behind the vehicle when backing up for parking. The after-market camera component is typically mounted to a license plate mounting of the vehicle. Vehicle cameras can also be useful for school buses to see if a child or object is in front of the bus or near the rear wheels of the bus. Similar uses can exist for semi-trailers, heavy trucks, snow removal equipment, etc. where the driver or operator needs improved vision around the vehicle.

Smartphones can have excellent computing capabilities and can be useful as a user interface for a variety of peripherals or uses. One example is an automotive rear view camera application. A wireless camera can be mounted at a rear of a vehicle to transmit images to a smartphone having a wireless data interface to provide a display of the images to the driver. Such cameras are useful for guiding a driver to back up a vehicle. Such rear view automotive cameras are typically wired into electrical power of the vehicle, this requires a modification that normally involves a professional installer. The requirement for professional installation can be a disincentive for consumers to purchase vehicle camera peripherals.

When a rear view camera is powered by a vehicle's backup lamp power, then the camera is powered only when a vehicle is in reverse. While this involves a wired installation, this resolves the issue of triggering of the camera to operate when needed. Other wired installations have the camera always transmit the video, while the display device is controlled to be on or off.

When using a smartphone as the display device, the smartphone needs to be placed in a state in which it is able to run software to display the video. In known systems, this involves typically a user selecting the app and running it in the foreground.

The camera peripheral also needs to be triggered to operate if it is desired for it to be normally in a low power or off state except when the camera needs to be viewed.

With the Google Android® operating system, a program or app can be given by the user special permission to run in the background, such that when video is transmitted from a camera to the smartphone the latter can respond by displaying the video. With the current Apple iOS® operating system, an app cannot be given permission to run continuously in the background. Furthermore, a background app in iOS cannot use the display for presenting the camera video. iOS® devices represent a significant portion of mobile computing devices in use that are suitable to display camera video, and thus it is a problem that user input is required with iOS® devices to allow camera video to be displayed when it is time to display the video.

SUMMARY

Applicant has developed a number of improvements in a vehicle camera peripheral that is to be used with a smartphone for displaying the camera video. In this application, “smartphone” is intended to mean a mobile computing device that includes mobile telephones, handheld computers and tablet computers.

In one improvement, the vehicle camera peripheral is battery powered so that installation does not involve wiring and can be easily done by a consumer. In these embodiments, the camera peripheral may use Bluetooth classic for wireless transmission of video to the smartphone. Bluetooth BLE may be used to communicate with the smartphone, prompting the smartphone to run an application program to verify if any user activation input has been registered by or provided to the smartphone.

BLE should be understood herein to mean the current Bluetooth low energy standard, but without limitation thereto, since any suitable Bluetooth or non-Bluetooth wireless protocol can be used.

The BLE component can be powered by the battery continuously while the camera and video transmission circuitry is only powered when needed. The BLE component can control power supplied to the camera and video transmission circuitry. In this improvement, a separate wireless activation unit is provided with the vehicle camera peripheral, and the function of the activation unit is to send a wireless signal that will cause the BLE component of the vehicle camera peripheral to power up the camera and video transmission circuitry. The activation unit can transmit a signal directly to the BLE component of the peripheral, or it can transmit a signal to the smartphone so that it in turn can transmit a signal directly to the BLE component of the peripheral. The activation unit may establish a first wireless connection with the peripheral, and the peripheral may establish a second distinct wireless connection (e.g. Bluetooth connection) with the smartphone. In some examples, the activation unit may instead communicate via radio frequency signals with the peripheral (e.g. over a 915 MHz transmission channel), where the activation signal may be a radio signal.

The activation unit can be mounted to the vehicle using an adhesive mount, bracket, clip or the like so that a user can trigger the wireless signal using a button press. The activation unit can be mounted to a vehicle gear shift to detect putting the vehicle into reverse. The activation unit can be connected so that it senses the vehicle's powering of the backup lamps. Such an activation unit can be essentially a battery powered BLE component that is configured to send a signal when its button is pressed or it otherwise detects a need for triggering the camera function. In the case of a transport trailer or school bus, the activation unit could trigger from different lamps circuits, such as turn signals or passenger door lights.

By providing an activation unit, triggering of the vehicle camera to operate is made efficient for the operator since it does not involve calling up an app on the smartphone, and because the vehicle camera peripheral can have its camera and video transmission functions triggered by the activation unit, the peripheral can be efficiently powered using batteries and thus avoid a wired installation.

The activation unit can also comprise an app running in the smartphone that detects user input. For example, Applicant has found that the app can read data from a smartphone's proximity sensor indicating a hand position near the proximity sensor, interpreted as a signal to activate the peripheral. Moreover, Applicant has found that the reading of a smartphone's accelerometer data can detect finger taps against the smartphone body that can be discriminated from vehicle vibrations and movements or screen touches.

In the case of an operating system that restricts the ability of an app to run in the background, such as the iOS® operating system, the background app can be activated by BLE messages. iOS® allows a background app to request the operating system to allow it to run when a message is received from a connected BLE device. The peripheral can then be used to send BLE messages on a regular basis to the smartphone so that the smartphone operating system maintains the background app running. The background app can then detect user input and respond to it by sending a message that would cause the camera peripheral to begin operation.

In the case of an operating system that restricts the ability of an app running in the background from displaying video, Applicant has also discovered that a BLE keyboard connection can be used to send keyboard commands either from the camera peripheral or from an external activation unit to the smartphone to cause a video display app to run in the foreground. While the Android® operating system can allow a background app to move into the foreground, display video while in the background, or to display video on the lock screen of the device, the iOS® operating system requires the smartphone to be unlocked and for the app providing the video display to be running in the foreground. Such keyboard commands can be used to place the smartphone in a state ready to display the video with no or very little user interaction. For example, the current iOS® version causes a dialog box to appear to require user screen touch input when a wireless keyboard command attempts to change the foreground app. Thus, a single touch by a user on the screen of the iOS device can allow wireless keyboard commands to cause the smartphone to begin displaying camera video.

Applicant has discovered that a battery powered camera can be powered off with only a Bluetooth bridge left active with the viewing device controlling the power state of the camera unit to turn on using user input from a separate battery-powered activation unit. In the case of a vehicle camera, the activation unit is located within the easy control reach of the driver of the vehicle, and allows the driver to control the vehicle camera while driving.

In some embodiments, a separate activation unit is provided that is paired with the smartphone for issuing Bluetooth keyboard commands so as to cause the smartphone to go into a desired state. When this activation unit is used with a Bluetooth peripheral, such as a camera, the activation unit or the smartphone can cause the camera unit to wake up by Bluetooth communication in the case that the camera unit was in a sleep mode. The configuration of the Bluetooth keyboard commands in the peripheral device that sends them to the smartphone to cause the desired app to be called up can be done using a utility that is part of the desired app itself that works with the peripheral or using a separate configuration app on the same smartphone. Alternatively, a separate programming mechanism can be used to set the commands.

In some embodiments, the peripheral device can be powered by a controllable power source. In the case of a rear view camera, power can conveniently be taken from the back up lights and controlled by the gear shifter being put into reverse gear. The placing of the gear shift lever into reverse powers up the camera unit, and the camera unit can send Bluetooth HID commands (normally for iOS devices) or other commands such as custom commands (normally for Android devices) to the smartphone to cause the camera app to be called up.

In accordance with one broad aspect of some embodiments, there is provided an automobile rear view camera device having a wireless module, a consumer control key sequence memory and interface unit connected to said wireless module and configured to store consumer control key codes (or descriptors), a consumer control key transmission module configured for automatically transmitting at least one consumer control key code or descriptor from said consumer control key sequence memory on powering on of said device using said Bluetooth module, a rear view camera, and a video transmission module connected to the camera and the wireless module for transmitting images from the camera. The consumer control key sequence interface unit may also be configured to receive keyboard command configuration data from the smartphone, for configuring the keyboard commands that are stored in computer readable memory. For instance, the keyboard command configuration data may provide the keyboard command configuration data specific to a designated unlocking sequence for a smartphone, updating the unlocking keyboard command configuration data as the unlocking sequence changes.

In accordance with another broad aspect of some embodiments, there is provided a handheld computer having a wireless data module for communicating with an automobile rear view camera device, an operating system based consumer control key module for interpreting a consumer control key code or descriptor received from the device by the wireless data module to generate operating system control commands, an operating system app launch module responsive to the control commands for launching a rear view camera application program stored in a memory on the handheld computer, a consumer control key descriptor set up module associated with the rear view camera application program for transmitting consumer control key data to the camera device using the wireless module, a camera viewer associated with the rear view camera application program for displaying images received from the camera device through the wireless module.

DETAILED DESCRIPTION

The present application teaches of a rear view camera system connectable with a user's smartphone to view the images produced by the camera. As the screen of the smartphone is used to view the images from the camera, the user does not need to purchase or obtain a separate screen device other than the smartphone to view the images produced by the rear view camera. Moreover, the rear view camera system may be activated with minimal or no user input performed on the smartphone. Therefore, the present rear view camera system offers a means for a user to easily view the images produced by the rear-view camera without having to navigate through the smartphone to, for instance, launch the viewing app (e.g. unlocking the phone, searching for the viewing app, launching the viewing app), undesirable when the user needs to back-up quickly or to rapidly identify what is located being the vehicle. As such, the present rear view camera system may be activated by a simple double-tap performed by the user on the smartphone's frame, pressing a button that is part of an activation unit, or placing the gear shift in reverse, as is further described herein.

Certain Definitions

While in this description reference is made to Bluetooth wireless transmission, it is to be understood that this is a commonly used wireless transmission protocol. It will be appreciated that any suitable wireless transmission protocol can be applied to variant embodiments herein.

While in this description reference is made to iPhone, a smartphone designed by Apple Inc. of California, it is intended that the device12can be any electronic device, such as a laptop or desktop computer, a smart phone or a tablet computer, such as an iPhone, iPod touch, Android tablet or Android smart phone, GPS unit, display and the like.

Peripheral Activated by User Input on Smartphone:

Reference is now made toFIG. 1, illustrating an exemplary rear view camera peripheral14connected to a smartphone12. In the example ofFIG. 1, the exemplary smartphone12is one that runs on an iOS device, such as the smartphones designed by Apple Inc. However, it will be appreciated that the peripheral14may be used with any other smartphone without departing from the present teachings.

The peripheral14has a camera28for generating a stream of images. Camera28may be digital or analog. The peripheral14also has, optionally, a battery75and a power circuit84. In some examples, the peripheral14does not run on a battery, but may be, for instance, wired in and powered by the back-up lights of the vehicle. The peripheral14also has a Bluetooth transceiver16b. The battery75is connected to the power circuit84and, in some embodiments, to the Bluetooth transceiver16b. The peripheral14also has a controller86. The peripheral14also has a codec85, for compressing, encoding and transmitting a stream of images received from the camera28.

Method of Activating Peripheral and Running the Viewing App:

Reference is now made toFIG. 3, illustrating an exemplary method200of activating a peripheral14using user input performed on the smartphone12, the activation of the peripheral causing the smartphone12to run a rear view camera application program21to display images from the rear view camera28.

The smartphone12first detects the Bluetooth transceiver16bof the peripheral14when the smartphone12is in range of the Bluetooth transceiver16bat step210. The Bluetooth transceiver16bmay be operating with Bluetooth Low Energy (BLE) technology. Once the Bluetooth transceiver16bis detected by the smartphone12, using, for instance, geofencing between the smartphone12and the Bluetooth transceiver16b, the Bluetooth transceiver16bis paired with the smartphone12at step220, establishing a wireless Bluetooth connection between the smartphone12, via its Bluetooth interface16a, and the Bluetooth transceiver16b. In some embodiments, the smartphone12may be placed in the vehicle on a holder having a magnet. The magnetometer of the smartphone12(and/or its magnetic field sensors), as is known in the art, detects the presence of the magnet, indicating that the smartphone12is positioned in the holder, likely ready to be used in the vehicle. This additional information may be used as an indication to start sending signals to the background application82to cause it to wake up, as explained herein.

In some embodiments, once the Bluetooth transceiver16bis paired with the smartphone12(and/or the magnetometer of the smartphone12picks up the magnet of the holder of the smartphone12), the Bluetooth transceiver16bstarts sending signals (e.g. pings) periodically to the smartphone12, to its Bluetooth interface16aat step230. In one embodiment, the Bluetooth transceiver16bsends a ping every second. The pings are received by the Bluetooth interface16a, transmitted to the iOS of the smartphone12and processed by the iOS. The smartphone12has a user input detection background application program82for periodically verifying if the user has provided input that corresponds to user input indicating the user's desire to activate the peripheral14. The activation user input may be defined by the user or pre-configured when the background application82is added to the smartphone12. The background application program82may be configured to verify user input data transmitted from a specific sensor83of the smartphone12(or the background application82is configured to retrieve the data from the sensor83).

In some examples, the sensor83in question that is verified by the background application program82may be the proximity sensor of the smartphone12. The proximity sensor, as is known in the art, is able to detect the proximity of nearby objects without any physical contact. The proximity sensor of the smartphone12is used to detect when a user's face is near the smartphone12during the call in order to avoid performing acts associated with undesirable user taps of the display screen of the smartphone12during a call (such as one caused by an ear pressing the screen of the smartphone12). In some smartphones, the proximity sensor is located at the top of the smartphone.

The proximity sensor may register when an object is in proximity of the smartphone12, such as a hand positioned over a certain portion of the smartphone12. If the proximity sensor is located at the top of the smartphone12, positioning a hand over the top of the smartphone12is registered by the proximity sensor. Therefore, after the background application program82is woken up by a ping, it may be configured to verify if the proximity sensor has detected as user input a hand near the proximity sensor, or a sequence of an object coming in and out of range of the sensor, such as a sequence consisting of a hand coming into range of the proximity sensor, and then out of range, followed by the hand coming back into range. It will be appreciated that any combination of hand movements (or other movements of the body or of an object) that can be detected by the proximity sensor may be used as activation user input, then retrieved by or transmitted to the background application82.

In other examples, the sensor83may be an accelerometer of the smartphone12as is known in the art, measuring changes in velocity (e.g. vibrations) of the smartphone12. As such, the user input indicative of the user's desire to activate the peripheral14may be a double-tap of the frame of the smartphone12, picked up by the accelerometer. Preferably, the activation user input is selected as one that can be distinguished from those used to activate or function other common application programs found on the smartphone12. Moreover, it is important that the activation user input is also sufficiently distinguishable from acceleration, deceleration and other motions that a vehicle is subject to (e.g. vibrations caused by hitting a speed bump), so that this input resulting from driving the vehicle is not falsely picked up by the accelerometer of the smartphone12as the activation user input. For instance, it has been determined that the accelerometer of an iPhone 6 can sufficiently distinguish the user input of a double tap of its frame from the double tap of the top of its screen, or the motions of the vehicle.

Moreover, the background application82may be configured to declare that it supports a Core Bluetooth background execution mode in its Information Property List (Info.plist) file. Therefore, in some embodiments, as the background application82is declared as being Bluetooth sensitive, once a ping is received by the smartphone12from the Bluetooth transceiver16b, the iOS wakes up the background application82at step240. The background application82stays awake for a certain time following being woken up, and verifies the user input data received from the accelerometer. However, as the pings are sent periodically to wake up the background application82, each ping keeps, in some embodiments, the background application82awake. The background application82may include a detection algorithm for analyzing the user input data in order to identify activation user input (e.g. by logging in the user input data, comparing against the other forms of user input registered by the smartphone12and the vibrations of the vehicle when moving, and/or identifying if it is comparable to the activation user input). In some embodiments, if the user input data matches the activation user input, then the background application82sends a trigger signal to the Bluetooth transceiver at step250. The trigger signal can be defined as, when the activation user input is a double-tap on the frame of the smartphone:

<Trigger><Source> double tap on the phone</Source></Trigger>or it can be very a binary hex as 2 bytes, where the first byte defines a command and the second the source of the commands, for instance:0x01—trigger0x03—double tap on the phone.

In some embodiments, the trigger signal is sent to the Bluetooth transceiver16bvia the Bluetooth interface16a, communicated through the Bluetooth connection established between the smartphone12and the Bluetooth transceiver16b.

In some embodiments, the background application82does not identify if the user input corresponds to the activation user input, instead sending all of the user input received from at least one of the smartphone's sensors to the Bluetooth transceiver16b(e.g. in the form of a binary hex identifying the type of user input). The Bluetooth transceiver16bmay have an analyzing function for analyzing the user input data received and comparing it with specific activation user input data (e.g. if the Bluetooth transceiver16breceives a binary hex, the binary hex is compared to establish if it corresponds to that leading to the activation of the peripheral14).

In some embodiments, once the Bluetooth transceiver16breceives a trigger signal indicative of user input for activating the peripheral14, the Bluetooth transceiver16bprompts the activation of the other components of the peripheral14at step260. In other embodiments, the activation of the other components of the peripheral14may be activated following the wireless transceiver16breceiving an activation signal from an activation unit as described herein (e.g. a button that is pressed by a user, the activation unit sending a wireless activation signal to the peripheral14upon the pressing of the button). For instance, the Bluetooth transceiver16bmay signal the activation of the power circuit84, allowing power from the battery75to be sent to the controller86and the rear view camera28. Once the controller86is powered, the controller86retrieves and reads from non-volatile memory24a sequence of keyboard commands at step270. In the case of the Apple iPhone®, keyboard commands can be used to perform actions that normally are associated with the device's touch screen actions or buttons, as for example, the swipe action to initiate unlocking a locked phone, the pressing of the home button, volume control, etc. Likewise, running a desired app can be implemented by using a keyboard command to initiate a search or find on the smartphone, and then sending keystrokes of the name of the app on the smartphone12will cause the desired app21to be found, with another keystroke, such as ENTER. Modules18and20represent parts of the smartphone12operating system that process wireless keyboard commands and allow such commands to launch application programs or apps. In the present example of method200, the sequence of keyboard commands may be those for unlocking the smartphone, searching for an application program21for viewing the images originating from the camera28, and run the viewing application program21. In some embodiments, the sequence of keyboard commands may be preceded by the sending of at least one character to the smartphone12for lighting up the smartphone12, followed by the sequence of keyboard commands for unlocking the smartphone12and running the viewing application program21. In other embodiments, the sequence of keyboard commands may be limited to those for running the application program21. For instance, the sequence of keyboard commands, once received by the smartphone12, may be processed by the OS of the smartphone12to cause the application program21to run and to present a notification window appearing on the screen of the smartphone12when the smartphone12is locked. For example, in the case of an iOS device, such as the iPhone 6, the user may swipe to the side the notification box corresponding to app21and, by using the iOS device's fingerprint security protocol, unlock the device by presenting the user's fingerprint (or the user may type in the user's unlock code). Once the smartphone12unlocked, app21begins to run and the display of the smartphone12begins to show the images received from the peripheral14.

The controller86then transmits the sequence of keyboard commands to the Bluetooth transceiver16b. The Bluetooth transceiver16btransmits the sequence of keyboard commands via the Bluetooth connection to the Bluetooth interface16aof the smartphone12at step280. The data of the sequence of keyboard commands are processed by modules18and20, and the iOS carries out these commands to, optionally unlock the phone, then search for the viewing application program21, and run the viewing application program21.

In the case where the peripheral14adheres to Apple's MFi licensing program, the user may be required to select an “allow” button that appears on the display of the smartphone12to run the viewing application program21. Touching the portion of the screen corresponding to the “allow” button may allow the user to run the viewing application program21. In other embodiments, the pressing of “allow” button may be performed using the AssistiveTouch™ application program of the iOS.

The stream of image data generated by the rear view camera28may be optionally encoded and, in some examples, compressed, by the codec85(e.g. at different compression rates depending on the available bandwidth). The stream of image data may also be transmitted to the smartphone12by the Bluetooth transceiver16bvia the Bluetooth connection between the Bluetooth transceiver16band the Bluetooth interface16a.

The stream of images made be decoded by the smartphone's codec32, and displayed on the screen of the smartphone12using the now active viewing application program21. In some examples, the background application82and the viewing application program21are part of the same program. In other examples, they are separate programs.

The peripheral14is therefore fully operational with its viewing application program21running on the smartphone12at step290.

Turning on the Background Peripheral:

The background application program82may be turned off on the smartphone12, requiring that it is turned on before use. In some embodiments, the BLE-based Bluetooth transceiver16bmay function as a beacon for the smartphone12. Using geolocation, once the smartphone12is in range of Bluetooth transceiver16b, the background application program82, having a permission to use the geolocation service, is turned on by the OS of the smartphone12. Once the smartphone12moves out of range of the Bluetooth transceiver16b, the OS of the smartphone12turns off the background application program82. In other examples, the user may manually turn on the background application program82or manually turn off the background application program82, receiving, for instance, a warning in the form of a message when the background application program82is to be or has been turned off.

Reference is made back to the exemplary peripheral ofFIG. 1.

The camera28and the peripheral14can be mounted to the rear license plate mounting of a vehicle. The battery75may be contained in the mounting frame. The controller26, the Bluetooth transceiver16b, the codec85, the non-volatile memory24and the power circuit84may be mounted on a single chip or circuit board (or in some embodiments, on separate chips or circuit boards), and the single chip or circuit board may also be contained within a compartment of the mounting frame. The controller26may be a microprocessor (such as a MSP430F5254RGCT) that includes non-volatile memory24(including the configuration memory). Non-volatile memory can also be provided using a component separate from the microprocessor. Some models of microprocessors may include a Bluetooth wireless transceiver16b, while a separate component for such a wireless transceiver (Bluetooth or otherwise) can be provided using a separate IC component (for example, a BLE0202C2P chip and/or a CC2564MODN chip). In some embodiments, the peripheral14may have two Bluetooth transceivers, one with BLE (Bluetooth Low Energy) technology, and the other with Bluetooth Classic technology. The BLE chip of the peripheral14may connect with the BLE chip of the smartphone12. However, once the peripheral14is activated, then the smartphone12, having its own Bluetooth Classic chip, establishes a wireless connection with the Bluetooth Classic chip of the peripheral14. As the Bluetooth Classic chip14consumes more energy, but may have greater bandwidth that the wireless connection established between BLE chips, in some examples, it is active only when the peripheral14is activated or when prompted to turn on. As such, the Bluetooth Classic connection is used to transmit the stream of image data to the smartphone12from the peripheral14over its greater bandwidth connection. When the peripheral14is shut off, so may the Bluetooth Classic chip return to sleep mode, or shut off, to save power. Once the Bluetooth Classic chip shut off, the BLE chip may remain active, consuming less power, waiting for the smartphone12to send a signal triggering a subsequent activation of the peripheral14. In other embodiments, the wireless transceiver16bmay be a Bluetooth chip operating with low battery consumption and capable of establishing a bandwidth connection comparable with that of Bluetooth Classic technology (in these embodiments, the BLE chip may always be active).

The peripheral14is woken up from a low-power sleep state using the Bluetooth transceiver16b. In some examples, the Bluetooth transceiver16bis a Bluetooth chip. In some embodiments, the Bluetooth transceiver16bis connected to the battery75(and in some examples, connected to the battery75via the power circuit84), and receives power from the battery75. The Bluetooth transceiver16bmay be a Bluetooth Low Energy Chip, integrating the BLE wireless personal area network technology or Bluetooth Smart™. The Bluetooth transceiver16bis also configured to send a ping or signal to the smartphone12, once the peripheral14is paired with the smartphone12. The Bluetooth transceiver16balso receives a trigger signal from the smartphone via the wireless connection to activate the peripheral14. Therefore, the Bluetooth transceiver16bmay cause the power circuit84to allow power to run from the battery75to the other components of the peripheral14(e.g. the rear view camera28and the controller86). The Bluetooth transceiver is also connected to the rear view camera28or to the codec85and receives a stream of image data (encoded or decoded; compressed or uncompressed), from the rear view camera28or the codec85. The Bluetooth transceiver16bmay then transmit the image data over the wireless connection established with, for instance, the smartphone's Bluetooth interface16a, to the smartphone12for viewing by the user on the smartphone's screen.

In other embodiments, the wireless transceiver16bmay be a wireless USB transceiver.

Consumer control key non-volatile memory and interface24is computer readable memory that may store the keyboard commands for at least one activation button, and instructions that are readable and may be executed by the consumer control key transmission module26(e.g. memory may store one sequence of keyboard commands associated with one task, or multiple sequences of keyboard commands, each associated to at least one task such as unlocking the smartphone12, searching for the application program21, running the application program21). The consumer control key interface24may also be configured to receive wirelessly command key configuration data from the smartphone12. The command key configuration data may provide information on the sequence of keyboard commands to be stored. Therefore, the smartphone12may send information to the peripheral14regarding the sequence of keyboard commands to be used. Such may be practical, for instance, when the password to unlock the smartphone12changes. The new sequence of characters to unlock the smartphone12may be sent by the smartphone12to the consumer control key non-volatile memory and interface24in the form of command key configuration data, the sequence of keyboard commands stored in consumer control key non-volatile memory and interface24updated as a result.

In the examples where there the peripheral14has a battery75, the power circuit84is connected to the Bluetooth transceiver16band allows power to flow from the battery75to the controller86and to the camera28when a signal is sent by the Bluetooth transceiver16bto activate the peripheral14(or activate the power circuit84that in turn activates the other components of the peripheral14). The power circuit84may be a power management integrated circuit. The power circuit84may also cease the flow of power from the battery75to the controller86and to the rear view camera28when the power circuit84receives a signal from the Bluetooth transceiver16bto deactivate the power circuit84or deactivate the peripheral14.

In some embodiments, the peripheral14is wired directly to back-up lamps, as described herein with respect toFIG. 7.

The codec85is a video codec as is known in the art for encoding a stream of images received from said rear view camera28. The codec85may also compress the image data to reduce transmission bandwidth. In some embodiments, the codec85may be connected to the controller86, where the controller86may vary the compression rate of the image data, via the codec85, as a function of available bandwidth of the wireless channel established between the Bluetooth transceiver16band Bluetooth interface16a, as explained herein. In some embodiments, the codec85may be part of the rear view camera28. In other embodiments, the codec85may be separate from the rear view camera28.

The battery75may be that as is known in the art. The battery75may be rechargeable.

In some embodiments, the activation of the peripheral may be initiated by a signal received from an activation unit15. In some embodiments, the activation unit15may be separate from the peripheral system. As described herein, the activation unit15may be, for example, a dongle with a button that may be pushed by the user to signal the activation of the peripheral14. In other embodiments, the activation unit15may be a device that sends a signal when the gear stick is shifted to a certain position, or the back-up lights turn on, as further described herein.

Reference is now made toFIG. 2A, illustrating an exemplary peripheral camera system10, with a peripheral14connected to an activation unit15. The wake-up signal is sent by the activation unit15in the embodiment ofFIG. 2A. Unit15can be a small battery-powered button supported on a key-chain, dashboard of a vehicle, visor, air vent, or any other suitable location that can allow the user to press a button (or otherwise issue a command) to cause the unit15to send a wireless signal to the interface16bto cause the peripheral14to wake up. Unit15can be a stand-alone device or it can be integrated into a phone holder/case or tablet holder/case.

The activation unit15may establish a first wireless connection with the peripheral14that is not, in some examples, a Bluetooth connection. As shown inFIG. 2B, the activation unit15connects with a wireless interface17of the peripheral14. The wireless interface17may be configured to establish a wireless connection with the activation unit15, and receive a wireless activation signal from the activation unit15. The peripheral14may establish a second distinct wireless connection with the smartphone12(e.g. a Bluetooth connection). The activation unit15may send the activation signal, for causing the peripheral14to turn on, to the wireless interface17across the wireless connection. As shown inFIG. 2B, the Bluetooth interface16bestablishes a Bluetooth connection with the Bluetooth interface16aof the smartphone12. This Bluetooth connection may be used to transmit the sequence of keyboard commands to the smartphone12, or the stream of images from the rear view camera28to be displayed on the smartphone12. In other embodiments, the activation unit15may establish a first wireless connection with the smartphone12, and a second wireless connection with the peripheral14.

In some examples, as shown inFIG. 2C, the activation unit15may communicate via radio frequency signals with the peripheral14(e.g. over a 915 MHz transmission channel), where the activation signal may be a radio signal. The peripheral14may have a RF module18(having, e.g. a RF module or RF transceiver chip as is known in the art) and the activation unit15may also have a RF module as is known in the art communicating with RF module18of the peripheral14.

In the embodiment ofFIG. 2A, the peripheral, once woken up, sends Bluetooth keyboard commands to the smartphone12to cause the latter to unlock (in the case that it was locked) and to run an app21associated with the rear view camera, including a viewer34. The peripheral14has a program module26that causes the transmission of wireless keyboard commands previously stored in memory26to the Bluetooth interface16aof the phone12. Once these commands are sent, module26causes another module30of the peripheral14to encode the video images from camera28for transmission to the phone12. The video encoding module30can comprise a hardware chip or software within the microcontroller or computer system.

In the case that the peripheral14transmits the keyboard commands to the smartphone12, an HID keyboard is started using a classic Bluetooth connection. Module26then sends a sequence of keyboard commands stored in memory24. In the case of an iPhone, this can comprise the following steps:send a first keystroke to light up the smartphone;send HID keyboard command for unlock swipesend passcode 4 digits or long passcode with ENTERin some examples, the Bluetooth keyboard can be stopped so as to be able to use an assistive touch commandturn on the camera28in the peripheral14send iOS launch command to launch app21in some examples, start iOS assistive touch, start HID point device (Mouse service) and move mouse pointer to the “OK” confirm position and press to actually start camera APP; in other examples, launch the Spotlight Search app, enter the keyboard commands corresponding to the name of the image viewing application program, and launch the image viewing application program.Once the app is fully launched, the video streaming starts. In some examples, disable assistive touch if it was activated to launch the viewing app.

An example of a command that simulates a press on touch screen can be as follows:

The memory24may store one sequence of keyboard commands associated with one task, or multiple sequences of keyboard commands, each associated to at least one task, such as, unlocking the smartphone12, searching for the application program21, running the application program21.

In other examples, the keyboard commands do not need to include those for unlocking the smartphone12. For instance, the sequence of keyboard commands may be limited to those necessary to run the application program21. Once the smartphone12receives the sequence of keyboard commands, the sequence may be processed by the OS of the smartphone12to cause the application program21to run and to present a notification window appearing on the screen of the smartphone12when the smartphone12is locked. For example, in the case of an iOS device, such as the iPhone 6, the user may swipe to the side the notification box corresponding to app21and, by using the iOS device's fingerprint security protocol, unlock the device by presenting the user's fingerprint (or the user may type in the user's unlock code). Once the smartphone12unlocked, app21begins to run and the display of the smartphone12begins to show the images received from the peripheral14.

It will be understood that the sequence of keyboard commands used to cause the smartphone to perform certain tasks, such as its unlocking or running a designated application, depends on the platform of the smartphone. The sequence of keyboard commands also depends upon the task to be carried out. Therefore, a skilled person will readily understand that a desired sequence of keyboard commands for a specific platform may be determined using basic trial and observation, where the effect of receiving a specific sequence of keyboard commands by the smartphone is monitored for the desired action.

While the video transmission inFIG. 2Ais done using the same Bluetooth interface16bas is used for the wireless keyboard interface, a separate wireless transmission link could be used. For example, it is possible to use an IEEE 802.11 (i.e. WiFi) link or a wireless USB or WUSB link to transmit the video data. This would require connecting the smartphone12to a corresponding WiFi link bridge of the peripheral14. Keyboard commands from peripheral14can be used to cause the smartphone to establish a WiFi connection to a WiFi module of the peripheral14. This option can provide greater bandwidth than Bluetooth, however, causing the smartphone12to make the new WiFi connection can cause the smartphone12to drop an existing WiFi connection and can require a few seconds to establish. Applicant has found the use of WiFi to be acceptable in some circumstances, however, Bluetooth communication has been found to be faster to start and to have sufficient bandwidth for the rear view camera application.

In some embodiments, as shown inFIG. 2D, the peripheral14may share a WiFi connection with the smartphone12in addition to the Bluetooth connection established between the smartphone12and the peripheral14. The Bluetooth connection is established between the Bluetooth interface16aof the smartphone12and the Bluetooth interface16bof the peripheral14. The smartphone12and the peripheral14share a common WiFi connection, where both wireless network interface91aof the smartphone and the wireless network interface91bof the peripheral14connect to a common WiFi connection (e.g. the building's WiFi connection when the vehicle is in or in proximity of the building; a wireless network connection; or a wireless wide area network).

In some embodiments, the smartphone12has a channel bandwidth estimation app92configured to estimate the connectivity and/or the available bandwidth over the WiFi connection between the smartphone12and the peripheral14. In some examples, channel bandwidth estimation app92may also estimate the available bandwidth over the Bluetooth interface16afor sending signals to the peripheral14to adjust, for instance the FPS or compression ratio of the stream of image data. The channel bandwidth estimation app92estimates the available bandwidth over the WiFi connection by communicating with the wireless network interface91a. The channel bandwidth estimation app92detects if the bandwidth of the WiFi connection drops under a desired level, and/or if the WiFi connection is lost altogether. If so, the channel bandwidth estimation app92may send, via the Bluetooth interface16a(or, if the WiFi connection is of limited bandwidth, but still active, via the wireless network interface91a), a signal to the Bluetooth interface16b(or wireless network interface91b). This signal is relayed to the connection controller module31. The connection controller module31(e.g. module31may be software stored in the memory of peripheral14, carried out by a processor of the peripheral14) receives the signal and instructs the video compression and transmission module30to switch the sending of the stream of image data from the wireless network interface91b(over WiFi) to the Bluetooth Interface16b(over Bluetooth).

Similarly, when the WiFi connection is re-established or when the available bandwidth of the WiFi connection increases, as determined by the channel bandwidth estimation app92, the channel bandwidth estimation app92may send a signal to the peripheral14to switch the streaming of image data to the WiFi connection. The connection controller module31receives this signal and instructs the video compression and transmission module30to transmit the stream of image data to the wireless network interface91b(to send via the WiFi connection), and not the Bluetooth interface16b.

In some embodiments, the smartphone12may not have a channel bandwidth estimation app92. In these embodiments, the analysis of WiFi connectivity and available bandwidth may be done by the connection controller module31. The connection controller module31may then signal the video compression and transmission module30to switch between transmitting the stream of image data to the Bluetooth interface16bor the wireless network interface91bdepending upon the WiFi connectivity and/or the available bandwidth over the WiFi connection.

It will be understood that because the WiFi connection may provide greater bandwidth than the Bluetooth connection, a switch of the streaming of image data from the WiFi connection to the Bluetooth connection, such as when the WiFi connection is lost, may require adjusting the frame rate and/or the compression ratio of the stream of image data. For instance, the stream of image data may be at 30 FPS when streaming over the WiFi connection, but may drop to 16 FPS, including, in some cases, a change in the compression ratio of the stream of image data, when switched to the Bluetooth connection. In some examples, if the available bandwidth of the Bluetooth connection drops, the video compression and transmission module30(receiving instructions from the connection controller module31) adjusts instead the compression ratio so that the frame rate does not drop below a certain level which would lead to a choppy video (i.e. the video is no longer fluid), The varying of the compression ratio allows to compensate for the reduced available bandwidth while maintaining a fluid video (e.g. over 16 FPS).

Furthermore, the bandwidth available over the wireless communications link can be assessed and the video transmission rate can be adjusted according to the assessed bandwidth by setting a compression ratio in module30, for example a TW9900 chip with an OV780 chip that can provide a variable compression ratio. The available bandwidth can be assessed, for example, by sending a block of data from peripheral14to app21and measuring the time required for the block of data to be transmitted. The peripheral14can then adjust the compression and/or the frame rate accordingly. Applicant has found that the quality of viewing is greatly improved to use a frame rate and/or a compression rate that the channel can handle without dropping frames rather than using a lower compression rate or a frame rate that then involves some frame drops. For instance, when the peripheral14is used for assisting a driver with backing up the driver's vehicle, the video feed received by the driver is as close as possible to real-time (e.g. no buffering) for allowing the driver to promptly react as he or she is operating the vehicle as a function of the received image feed. If the driver receives an intermittent video as a result of dropped frames, due, for example, to limited available bandwidth, the driver may be missing important information, such as the presence on an obstacle behind the vehicle (e.g. a child) and may not have received the visual information in time to avoid the obstacle.

To ensure the Bluetooth streamed video's latency performance, the following can be performed. The Bluetooth radio's usage of the smartphone can be monitored in real-time. This can be done with the help of app21in communication with peripheral14. It is determined if a phone call is in progress at device12and if the audio route is to Bluetooth hands-free. If Smartphone's12Bluetooth radio is in use, then the H264 video's compression ratio in module30is dynamically adjusted to reduce the bit rate of the video so that video's latency performance is assured. Then, app21monitors the video streaming bit rate in real-time, as smartphone12knows the video's source bit rate, if the streaming bit rate is lower than the source bit rate (consistently for a predefined period of time), the app21can decide that the lower streaming bit rate is due to interference of surrounding environment and increase the H264 video's compression ratio by sending a command to peripheral14to reduce video source bit rate in module30.

It is also possible to cause the smartphone12to stop using the wireless channel for the telephone call audio by causing the smartphone to change the audio output of the smartphone from, for example, Bluetooth to the smartphone's own built-in speaker. The app21may or may not be able to issue such a command to the operating system of the smartphone12, and in the case that it cannot, suitable wireless keyboard commands can be issued from module26to cause the audio streaming usage of the wireless channel to be stopped so that more bandwidth is available for the video data. When video transmission is over, the user can restore telephone call streaming over the wireless channel, or the app21or module26can perform the restoration.

The steps involved in adjusting the frame rate or compression rate in the video encoding are illustrated inFIG. 4.

In the embodiment ofFIG. 2A, the smartphone12has a video codec32that is shown as part of the operating system of the hand held computer or smartphone. Alternatively, the video codec32could be provided in software within the app21. Decoded video frames from module32are then displayed on the display viewer34. While it is preferable to transmit encoded and compressed video, uncompressed images can also be transmitted, possibly at a lower resolution or frame rate.

When a driver is finished using the peripheral14, the user can switch apps using the interface controls of the smartphone12or alternatively the unit15can be used to signal closing or stopping of the peripheral14. Unit15can make use of a separate key or an interpretation of a same key (subsequent press, held-down press, or a double tap) to issue shutdown commands to either the peripheral14or the smartphone12, or to both. The shutdown command to the phone12can involve Bluetooth keyboard commands to be sent directly or via peripheral14to interface16ato cause the peripheral14app21to close and then, preferably as configured by the user, the smartphone12can turn its screen off, lock, go to a home screen, go to a GPS navigator app, etc. This can save the user from having to manipulate the smartphone12, following a backing up action of the vehicle and normally an immediate action of continuing to drive forward.

Because the camera28can be an after-market device, the position of the camera, its tilt angle and the vehicle width are not known until installation. In some embodiments, rear view camera grid lines can be used to estimate the distance and the width of the vehicle when using the camera image for backing up. Such grid lines are known, and in the case of grid lines to guide backing up into a parking space, the lines appear as curved lines that should follow the image of the parking space's parallel lines with transverse curved lines showing distance from the vehicle bumper to the end of the space. Producing an overlay of grid lines using an analog video camera is complicated, and in some embodiments, grid line display is achieved in app22rather than in the peripheral14. The app22can be provided with a settings mode that gives the user the ability to adjust the grid lines. Because the smartphone12is wirelessly receiving the images, the user can exit the vehicle and stand in the camera's field of view to be on the grid lines seen using app22.FIG. 5illustrates the step involved in configuring the grid lines. The user can then use the interface of the app to set the position of each of the side or width lines to take into consideration camera position (particularly when the license plate is to one side of the rear of the vehicle) and the vehicle width, and to set the position of the transverse distance line or lines. These calibration settings can be stored in the app22or they can be stored in the peripheral14so that they can be retrieved and used with the smartphone app22of other users.

FIG. 7illustrates an embodiment similar to that ofFIG. 2Ain which activation of the peripheral comes from a different mechanism than the activation unit15. InFIG. 7, the rear view camera peripheral14is turned on by being powered from the 12V DC power taken from the vehicle's reverse indicator lights. An installer finds the power cables connected to the back up or reverse indicator lamps, and splices in a power cable that feeds the peripheral14. Since power is provided to the reverse indicator lamps by a switch associated with the gear shift mechanism, the peripheral is selectively powered only when the vehicle is in reverse gear.

When the peripheral14is battery-powered, installation in the case of a vehicle can be simplified because a power cable is not required to pass from an inside of the vehicle to an outside. However, on/off control of the peripheral14using a vehicle signal, such as the on/off state of the back-up indicator lights, is convenient because the driver does not need to engage a separate control for the camera. In an alternative embodiment, the activation unit15is installed in the vehicle to be controlled by a vehicle signal, such as the on/off state of the back-up indicator lights. For example, an activation unit can be installed in a compartment housing the rear brake/running/back-up indicator lights and powered by the turning on of the back-up lights. In this way, when the driver puts the vehicle into reverse, the activation unit15can cause the operation of the rear-view camera to start.

In some embodiments, as illustrated inFIG. 8, the activation of the peripheral14may be the result of a signal that it receives once a gear stick of the vehicle is placed in reverse. For example, the peripheral14may be activated by receiving a signal from an activation unit15acting as (or having) a gear shift signaling device. The activation unit15detects when the gear stick is shifted into a certain position, for instance, a reverse position (indicating that the driver intends to back up the vehicle), and sends a signal to the peripheral14that in turn communicates with the smartphone12to turn on the APP21responsible for showing the images streamed from the rear view camera28.

The activation unit15ofFIG. 8has a property generator71for generating a change in a given property (e.g. a magnetic field, change in light intensity), a sensor73adapted to pick up on a specific property change, a wireless transmitter72responsive to the sensor73picking up on a given property change, and an attachment device for joining at least a portion of the activation unit15to the shaft of the gear stick (or another portion of the gear stick).

The wireless transmitter72may be one for establishing a bandwidth limited connection, e.g. a wireless Bluetooth transmitter. The wireless transmitter72may transmit, via a Bluetooth connection, an activation signal to the peripheral14via the Bluetooth interface16b(or to its camera28) once the sensor picks up on a desired change in property. The wireless transmitter72is connected to the sensor73, receiving a signal from the sensor73once the sensor73picks up on a specific property change. In some examples, the wireless transmitter72is a radio frequency transmitter (e.g. a RF module) configured to send a wireless RF activation signal to the peripheral14once a gear shift to the desired position is detected.

The attachment device is attached to at least a portion of the activation unit15and is adapted to attach to the gear stick. For instance, the attachment device may be an adjustable clamp on ring (e.g. a clamp ring), wrapping around the shaft of the gear stick, to which at least a part of the activation unit15is attached.

The property generator71may be composed of two parts. A first part of the property generator is located in the car next to the position of the gear stick when the gear stick is placed in reverse. For instance, the first part of the property generator71may be fixed on the inner surface of the box that at least partly encases the gear stick, the first part of the property generator71located at the position where the gear stick is located when moved to the reverse position. A second part of the property generator71may be joined to the gear stick. When the gear stick shifts to the reverse position, the first and second parts of the property generator71align and/or are placed in proximity so as to create a property change. For instance, the first part of the property generator71may be a magnetic strip, and the second part of the property generator71may be a magnet located on the activation unit15joined to the gear stick. Therefore, the magnetic strip is fixed, but the magnet joined to the gear stick shifts with the gear stick. The magnetic strip and the magnet on the gear stick are positioned in such a way that when the gear stick shifts into reverse, the magnet attached to the gear stick moves next to the magnetic strip, generating a magnetic field change (i.e. a property change). In other examples, the first part of the property generator71may be a reflective strip placed next to where the gear stick would be in the reverse position, and the second part of the property generator71may be a light source (or light emitter) connected to the gear stick. The light emitted by the light source is reflected by the reflective strip when the gear stick is positioned in reverse. The above are but examples of a property generator71and the skilled person will readily recognize that other means for generating a property change when the gear is shifted to a desired position may be used.

The sensor73is attached to the gear stick via the attachment device and detects a change in a given property, the change in property created by the property generator71when its first and second parts are placed in proximity as a result of the gear stick moving into reverse. For instance, the sensor73may be one for detecting the creation or change in a magnetic field, such as by detecting the variation in an output voltage (e.g. a Hall effect sensor). In this example, where the first part of the property generator71is a magnetic strip, and the second part of the property generator71is a magnet, the magnetic field sensor73detects the magnetic field created when the magnet, attached to the gear stick is moved next to magnetic strip. In another example, the sensor73is a light sensor (e.g. a photo sensor), and the first part of the property generator71is a reflective strip and the second part of the property generator71is a light source attached to the gear stick (via the attachment device). When the light source is moved with the gear stick in proximity with the reflective surface (the gear stick being in reverse), the light emitted by the light source is reflected off the reflective strip and detected by the light sensor73. When the gear stick is in another position than in reverse, the light is not reflected off the reflective strip and the light sensor73does not detect light (the property change). Once the sensor73picks up on the property change, indicative of the gear stick being put into reverse, the sensor73sends a signal to (or prompts) the wireless transmitter72. In response, the wireless transmitter72sends an activation signal via the wireless connection to the peripheral14, the peripheral14turning on its rear view camera28once it receives the wireless activation signal from the wireless transmitter72. In some examples, the wireless transmitter72may send a wireless signal to the smartphone12to turn on and open the camera APP21(e.g. keyboard commands to turn on the smartphone and run the camera APP21). In other examples, the smartphone12and the camera APP21are turned on by the peripheral14, receiving the keyboard commands or activation signal from the peripheral14, once the peripheral14has received the activation signal from the activation unit15.

It will be appreciated that the activation unit15may send out a signal to cause the peripheral14and/or smartphone12to turn on when the gear stick is shifted into another position than reverse (e.g. in “Drive”), such as when the peripheral's camera is to turn on when the vehicle is, for instance, put into “Drive” (the camera located as the front of the vehicle). Necessary adjustments are made to the positioning of the components of the activation unit15as a result, such as the location of the first part of the property generator71(e.g. placing the first part of the property generator71next to where the gear stick is positioned when in “Drive”).

The steps for the embodiment of the rear view camera video start sequence can be as follows. The user can approach the vehicle where peripheral14is paired with his or her phone12. The peripheral14detects phone12, making a classic Bluetooth connection, and MFi authentication is done. The phone12and peripheral14are now connected. The Bluetooth connection between them is maintained with minimum power consumption by maintaining only the Bluetooth component powered while the camera and video compression processor are off. The power requirements for maintaining this Bluetooth connection are so low that conventional batteries can power the unit14to remain wirelessly connected for years at a time. Pressing a button on activation unit15can cause it to turn on and connect to the peripheral14. Peripheral14responds to the signal from unit15to cause the camera28and video transmission30of peripheral14to turn on.

In some embodiments, peripheral14and activation unit15are paired at the factory. Interface16bcan be configured to be always advertising. Activation unit15is normally off. When a button is pushed on unit15, power is supplied from its battery and the Bluetooth connection is made. In peripheral14, when the interface16bis connected to the activation unit15, interface16bturns on the remainder of the components in peripheral14. Thus, codec30and camera28turn on. When the vehicle driver wants to use the rear view camera, the video button on unit15is pressed. Unit15can be powered by a small button battery, and so can be powered on by pressing its button. In some embodiments, this is the only button. The Bluetooth module16bof the rear view camera peripheral unit14detects the button pressed. The module16bnow powers up the peripheral components. In the case of a microprocessor that can be woken up by an interrupt, module16bissues the interrupt. As a result, the camera28is powered and video compression and transmission30are ready to be started. Video compression can be handled in the microprocessor, or it can be handled by a separate chip, for example a TW9900 chip with an OV780 chip.

The peripheral14, particularly in the case of a vehicle rear view camera accessory, can be vulnerable to theft. To reduce the ability for the peripheral14to be used by a thief, a master phone12is designated. The peripheral14can thereafter only be used by a smartphone12that is given permission by the master phone12. This can be done, in the example of an iPhone, by turning on Bluetooth in the setting of the iPhone12. In the example an Android phone, the app21can be started. The peripheral device14can be turned on using a switch on the peripheral14or by using unit15. On the iPhone, a Bluetooth pairing request will appear, and the user can complete the pair request. Using an Android device, the pairing can be completed by the app21. On the iPhone, the app21can then be started. Video can then appear on screen. In the app21, the user provides the input required for the commands to be stored in memory24. For example, the user provides the unlock code, and this code is send to peripheral14to be stored in memory24. The peripheral14is configured to recognize the Bluetooth ID (an equivalent of a MAC address unique to the device) of the phone being first paired and to refuse pairing with another smartphone12unless given permission from the first paired smartphone12. Peripheral14stored the Bluetooth ID of the first or master smartphone12in non-volatile memory, along with the ID's of all authorized smartphones12. If the master smartphone is lost, a number of factory set backup single-use master codes are also stored. The owner of the peripheral14can contact the manufacturer with the peripheral's serial number to retrieve a backup code that, when sent to the peripheral from app21, will cause the peripheral14to replace the previous master smartphone Bluetooth ID with the new one. The manufacturer can identify the registered owner of the peripheral by the serial number and/or the owner's identification. Once a one-time back up code is used, the used status is recorded in the nonvolatile memory and is no longer useable.

Stopping the Peripheral:

Stopping of the camera and app can be done either in response to a timer or in response to a subsequent user input, either from the unit15or on the smartphone app21. For example, the video can stop after a short period, such as 20 seconds, using a timer, or the video can be stopped when the button of unit15is pressed and video is being streamed. Peripheral14would shut down all components except for the module16b, so that the Bluetooth connection is maintained between the peripheral and the activation unit. The peripheral can also send a command to the app21that streaming will stop, so that the app can manage the end of streaming without an error. Alternatively, the app21can be used to send a stop signal to the peripheral14.

In some embodiments, app21may also be communicating with the GPS application of the smartphone12. App21may use the GPS data of the GPS application to detect the speed of the vehicle. Once the speed of the vehicle is detected by the GPS application as being, for instance, over a certain amount (i.e. indicating that the vehicle may no longer backing up), the GPS data, analyzed by app21, may cause app21to shut off, and may cause the smartphone12to send a wireless signal to the peripheral14to stop streaming.

For security reasons, the HID keyboard interface is started again at the peripheral14, and a lock key command is sent to lock the phone12. Then the HID keyboard interface is stopped and the peripheral14sleeps with the exception of its Bluetooth interface16b.

The steps involved in activating the peripheral14and the smartphone12to operate are illustrated inFIG. 6.

In the embodiment ofFIG. 7where the sleep mode is not managed by interface16b, the peripheral14can follow the above sequence for sending the commands to wake up the phone12and to cause the app21to open up, however, the commands and/or signals related to waking up and sleeping the peripheral14are not required.

The embodiment ofFIG. 7has the advantage over prior art systems that the smartphone12can be off and locked, and then the peripheral14can cause the smartphone12to be unlocked and to open up the app21associated with the rear view camera peripheral14without the user needing to manipulate the phone12.

InFIG. 9, the peripheral14can be woken up using the activation unit15directly using Bluetooth communication from interface16c, or it can be woken up by the app21a(through interface16a) that is called up by activation unit15in the manner described above. As illustrated, the keypad27can have four buttons (any number can be provided as desired), with buttons labeled for specific apps, such as the rear view camera, GPS navigator app, mail app, a “phone home” button that launches the telephone to call a specific number, etc. Configuration of the commands can be done in module22whether in a stand-alone app or as part of the peripheral app21a.

In the embodiment ofFIG. 10, a battery-powered rear view camera peripheral14with battery75is coupled with an activation unit15, while the peripheral14is coupled with a dedicated GPS navigator unit associated with the vehicle. As in embodiments above, the activation unit15can be coupled with the peripheral's Bluetooth interface16bto cause it to wake up (as illustrated) (or, in some examples, the activation unit15may use its RF transmitter to send a radio frequency activation signal to the RF module of the peripheral14), or it can be coupled with the interface16aof the display unit12′ which in turn will send the peripheral14a wake up command over interface16b. When a GPS unit is equipped with Bluetooth communications abilities16a, this embodiment requires additional software to provide the codec32, the view display and the mode switching between regular navigation mode and camera display mode, but no additional hardware to provide the rear view camera capability. The activation unit15ofFIG. 10may store a sequence of keyboard commands in memory24, where consumer control key transmission module26retrieves the sequence of keyboard commands and sends it to display unit12(when, e.g., display unit12is a iOS based smartphone). The sequence of keyboard commands may cause the display unit12to unlock and run the viewing application program21a.

Likewise, the embodiment ofFIG. 10could exclude the activator15as a separate component, and allow controller25through user input to cause interface16ato send a wake-up signal to interface16bof the peripheral14.

In the embodiment ofFIG. 11, the smartphone12is coupled with the peripheral14using interfaces16aand16b, without involving wireless keyboard commands to control the smartphone12to unlock and open up the app21. In this embodiment, the user unlocks the phone12and opens up the app21. The app21then sends the commands to the peripheral14that cause it to wake up and to begin sending video.

Frame of Peripheral:

FIG. 12shows a frame40of a peripheral14. The frame40has a surface for receiving a license plate46and includes holes42for mounting the plate46to the frame40using mounting bolts44. It will be appreciated that any suitable mounting mechanism, whether clips, bolts, transparent retainer cover, or the like can be used. In the embodiment ofFIG. 12, the camera28is mounted in a fixed position, namely in the top left corner using a mounting48. The camera28can be arranged to be located in a variable position or in a different fixed position. In the embodiment ofFIG. 12, the mounting48has a slot into which the plate46fits so that the camera28fits within the boundaries of the frame40of a standard license plate46. While the plate46shown has the dimensions of a North American license plate, it will be appreciated that the frame40can be adapted for the plate dimensions of any jurisdiction or vehicle type. Frame40can be relatively thin, and the embodiment ofFIG. 12is about 1 cm at the top and expands to about 2 cm at the bottom to have a trapezoidal shape and better accommodate the battery, however, different shapes of battery can fit within a rectangular frame as well.

The vehicle side of the frame40is shown inFIG. 13with the components removed for clarity. The frame40is upside down in the view, and the mounting holes42are at the bottom. The battery compartment50and the circuit board compartment52are shown, along with an inner side of the mounting48. Cut outs54near the mounting holes42are used for receiving a bracket56. While a frame40can be mounted to the vehicle using the vehicle's mounting nuts for receiving bolts44that are a bit longer than usual (by the added thickness of the frame40), Applicant has found that some vehicles have a plate mounting area that has obstructions, such as trunk handles, spare tires or lights, and an adjustment in height is useful. Furthermore, it is convenient, although optional, to use the vehicle's original mounting bolts to mount the frame to the vehicle and to use separate bolts to mount the plate to the frame40. Therefore, bracket56is an example of a mechanism that allows a vertical adjustment in position for frame40. The vehicle's original plate mounting bolts can be affixed through hole58with the nut57positioned either above or below for a higher or a lower position respectively. The bracket is then clamped to the vehicle and the nut57is ready to receive bolt44through hole42. Slots54prevents the brackets56from turning out of position should the bolts attached to the vehicle become loose. This arrangement has been found to avoid conflicts with the car body components in most cases.

As shown inFIG. 14, the peripheral14can comprise a camera28held by a bracket62that allows for an adjustment of the camera tilt. As illustrated, this can be provided by making screws63accessible from the vehicle side of the frame40where they can be loosened to allow the camera28to be adjusted, and then the screws63are tightened so that the camera28is fixed in its tilt position. The camera28is mounted in the mounting48with the circular side members rotatable in sleeves in the mounting48and the bracket62can have teeth engaging complementary teeth in the side members of the housing of the camera28to ensure there is no slippage of the camera in its mounting. Other suitable mechanisms to set the tilt angle are possible, and the example given is but one way of securely setting a tilt angle.

The camera28is connected to a circuit board64that contains the hardware and software components of the peripheral14, and is to be received in compartment52(FIG. 13) and sealed using cover65and gasket66. Protection against the weather and road contamination is important. A battery68is connected to the circuit board64for power, and is to be received in compartment50and sealed using cover69and gasket70. The battery68can provide a service life of about two years. A smaller rechargeable or replaceable battery can also be used.

While the embodiment ofFIG. 12is a frame40that essentially matches the dimensions of the license plate46with only the camera mount48overhanging the plate area, it can be desirable to have either an enlarged frame40with a border region along at least one side (for example the two vertical sides) to as to accommodate one or more photovoltaic strips that can be used to recharge the battery68using sunlight. Alternatively, solar panel strips can be arranged within the plate area thus covering a border region of the license plate46.

While reference is made herein to a rear-view camera system, it will be appreciated that a vehicle camera can be installed at the sides or front of a vehicle. For example, a school bus can use the license plate mount at the front of the bus to monitor an area at the front of the bus without modifying the camera housing. Triggering of the camera operation could be then done from other signal sources, such as the bus stop lights. For side mountings of a camera, a different housing would be used.

FIG. 15shows a view of a stick-on activation unit15that includes a single ON button27and a single OFF button27′. Unit15can be powered using a standard button battery (e.g. a Lithium CR2032 type battery) or alternatively, it can be powered from the vehicle (or any other external power) using wire port25. Unit15may include the Bluetooth transceiver chip or another wireless transmitter. For instance, activation unit15may have a radio frequency module for transmitting RF activation signals to the peripheral14. In the example where the unit15has a Bluetooth transceiver, the Bluetooth transceiver is paired with the peripheral14and maintains a low power connection at all times. When the button27of unit15is pressed, a signal is sent to the peripheral14that causes its Bluetooth component16bto cause the peripheral to wake up and to communicate with the smartphone12or the dedicated GPS unit (or any other main computing device)12′. When the activation signal is an RF signal, pressing the button27causes the RF module of unit15to send an RF activation signal to the peripheral14that is received by the RF module (e.g. RF receiver chip) of the peripheral14, causing the peripheral14to wake up. The unit15and the peripheral14can remain in this sleep mode with Bluetooth communication established for years without recharging or changing batteries. In the case of button27′, the signal sent to the peripheral indicates that the peripheral14is to shut down.

While in the embodiment described above, the peripheral is a rear view camera peripheral, it will be appreciated that other types of peripherals can make use of the features described herein (e.g. a front view camera).