Security camera having a body orientation sensor and method of use

A security camera includes a camera body and a body orientation sensor for detecting an orientation of the camera body. The security camera can include an orientation feedback system used with the body orientation sensor to adjust a position of the security camera to true camera. This orientation feedback system indicates degree to which the camera body is off horizontal/vertical. The security camera is part of a video security system that has an image processing unit for de-warping and/or rotating (e.g., 90 degrees) a raw image based on the orientation detected by the body orientation sensor.

BACKGROUND OF THE INVENTION

Video security systems are often deployed in and around buildings as well as in metropolitan settings. Example buildings and metropolitan settings include schools, government buildings, commercial buildings, residential buildings, and town and city centers.

These video security systems typically include security cameras that connect via a security network to a control system. Additional components include network video recorder (NVR) systems and monitors for displaying images such as video from the security cameras.

The security cameras typically have a lens and imager system that is fixed, adjustable, or motorized. A fixed security camera will have the lens and imager system permanently fixed in a set position (i.e., lens and imager system cannot change position with respect to camera body). On the other hand, an adjustable security camera's lens and imager system is movable with respect to camera body (e.g., installer can move the lens and imager system to different positions) so that it can be pointed down a hall or at a door, for example. A motorized security camera, such as a pan-tilt-zoom (PTZ) security camera, utilizes motor(s) to automatically move the lens and imager system to different positions usually under operator or automatic control.

An example of the fixed security camera is a fisheye security camera. The fisheye security camera uses an ultra-wide-angle fisheye lens to form an image on the imager chip.

The fisheye security camera is typically used in situations in which there is a need to capture a wide field of view in a single image. The fisheye security camera provides this wide field of view by utilizing the fisheye lens to provide, for example, between 180 degrees and 360 degrees of surveillance range. Due to the wide field of view, the raw image captured by the imager chip is distorted, however.

An example of the adjustable security camera is a dome security camera. The adjustable or dome security camera's lens and imager system includes a lens (e.g., normal lens, wide-angle lens, or long-focus lens) that forms an image on the imager chip. This lens and imager system is adjustable such that it can be positioned in different directions using a gimbal system. Often these gimbal systems enable movement along at least two axes (e.g., two-axis gimbal or three-axis gimbal). The two-axis gimbal provides movement along a roll axis and a tilt axis whereas the three-axis gimbal provides movement along the roll axis, tilt axis, and pan axis. The gimbal allows the adjustable lens and imager system to be moved manually during and after installation to change the fields of view. The adjustable or dome security camera is typically used in locations in which there is a need to capture images from a specific direction.

The installation process of a fixed security camera (e.g., fisheye security camera) for a video security system involves several steps. An installer mounts the fisheye security camera at a desired location that allows for the fisheye security camera to capture a wide area of interest. For example, the fish eye security camera is typically installed directly to a wall or ceiling of a room (i.e., wall mode orientation or ceiling mode orientation) such that the fish eye security camera is positioned to view an entire room. The camera should usually be leveled to ensure good image orientation. Then, the installer will usually program the video security system with the fixed security camera's orientation.

The installation process of the adjustable or dome security camera for the video security system is slightly different. After the adjustable or dome security camera is attached to the wall or ceiling, the lens and imager system is typically positioned to provide either a corridor orientation or landscape orientation with respect to the area of interest. Then, the installer will usually program the video security system with the adjustable or dome security camera's orientation.

In general, there is distortion processing software. Distortion processing software can be used to correct a distorted or warped image by de-warping the image. In particular, this distortion processing software uses image processing algorithms or models corresponding to the lens being used (e.g., fish eye lens) to correct the distorted image.

SUMMARY OF THE INVENTION

The present invention concerns including one or more orientation sensors in security cameras to automatically determine orientation information. The orientation information can be used to assist in the process or leveling or trueing cameras. Orientation information can also be used in the process of image correction for de-warping and/or rotating (e.g., 90 degrees) raw image data received from security cameras. This feature eliminates the step of manually inputting orientation information. This feature can also be utilized to accurately install a security camera to a wall or ceiling such that the security camera is level (i.e., positioned to true camera).

In general, according to one aspect, the invention features a security camera that includes a camera body and a body orientation sensor for detecting an orientation of the camera body.

In embodiments, the body orientation sensor is mounted to an external surface or an internal surface of the camera body.

Typically, the body orientation sensor is an accelerometer. In one case, the accelerometer is at least a two-axis or three-axis accelerometer.

In embodiments, the security camera further includes a lens and imager system for capturing a raw image. In one application, this raw image is de-warped and/or rotated (e.g., 90 degrees) based on the orientation detected by the body orientation sensor.

In one embodiment, the security camera further includes a lens orientation sensor for detecting an orientation of the adjustable lens and imager system of the camera.

In embodiments, the security camera includes an orientation feedback system for indicating degree to which the camera body is off horizontal/vertical based on the orientation detected by the body orientation sensor. The orientation feedback system generates light, sound, or web content for indicating degree to which the camera body is off horizontal/vertical. In one application, the detected orientation is a horizontal orientation. In another application, the detected orientation is a vertical orientation.

In general, according to another aspect, the invention features a method of operation of a video security system. This method includes a body orientation sensor detecting an orientation of a camera body and an image processing unit de-warping and/or rotating a raw image based on the orientation detected by the body orientation sensor.

In embodiments, the image processing unit is within a camera controller or a control system.

In one embodiment, the image processing unit de-warps and/or rotates the raw image based on the orientations detected by the body orientation sensor and the lens orientation sensor.

In general, according to still another aspect, the invention features an installation method for a security camera that includes a body orientation sensor detecting an orientation of the camera body after being mounted, a camera controller determining a degree to which the camera body is off horizontal/vertical orientation based on the detected orientation from the body orientation sensor, and an orientation feedback system indicating degree to which the camera body is off horizontal/vertical orientation.

In embodiments, the orientation feedback system is a light emitting diode (LED) that indicates the horizontal/vertical orientation by generating light, a speaker that indicates the horizontal/vertical orientation by generating sound, or an electronic interface that indicates the horizontal/vertical orientation be generating web content or other types of messages that are sent or served to a mobile computing device (smart phone or tablet computing device) operated by the installer.

In embodiments, the camera controller determines whether the camera body is in a vertical orientation or a horizontal orientation based on the detected orientation from the body orientation sensor.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

FIG. 1shows a fixed security camera100(e.g., fisheye security camera) which has been constructed according to the principles of the present invention.

The fixed security camera100includes a body orientation sensor104for detecting an orientation of the camera body102. In one example, the body orientation sensor104is mounted to an outer housing of the camera body102. In other examples, the body orientation sensor104is mounted internally such as on a circuit board within the camera body102. In another example, the body orientation sensor104is positioned within a wall of the camera body102.

The body orientation sensor104detects the orientation of the camera body102based on the angular relationship of the camera body102with respect to gravity. Typically such sensors are referred to as accelerometers. In particular, the body orientation sensor104can be a two-axis accelerometer or a three-axis accelerometer system.

FIG. 2illustrates an adjustable security camera200(e.g., dome security camera) according to another embodiment.

The lens and imager system108of the adjustable or dome security camera200can be repositioned in different directions using a gimbal206. In the illustrated example, the gimbal206provides movement along two axes (pan axis212and tilt axis214). In an alternative example, the gimbal206is a three-axis gimbal that provides movement along the pan axis212, tilt axis214, and roll axis.

The example two-axis gimbal206includes pan joints208and a circular tilt boom210. The lens and imager system108is attached to the tilt boom210such that the lens and imager system108can tilt along the tilt direction214. The pan joints208are attached on two ends of the tilt boom210to aid in providing the tilting movement214. The pan joints208are positioned within the camera body102to provide panning along the pan direction212independent from the tilting movement214. For example, the pan joints208are positioned in a pan track of an inner surface of the camera body102such that the pan joints208can rotate along this pan track in the camera body102. Thus, the gimbal206uses the pan joints208and tilt boom210to provide panning and tilting movements212,214.

The lens and imager system108is mounted to this gimbal206which can be positioned to move in a variety of directions along the pan and tilt axes212,214. In one example, this two-axis gimbal206provides about 360 degrees of panning movement212and about 90 degrees of tilting movement214.

The adjustable or dome security camera200includes two orientation sensors: body orientation sensor104and lens orientation sensor204, in the illustrated embodiment. These sensors together provide for the ability to track the camera body's orientation independently from the lens and imager system's orientation.

Similar to the fixed security camera100, the body orientation sensor104is mounted to a portion of the camera body102of the adjustable or dome security camera200. For example, the body orientation sensor104is mounted to an outside surface, inside surface, or within the camera body102.

The lens orientation sensor204detects an orientation of the lens and imager system108. The lens orientation sensor204is attached to a portion of the lens and imager system108. For example, as shown inFIG. 2, the lens orientation sensor204is mounted to an external surface of the lens tube216. Alternatively, the lens orientation sensor204is mounted to a circuit board in the lens and imager system108or even made part of the imager chip. Similar to the body orientation sensor104, the lens orientation sensor can be a two-axis accelerometer or three-axis accelerometer.

The adjustable or dome security camera200includes a dome cover202mounted over the lens and imager system108. In particular, the dome cover202is attached to a perimeter of the camera body102providing a housing that protects the lens and imager system108from external elements.

As shown inFIGS. 1-2, the fixed security camera100and adjustable or dome security200include an orientation feedback system (e.g., light or speaker)106that indicates to an installer whether the camera body102is level or not level. In one example, the orientation feedback system106is a speaker (i.e., provides sound feedback). In another example, the orientation feedback system106is a light such as a light-emitting diode (LED) (i.e., provides light feedback).

FIG. 3illustrates an exemplary room or hallway300with installed fixed security cameras100(e.g., fisheye security cameras) and adjustable or dome security cameras200. The security cameras100,200are installed in different orientations for monitoring the room or hallway300and individuals306in the room or hallway300. The security cameras100,200are mounted to the ceiling302or to the wall304.

The fixed security cameras100, such as fisheye security cameras, are installed directly to the wall304or ceiling302of the room or hallway300(i.e., wall mode orientation or ceiling mode orientation) to capture a wide area of interest.

The adjustable or dome security cameras200are attached to the ceiling302or wall304and then aimed at a particular area of interest, usually by the installer. In one installation, the adjustable or dome security camera200is mounted to the wall304by a wall bracket308. The wall bracket308effectively moves the field of view for the adjustable or dome security camera200beyond objects in the room or hallway300that would otherwise obstruct the field of view of the adjustable or dome security camera200. In another installation, the adjustable or dome security camera200is mounted directly to the ceiling302. After the adjustable or dome security camera200is mounted to the wall304or ceiling302, the lens and imager system108is positioned using the gimbal206to provide either a corridor view (i.e., corridor mode) or landscape view (i.e., landscape mode) with respect to the room or hallway300.

FIGS. 4A-4Cillustrate the main components of the security cameras100,200according to embodiments.FIG. 4Aillustrates an example fixed security camera100andFIG. 4Billustrates an example adjustable or dome security camera200.

The security cameras100,200include a camera controller406. The camera controller406manages and directs various security camera features such as use of the lens and imager system108. Also, the camera controller406directs output of data including image data to the security network402through an interface404. The camera controller406can also manage power distribution through this interface404as well. The camera controller406directs actions by certain components based on orientation information received from the body orientation sensor104. In one example, the camera controller406drives the orientation feedback system106based on orientation information received from the body orientation sensor104.

The security cameras100,200include the lens and imager system108which generates raw images of a field of interest. The lens and imager system108includes an imager chip and a lens train. The lens train (e.g., fisheye lens or normal lens) forms images of a field of view onto the imager chip. The images on the imager chip are directed by the lens and imager system108to the camera controller406.

Depending on the type of lens train and/or orientation of the camera, the raw images on the imager chip may need correction (e.g., de-warped and/or rotated). For example, a fisheye lens produces raw images that are typically distorted or warped. Also, images may be upside down or rotated by 90 degrees depending on the installed orientation of the camera (e.g., camera positioned upside down).

An image processing unit604de-warps and/or rotates raw images to produce corrected images based on detected orientation information, in one implementation. This image processing unit604is within the camera controller406, in one example. Alternatively, the camera controller406directs the unprocessed raw image data to an image processing unit605independent from the security camera100,200, such as in a control system. For the fixed security camera100, the detected orientation information is received from the body orientation sensor104. For the adjustable or dome security camera200, the detected orientation information is received from the body orientation sensor104as well as the lens orientation sensor204.

As shown inFIG. 4Band described above, the adjustable or dome security camera200additionally includes the gimbal206and the lens orientation sensor204. The gimbal206provides for movement of the lens and imager system108while the lens orientation sensor204detects the orientation of the lens and imager system108separate from the orientation of the camera body102. The lens orientation sensor204is in communication with the camera controller406to provide the detected orientation for the lens and imager system108.

FIG. 4Cillustrates an example where the orientation feedback system (web server)106provides feedback or information as electronic (web) content according to another embodiment.

Here, the orientation feedback system (web server)106provides web content on a website accessed by a mobile computing device618of an installer614. The web content can be in the form of messages using words, colors, sounds, etc. as appreciated by one of skill in the art. In general, the orientation feedback system (web server)106provides messages that indicate that the camera body102is level or not level and/or the angle of the body102and/or the degree to which the body is out of level.

As illustrated, the fixed security camera100includes a web server or application server process106executed by the camera controller200. The camera controller406utilizes this orientation feedback system (web server)106to provide feedback in the form of web content on the Internet616and router620, for example. The installer614can use the mobile device618to access this data on either a webpage or mobile application.

Similar toFIG. 4C, in another example, this orientation feedback system (web server)106is included in the camera controller406of the adjustable or dome security camera200to provide feedback as web content from the adjustable or dome security camera200.

FIG. 5illustrates the process of adjusting the position of the security camera100,200to true camera based on the orientation feedback system106. This process utilizes the orientation feedback system106for communicating to an installer614, as shown inFIGS. 4C and 6, that the camera body102is level or a degree to which the camera body102is not level. This degree (e.g., how far off horizontal/vertical) is based on the detected orientation of the camera body102which drives the orientation feedback system106accordingly.

In one example, the truing process includes the following steps.

In step504, an installer614, mounts a camera body102to a location. For example, the camera body102is mounted to the ceiling302or wall304.

A spirit level routine is then invoked on the camera controller406at step506.

In step508, the body orientation sensor104detects an orientation of the camera body102. The camera controller406determines whether the camera body102is in a vertical orientation (i.e., wall-mounted orientation) or horizontal orientation (i.e., ceiling mounted orientation) based on the body orientation sensor104(step510). For example, if the angle between the plane of the base and vertical is less than 45 degrees, the controller406concludes that the camera body102is intended to be installed in a vertical orientation, and if the angle between the plane of the base and vertical is greater than 45 degrees, the controller406concludes that the camera body102is intended to be installed in a horizontal orientation In step512, the camera controller406determines degree to which the camera body102is off horizontal/vertical based on the detected orientation from the body orientation sensor104.

At step514, the controller406determines if the camera body102is level. If the camera body102is level, then the orientation feedback system106provides indication to the installer614that the camera body102is level (step516) (e.g., using light from an LED, sound from a speaker, or web content from a web server). For example, this indication can be a continuous light from the LED, a constant tone played by the speaker, or displaying “Level” as web content. If the camera is not level, the camera controller406drives the orientation feedback system106to provide feedback corresponding with a degree to which the camera body102is not level (i.e., off horizontal/vertical) (step518). For example, this feedback can be indicated by blinking the LED, multiple sounds (e.g., beeps) from the speaker, or displaying a position on a scale between “Level” and “Not Level” corresponding with how off horizontal/vertical. For example, slow flashing of the light means the camera body102is more off horizontal/vertical and a fast flashing of the light means the camera body102is less off horizontal/vertical. With sound, for example, a long tone is more off horizontal/vertical and short tone is less off horizontal/vertical. For the web content, the position on the scale between “Level” and “Not Level” relates to the camera body102as more or less off horizontal/vertical. In step520, installer614adjusts the position of the camera body102to true camera based on this indication from the orientation feedback system106.

FIG. 6illustrates a video security system600with security cameras100,200installed and connected on the security network402. The security network402provides the security cameras100,200with access to a control system602. The security network402is typically a public data network (e.g., the Internet), a private data network (e.g., local area network), and/or combination of those networks.

In general, the control system602manages, directs, and responds to information received from security cameras100,200via the security network402. For example, the control system602can direct images received from security cameras100,200via the security network402to be displayed and/or recorded to the NVR610. In another example, the control system602can be used to provide feedback and correct raw images based on information received from the security cameras100,200.

In the illustrated example ofFIG. 6, the control system602includes the orientation feedback system (web server)106. The control system602drives this orientation feedback system (web server)106based on orientation information from the camera controllers406in the embodiment where the cameras do not provide this information directly. As described above, the orientation feedback system (web server)106provides feedback or indication information as web content (e.g., on a website or mobile application) on the Internet616. The installer614can use the mobile device618to access this web content from the orientation feedback system (web server)106of the control system602for the camera that they are currently installing.

In the illustrated example, the control system602includes an image processing unit605in some embodiments. As described above, the image processing unit605de-warps and/or rotates raw images based on orientation information to produce corrected images. In some embodiments, the camera controller406directs the orientation information from the orientation sensors104,204to the control system602to be used by the image processing unit605to correct the raw images from the cameras rather than the cameras themselves correcting the images.

The control system602directs corrected images from the image processing unit604(e.g., on control system602or on camera controller406) for display and/or to be recorded. For example, the control system602forwards the corrected images to a monitor606that displays the corrected images for viewing by a user608. The control system602also typically forwards the corrected images to be recorded, at predefined intervals for example, on the NVR system610. In one particular example, the NVR system610can record the corrected images as well as add time and date information to allow the recorded images to be indexed and reviewed in the future.

FIG. 7Ais a flow chart illustrating the process of de-warping and/or rotating raw images based on detected orientation for a fixed security camera100according to another embodiment.

Initially, in step704, installer614installs the fixed security camera100(e.g., fisheye security camera) in a desired location. After installing the fixed security camera100, the body orientation sensor104detects the orientation of the camera body102(step706). In step708, the camera controller406or control system602determines whether the fixed security camera100is in a vertical orientation (i.e., wall-mounted orientation) or a horizontal orientation (i.e., ceiling mounted orientation) based on detected orientation of the camera body102. The lens and imager system108generates a raw image at step710. In step712, the image processing unit604or605de-warps and/or rotates (e.g., 90 degrees) raw image based on the determined orientation (wall-mounted or ceiling mounted). For example, the image processing unit604,605selects either a wall-mounted image processing algorithm or a ceiling mounted image processing algorithm which is used in de-warping and/or rotating the raw image. Step712generates a corrected image based on the application of either the wall-mounted image processing algorithm or ceiling mounted image processing algorithm. In step714, the image processing unit604or605sends the corrected image to the monitor606and/or NVR system610(i.e., display and/or record). After step714, this process repeats itself at step710for future images.

FIG. 7Bis a flow chart illustrating the process of de-warping and/or rotating raw images based on detected orientation for an adjustable or dome security camera200according to another embodiment.

Initially, in step720, installer614installs the adjustable or dome security camera200in a desired location. After installing the adjustable or dome security camera200, the body orientation sensor104detects orientation of the camera body102(step722). In step724, the lens orientation sensor204detects orientation of the lens and imager system108. The camera controller406or control system602determines whether the adjustable security camera200is in a horizontal orientation (i.e., corridor orientation) or a vertical orientation (i.e., normal orientation) based on the detected orientations from the body orientation sensor104and lens orientation sensor204(step726). For example, the camera controller406mathematically (e.g., using geometry) determines whether the lens and imager system108is directed horizontally (corridor orientation thus corridor mode) or vertically (normal orientation thus normal mode) based on the orientation information received from the orientation sensors104,204. In step728, the lens and imager system108generates a raw image. Then, after the raw image is generated, the image processing unit604or605de-warps and/or rotates the raw image based on this determined mode (corridor or normal) (step730). For example, the image processing unit604or605selects either a corridor image processing algorithm or a normal image processing algorithm which is used in de-warping and/or rotating (e.g., 90 degrees) the raw image. Step730generates a corrected image based on the application of either the corridor image processing algorithm or normal image processing algorithm. The image processing unit604605sends the corrected image to be viewed on the monitor606and/or recorded by the NVR system610at step714.

Before repeating this process for future images, the camera system determines if the position of the lens and imager system108has been adjusted at step734. In one example, this can be determined by manual input from a user608or installer614. In another example, the camera controller406or control system602can track if there has been any change in the detected orientation of the lens and imager system108by the lens orientation sensor204. If the lens and imager system108has not been adjusted (i.e., no change in orientation), then this process is repeated at step728based on the previously determined orientation. If the lens and imager system108has been adjusted (i.e., change in orientation), then this process repeats at step722for updating orientation of the lens and imager system108.