Patent Description:
In assisting those with low vision or impaired eyesight to view an object or read text, it can be useful to employ magnification and/or image enhancement. This can be done through different types of devices ranging from a simple hand-held magnifying glass to a machine which employs a camera for capturing the object and a screen for displaying an electronic representation of the object. The electronic representation can show the image magnified, with better contrast, different colors, inverted text and/or different brightness.

Generally, in the type of machine which displays an electronic representation of the object, the object is placed on a support, in front of the camera. The object is then manually moved with respect to the support and the camera so that the camera captures different parts of the object, and the screen subsequently displays the part being captured. The magnification level can typically be changed, resulting in less of the object being displayed on the screen when a large amount of magnification is desired. When a large amount of magnification is required, the object has to be moved around a lot in relation to the support and the camera in order to view the whole object. Some prior art viewing devices are configured such that the device moves and not the object that is being viewed. This can be through wheels, slides or other means to view all parts of the object.

<CIT> discloses an apparatus to capture and display an image of an object comprising a frame, at least one optical sensor for capturing the image of the object, means for moving the frame relative to a surface of the object in a first direction, and means for moving the optical sensor relative to the frame in a second direction.

<CIT> discloses a magnifier that is adapted to rest upon a table when in use. The magnifier is articulated to permit the associated camera to be pointed at objects anywhere around the magnifier. The articulation also permits the camera to focus upon, and enlarge, nearby and distant objects. The magnifier is supported by way of two support legs. The legs can be pivoted between a first position to support the magnifier upon a table and a second position wherein the legs are locked adjacent the magnifier housing.

<CIT> discloses an image magnifying device for a low vision device capable of being used by a user more conveniently by performing image processing according to detailed settings on an image taken with respect to an imaging object. In an embodiment the image magnifying device includes a display for displaying an image, a camera unit for photographing an object, a camera support unit for supporting the camera unit and coupled with a swing arm.

According to a first aspect of the invention, an apparatus comprises a frame, a screen supported by the frame for displaying an image; a first optical sensor for capturing an image, an extendable arm connected to the frame; and a second optical sensor connected to the arm for capturing an image. Such an apparatus can allow for viewing and/or magnification of objects at different locations and distances from the apparatus. The extendable arm allows for capturing an object from the second optical sensor on the extended arm, allowing for the capture of a larger image space and for capturing at locations not directly in front of or behind the apparatus. This could allow for capture to the side of apparatus, promoting the capture of writing and/or capture of an entire standard size paper, for example, for use with optical character recognition.

According to an embodiment, the apparatus further comprises a third optical sensor connected to the apparatus, wherein the first optical sensor is configured for capturing an image near to the apparatus and the third optical sensor is configured for capturing an image at a distance from the apparatus. This can enable specific lenses to be used according to the range of each optical sensor, thereby providing a better capture and therefore better picture for display on the screen.

According to an embodiment, the arm is rotatably connected to the frame. Rotatable connection can allow for easy extension and placement of the second optical sensor above and/or to the side of the screen.

According to an embodiment, the arm is extendable to a use position such that the second optical sensor is positioned to capture an image to a side of the frame. This can be useful for capturing a user writing or for capturing something that is not flat, such as a large book.

According to the invention, the extendable arm can secure generally within the confines of the frame when not extended. The frame has a slot and the extendable arm rests in the slot when not extended. This allows apparatus to compress into a compact size for transport or storage.

Furthermore, according to the invention the first optical sensor is connected to a back surface of the screen or to a part of the frame positioned behind the screen. This can allow for capture of an image directly in line with the back of apparatus.

According to an embodiment, the apparatus is configured to be collapsible into a compact package. Optionally, the compact package comprises the frame collapsing to lie adjacent to the screen and/or a part of the frame. Further optionally, the compact package is substantially rectangular cuboid. Being able to collapse into a compact package ensures that the apparatus is able to be easily transported or stored without the need for a lot of space and with a reduced chance of damage while in transit or storage. This enables a user to take the apparatus to anywhere needed, making many more places and situations accessible for low vision persons.

According to an embodiment, the extendable arm extends with a slide.

According to an embodiment, the extendable arm is a length substantially equal to the length of the frame. Such a length would allow for the second optical sensor to be able to extend to a position quite a distance from the frame, and still allow for collapsing into a compact package for transport or storage.

According to an embodiment, the apparatus further comprises one or more speakers. These can be used for a number of functions, for example, to give audio feedback to a user.

According to an embodiment, the frame comprises a skid on each side of the frame extendable in front of the frame for supporting the frame on a surface such that the first optical sensor is positioned to display images of the surface between the two skids. This allows for easy capture and display of information by the first optical sensor.

According to a further aspect of the invention, a method of manufacturing an apparatus for displaying information on a screen comprises connecting a screen to a frame such that the screen can be supported by the frame with respect to a surface; connecting a first optical sensor to the apparatus such that it can capture information to display on the screen; and connecting an extendable arm to the frame such that a first end can extend above and/or to the side of the frame, the first end comprising a second optical sensor. Such a method of manufacturing results in an apparatus that is able to capture and display images at a variety of different locations and/or distances from the apparatus in one compact device.

According to an embodiment, the step of connecting an extendable arm to the frame such that a first end can extend above and/or to the side of the frame comprises rotatably connecting a second end of an extendable arm to the frame such that a first end can extend above and/or to the side of the frame.

According to an embodiment, the method further comprises connecting the screen to the frame and connecting the extendable arm to the frame such that each can fold into a compact package.

According to an embodiment, the method further comprises connecting a third optical sensor to the apparatus. Having a variety of optical sensors allows for use of a variety of different sensors to capture images according to the distance from the apparatus.

According to a further aspect of the invention, an apparatus for capturing and displaying information on a screen comprises a collapsible frame for supporting the screen in a working position; an extendable arm connected to the frame and which can extend away from the frame; and an optical sensor connected to the extendable arm. Such an apparatus allows for a versatile device that can be used for capturing and displaying information from a variety of locations and distances. A screen could be provided with the apparatus, or a tablet or other device with a screen could be connected to the frame for use.

According to an embodiment, the extendable arm rotatably connects to the frame on a second end and the optical sensor connects to the extendable arm on a first end.

According to an embodiment, the apparatus further comprises one or more further optical sensors connected to the apparatus for capturing information.

<FIG> shows a perspective back view of apparatus <NUM> for viewing an object with an extended arm <NUM>, <FIG> shows the front side perspective view and <FIG> shows a front view of apparatus <NUM>. Apparatus <NUM> includes front side <NUM> and back side <NUM>, frame <NUM> with skids <NUM>, screen <NUM>, arm <NUM>, first optical sensor <NUM> with viewing area <NUM>, second optical sensor <NUM> with viewing area <NUM>, third optical sensor <NUM> and control buttons <NUM>. Arm <NUM> includes first end <NUM> and second end <NUM>. Frame <NUM> includes slot <NUM> for securing arm <NUM> to frame <NUM>.

Screen <NUM> can be integral to frame <NUM> or can be detachable from frame <NUM>. In some embodiments, screen <NUM> can be integral with a tablet computer and/or be a touch screen. Screen <NUM> is large enough to display objects with a large amount of magnification, but small enough to be easily transportable, for example, seven inches (<NUM>) to seventeen inches (<NUM>). Apparatus <NUM> can include a cover or protection case (not shown), which can protect screen <NUM> when not in use.

First optical sensor <NUM> can be a camera connected to a back side <NUM> of apparatus <NUM>, either to frame <NUM> or a back side of screen <NUM>. In some embodiments, first optical sensor <NUM> could be connected to a plate or other attachment which is connected to frame <NUM> and/or screen <NUM>. Optical sensor <NUM> could also be moveable and/or rotatable, though it is generally directed at the surface on which apparatus <NUM> rests to capture an object on that surface. As shown by viewing area <NUM>, first optical sensor <NUM> captures the surface between skids <NUM>, allowing easy viewing of anything put on that surface.

Second optical sensor <NUM> is connected to a first end <NUM> of extendable arm <NUM>, though in other embodiments it may be at a different position of arm <NUM> or moveable along arm <NUM>. Second optical sensor <NUM> can be a camera that is generally configured to be positioned to capture objects on the surface on which apparatus <NUM> rests. This could include to a side of apparatus <NUM> and/or from a greater distance than first optical sensor <NUM>, perhaps enable the capture of an entire object, e.g., a standard A4 sheet.

Third optical sensor <NUM> can also take the form of a camera, and could also be connected to frame <NUM> and/or screen <NUM>. Third optical sensor <NUM> can be for viewing objects at a distance. To enable this, third optical sensor <NUM> could be rotatable or movable in another manner such that it can be directed toward the object desired. The object at a distance could be, for example, a monitor, a blackboard or a whiteboard. Third optical sensor <NUM>, could be especially useful for performing hobbies which could take place in front of apparatus <NUM>.

Arm <NUM> is extendable from frame <NUM>. In the embodiment shown, second end <NUM> of arm <NUM> is rotatably connected to frame <NUM>, such that first end <NUM> can rotate to be located above and/or to the side of apparatus <NUM>. In other embodiments, arm <NUM> could be connected to frame <NUM> and extendable in a different manner, for example, slidable. Arm <NUM> is of a length that is substantially equal to the length of frame <NUM>, and can be secured to frame <NUM> through slot <NUM> when not in use.

Frame <NUM> includes skids <NUM>, which extend in front of frame <NUM> for supporting frame <NUM> on a surface when apparatus <NUM> is in use. Skids <NUM> can fold in to a collapsed position, for example, by rotating when apparatus <NUM> is not in use (see <FIG>). Skids <NUM> can have a low-friction surface, for example, Polyoxymethylene ("POM"), and can have curved ends for easier sliding movement around and/or over a surface or an object to be viewed on screen <NUM>.

Controller buttons <NUM> could take a number of different forms and be located at different places on apparatus <NUM>. Control buttons <NUM> are typically large, easy to use buttons or switches which can perform various functions, such as turning apparatus <NUM> on or off, adjusting the screen <NUM> display and/or adjusting placement of optical sensors <NUM>, <NUM>, <NUM>. In other embodiments, control buttons <NUM> could be other types of controllers, including but not limited to a slide, switch, knob or other device for controlling the apparatus <NUM>, screen <NUM>, and/or optical sensors <NUM>, <NUM>, <NUM>. In some embodiments, for example when screen <NUM> is a touch screen, apparatus <NUM> may have minimal or no other control buttons <NUM>.

Screen <NUM>, optical sensors <NUM>, <NUM>, <NUM> and/or other components of apparatus <NUM> can be powered by batteries, for example located within frame <NUM> or screen <NUM>, by a photovoltaic panel, by a plug-in power connection or by other means.

Apparatus <NUM> is a versatile device that can be used to capture and display objects using a number of optical sensors <NUM>, <NUM>, <NUM> and devices for properly orienting and positioning the sensors <NUM>, <NUM>, <NUM>. First optical sensor <NUM> can be used for viewing an object directly in front of apparatus on a surface in viewing area <NUM>. This can be used for magnifying and/or reading a documents, for example, a letter or a book. Skids <NUM> allow for easy placement of the object to be viewed by first optical sensor, and easy alignment and positioning of the object with respect to apparatus <NUM>. Further, skids <NUM> allow for easy movement of apparatus <NUM> over an object viewed if needed. Third optical sensor <NUM> can be used for viewing something at a distance. Third optical sensor <NUM> includes a lens for distance viewing, and therefore ensures optimal capturing of the object which is desired to be projected on screen <NUM>.

Second optical sensor <NUM> can be used by extending arm <NUM> to a position above and/or to the side of screen <NUM>, such that it can capture viewing area <NUM>. By positioning second optical sensor <NUM> above and/or to a side of screen <NUM>, second optical sensor <NUM> is able to capture an image that first and third optical sensors <NUM>, <NUM> could not reach. This could be used, for example, to position second optical sensor <NUM> such that the viewing area <NUM> could capture a standard size paper, for example A4. This could be used in combination with optical character recognition ("OCR"), and in some instances, apparatus <NUM> could then display the object on screen <NUM> and/or read the text which has been captured by second optical sensor <NUM> and gone through OCR. Second optical sensor <NUM> would have an appropriate lens to capture images on the surface from the distance from which arm <NUM> extends. In some embodiments, optical sensor <NUM> could be moveable along arm <NUM>. Second optical sensor <NUM> could also be used for capturing a person writing or drawing to the side of apparatus <NUM>, and then displaying on screen <NUM>.

By having first, second and third optical sensors <NUM>, <NUM>, <NUM>; apparatus <NUM> is able to be used to capture a variety of different objects at different locations and display a clear image on screen <NUM>. A user is able to use apparatus <NUM> for viewing objects near, far and even for viewing one's own writing without needing to switch between devices. By including arm <NUM> with optical sensor <NUM>, apparatus can easily be used for capturing pages for OCR or capturing images which are not directly in front of apparatus <NUM>.

<FIG> shows a perspective view of the apparatus <NUM> with arm <NUM> not extended, <FIG> shows a side view of the apparatus <NUM> of <FIG> from a first side, and <FIG> shows a second side view.

In <FIG>, arm <NUM> of apparatus <NUM> is not extended and rests in slot <NUM> to sit at least generally within the confines of frame <NUM>. Arm <NUM> can be secured in such a position, for example, by snapping into place or being held by a securing device, such as a magnetic lock. In some embodiments, arm <NUM> could have a handle for easy movement to and from an extended position.

By allowing arm <NUM> to move from an extended position and be secured to frame <NUM>, apparatus <NUM> can be used as a compact apparatus with arm <NUM> in a stored position when second optical sensor <NUM> is not needed.

<FIG> shows a front view of the apparatus of <FIG> in a collapsed state. <FIG> shows a side view of <FIG>.

Apparatus <NUM> is able to be put into a compact package by collapsing frame <NUM> and putting arm <NUM> in a non-extended position. When fully collapsed, apparatus <NUM> is generally rectangular cuboid. Frame <NUM> is collapsed by rotating skids <NUM> to lie against the back side of apparatus <NUM>, generally against another part of frame <NUM> or a back side of screen <NUM> depending on the specific configuration of apparatus <NUM>.

By being able to collapse into a compact package, apparatus <NUM> is able to be easily stored and transported elsewhere when not in use.

By forming apparatus <NUM> with a plurality of optical sensors <NUM>, <NUM>, <NUM> and in a manner that it can be collapsed into a compact package, apparatus <NUM> is a versatile apparatus <NUM> for capturing and displaying a variety of different objects and can be easily taken to where it is needed. As apparatus <NUM> is generally used for helping persons with low vision, the ability of apparatus <NUM> to be transported and easily set up for use elsewhere ensures that low vision persons are able to capture and magnify images wherever they are and not only at home. Extendable arm <NUM> ensures that the compact size of apparatus <NUM> does not limit the ability to capture larger areas, as arm <NUM> can position second optical sensor <NUM> at a further distance from a surface for capturing larger area <NUM>, which could be the size of a page or a newspaper, for example. This can also enable the use of apparatus <NUM> with OCR functions and/or capturing things that may not be easily captured by optical sensors only directed in front of apparatus <NUM>, such as three dimensional objects or the handwriting of a user as they are writing.

As discussed in the background section, past systems that had larger display screens typically included a support on which the object is placed. Devices that were designed to be more compact could not capture a very large area due to the placement of the optical sensor on the frame. Thus, the past devices typically either required a large amount of space and were not truly transportable due to weight and size; or if they were transportable they were limited in what they could capture and display due to the compact size. Apparatus <NUM> overcomes these problems by having a fully collapsible, compact design; a plurality of optical sensors <NUM>, <NUM>, <NUM> for capturing different locations; and an extendable arm <NUM> for positioning an optical sensor <NUM> at a position to have a larger capture area <NUM> than if fixed to frame <NUM>.

Apparatus <NUM> could also include light sources, for example, light emitting diodes ("LEDs"), that can be directed toward the same surface which one of optical sensors is directed toward. Different numbers and/or arrangements of light sources could be used.

While apparatus <NUM> has been shown to have three optical sensors <NUM>, <NUM>, <NUM>; apparatus could have fewer optical sensors or more optical sensors depending on desired uses of apparatus <NUM>.

Claim 1:
Apparatus (<NUM>) comprising:
a frame (<NUM>) having a slot (<NUM>) ;
a screen (<NUM>) supported by the frame for displaying an image;
a first optical sensor (<NUM>) connected to part of the frame positioned behind the screen or to a back surface of the screen (<NUM>) for capturing an image;
an extendable arm (<NUM>) connected to the frame (<NUM>); and
a second optical sensor (<NUM>) connected to the arm (<NUM>) for capturing an image,
wherein the extendable arm (<NUM>) can rest in the slot (<NUM>) when not extended and can sit and secure generally within the confines of the frame (<NUM>) when not extended.