Head worn wireless computer having high-resolution display suitable for use as a mobile internet device

A handheld wireless display device, having at least SVGA-type resolution, includes a wireless interface, such as Bluetooth™, WiFi™, Wimax™, cellular or satellite, to allow the device to utilize a number of different hosts, such as a cell phone, personal computer, media player. The display may be monocular or binocular. Input mechanisms, such as switches, scroll wheels, touch pads, allow selection and navigation of menus, playing media files, setting volume and screen brightness contrast, activating host remote controls or performing other commands. The device may include MIM diodes, Hall effect sensors, or other position transducers and/or accelerometers to detect lateral movements along and rotational gestures around the X, Y and Z axes as gesture inputs and movement queues. These commands may change pages, scroll up, down or across an enlarged screen image, such as for web browsing. An embedded software driver permits replicating a high-resolution screen display from a host PC.

BACKGROUND OF THE INVENTION

Recent technology convergence between mobile phones and digital media players, such as with the iPhone™, are increasingly placing small, portable devices capable of storing large amounts of high-resolution computer graphics and even video content in the hands of consumers. While these handheld devices typically include a display screen, the visual experience of a high-resolution, large format display can never be replicated in such a device, simply because of the physical size limitations expected of a hand held device.

As a result, consumers are now seeking high-quality, portable, color displays to augment their handheld video devices. One such display is worn on the user's face or head similar to a pair of eyeglasses or headphones. Through recent dramatic developments in optical technologies, these devices can provide the appearance of a large format, high-resolution display.

One example of such a device is found in U.S. Pat. No. 7,088,234 issued to Naito, et al. and assigned to Matsushita Electrical Industries. The wearable information device described in that patent can display certain information to notify the user, e.g., information about arrival of an e-mail, etc.

Another such device is described in U.S. Pat. No. 7,158,096 issued to Spitzer and assigned to MyVu Corporation. That device includes a projection type display attached to one end of a head-mountable support. An eyepiece assembly is attached to a second end of the support. The support maintains the projection system and the eyepiece assembly in alignment along an optical path.

Unfortunately while such head-mounted displays have found some use they do not provide the best viewing experience in all situations. For example, a number of decisions must be made by the designer of such a device with respect to their mechanical packaging and styling. That is, these head-mounted display arrangements invariable require some sort of apparatus to permit the user to mount the device on their head, and then find an optimal position for the display relative to the user's eye. The inherent constraints of such a device thus do not provide optimal viewing comfort for all users.

Secondly, such prior art head worn displays are limiting in the overall functions that can be performed. Such tasks can include viewing images, graphics, or movies with audio. This can be for gaming purposes or recreational viewing of images from a television broadcast or video. Such prior art head worn displays are severely limited in connection with other day-to-day desired functional computing tasks. For example, the user may desire to use the display in connection with communication tasks, web browsing, running business applications, active navigation tasks, mobile instruction with real time updates or using the display to wirelessly control other devices that the user regularly uses (or comes in contact with) on a day-to-day basis. These secondary devices can include a Personal Digital Assistant (PDA), a notebook computer, a desktop computer, a mobile phone, a vehicle, a wireless network, devices associated with a wireless service hot spot, a thin client, or other electronic devices or appliances. Such prior art head worn displays often cannot interface with (or slave) such devices to initiate and control running programs, initiate real time device functional changes, alter real time device operational parameters, enable local or remote wireless communication with mobile devices and/or otherwise perform wireless networks and services.

Thirdly, such prior art devices are not readily upgradeable to provide other functions that the user may desire. A user may desire, in some locations, to have some functional attributes of a particular software application or a particular hardware configuration, while in other locations the user may not desire to have those software applications or hardware configurations. In fact, the user may not use such a heavy display device with multiple heavy hardware configurations, and additional connections and drives and instead may wish to remove unnecessary hardware from the device so the device remains lightweight.

Fourth, users would enjoy more compact mobile devices that can access important data that are lightweight, and do not require users to carry relatively larger, and bulkier computers, such as notebook computers, laptops, tablet computing devices, or relatively larger media players. Additionally, users, when they do carry their laptops, often have to flip the laptop open, then boot the machine, which takes time. This is disfavored, especially, when the user wants a specific information quickly, such as, an address, e-mail, or relevant text from an e-mail attachment, while traveling.

Microsoft Windows SideShow™ is a software program that is in an operating system (OS) that supports a secondary screen on a mobile personal computer, such as a laptop computer, that is generally disposed on the rear of the laptop cover. With this additional secondary display, a user can access the Microsoft Windows SideShow™ software program to display images on the secondary display while the computer is in sleep mode or turned on or off.

Microsoft Windows SideShow™ uses convenient mini programs called Gadgets. These Gadget programs extend information from the laptop to other devices. Gadgets can run on computers operating with Microsoft Windows SideShow™ and update devices with information from the computer. Gadgets may allow viewing of information from the computer regardless of whether it is on, off, or in sleep mode. This saves power and a user's time by not requiring booting of the computer.

These gadget software programs are limiting and users desire a software gadget that permits wireless access to the laptop computer without the need to use any input device to continuously monitor. Additionally, users desire great amounts of information from the computer while the laptop computer, or PC, is on, off, or in sleep mode.

SUMMARY OF THE INVENTION

A handheld, high-resolution, microdisplay device provides greater convenience and mobility and avoids the problems of wired and wireless video headsets. The handheld wireless display device provides at least Super Video Graphics Array (SVGA) (800×600) display resolution, or even higher resolution such as Extended Graphics Array (XGA) (1024×768). The microdisplay component may be relatively small; preferably, the active area of the display being in the range of about 0.5 inches on the diagonal or less.

The handheld design format provides several advantages. First, overall styling is much easier and therefore more generally acceptable to a wide variety of users then head-mounted displays. Since the display unit and the human head are decoupled, hand movement of the unit itself may be used to find an optimal position of the device relative to the users eye. Viewing of the image on such a handheld device is also similar to the viewing in direct view large format display—either the head moves or the display moves for optimal viewing. The device may be adapted for placing on a stand or attached to a head band and the like for use over a long term time frame.

In a preferred embodiment, the handheld unit includes one or more metal-insulator-metal (MIM) diodes, Hall effect sensors, or other high-sensitivity position transducers and/or accelerometers that may indicate lateral movements along and rotational gestures around the X, Y and Z axes to serve as hand gesture inputs, movement queues and the like. These may be used to accept user inputs to change pages, scroll up, scroll down or across an enlarged screen image providing a more pleasant user experience for activities such as scrolling through web pages or engaging in mobile game playing. Alternatively, switches associated with or voice commands received at the device allow the user to select and navigate menus, play media files, set volume and screen brightness, activate controls for the host target device or perform other commands. Similarly, the device may be manipulated by voice commands, a Bluetooth mouse, a Bluetooth keyboard, key pads on the display housing and/or other devices as may be desired.

The display may be configured in either a monocular or binocular configuration. In a monocular configuration, the shape of the display unit may be wide parallel to the eyes so that one eye not looking at the image is blocked from viewing the surrounding. In a binocular configuration one may incorporate inter-pupillary distance (IPD) adjustment and or a user image focus mechanism. With the IPD adjustment, requirements for optics in a display may be relaxed. In return for this other optical characteristics such as distortion may also be improved so that the resolution is good across the entire plane of the image. An eye relief may be fairly large so that a user wearing eye glasses may use the unit comfortably.

In a preferred embodiment, the device contains external wireless connection to provide for ease of interface to many other types of devices. For example, a wireless communications controller associated with the device acts as a video link to a host device. Alternatively, connections with multiple hosts may be established. The connection may for example be provided by either a Bluetooth™, WiFi™, Wimax™, Cellular or Satellite wireless connection. The wireless interface also may support Microsoft Windows SideShow, Remote Desktop Protocol (RDP) or Virtual Network Computing (VNC) protocols. The use of these or other standard wireless interfaces allows the device to be adapted for use with a number of different other host devices without the need to change any hardware.

It might also be beneficial to use a Bluetooth™-type wireless physical layer. Bluetooth™ has become the most widely-adopted way to interface portable handheld devices to other equipment. Bluetooth™ also offers broader compatibility, lower power consumption, and other advantages over WiFi™. A Bluetooth™ proxy may be used to implement a packet switching gateway.

The host is any appropriate device that sources video information, such as a cell phone, personal computer (PC), laptop, media player and/or the like. In certain embodiments, the handheld wireless display device may repeatedly poll a host computing device for updated content at times the host computing device is on, off or in a reduced power mode, such as sleep or hibernate.

DETAILED DESCRIPTION OF THE INVENTION

FIG. 1Ais a perspective view of a first embodiment of a handheld wireless display device100having a housing101that incorporates a high-resolution (SVGA or better) microdisplay element140. The housing101may also include a number of buttons102, track pad103, Capacitive or resistive touch pads102, a small touch screen or track pad103, and/or a scroll wheel104to allow a user to provide control inputs thereto. Audio input and/or output device(s), which may include microphone input and stereo outputs, may also be placed in the housing101(not shown). A Secure Digital (SD), eXteme Digital (xD), Universal Serial Bus (USB) integral SD (uSD) memory or other similar interfaces (not shown) may or may not be stored in the housing101, and may be used to store application programs, kernel directives, configuration data, and/or connect to external devices.

The microdisplay element140is preferably a lightweight small form factor imaging unit. The image may or may not be magnified. Although not shown inFIG. 1A, the microdisplay element140is positioned relative to a prism or other optical elements in the same display housing101to assist with bringing images into user focus and/or substantially correcting for optical distortion, astigmatism, and chromatic aberrations. The optically enhanced (or not-enhanced) image is then directed such that the user of the handheld wireless display device may view the virtual image by looking directly into the optical component cover (glass or plastic)105. The displayed image need not be projected to, or displayed on, the entire microdisplay element140. Instead, the image may be displayed on a portion of the microdisplay element140.

The microdisplay element140of the handheld wireless display device100may be advantageously viewed by looking out of the corner of the user's eye momentarily to view images, and then immediate return to the field of vision in front of the user. This encourages the user to use the handheld wireless display device100in day-to-day activities. Advantageously, the user may quickly look at the handheld wireless display device100and then quickly, safely and easily regain focus to other objects that are in front of the user. This is advantageous because the user is not confined to using the handheld wireless display device100in certain designated “safe” locations. The user's dominant eye is defined as the right or left eye that is the strongest or dominant in the user's day-to-day vision. In other embodiments, the handheld wireless display device100does not project an optically enhanced virtual image on the microdisplay element140but instead directly displays the optically magnified and enhanced virtual image to the user's desired (typically the dominant) eye.

The microdisplay element140may be a liquid crystal display (LCD), or an organic light emitting diode (OLED) based display. Various lightweight and high-resolution display configurations are possible and within the scope of the present disclosure. As one example, the microdisplay element140may be a 0.44 inch diagonal CyberDisplay SVGA LVS display with about 800×600 resolution from Kopin Corporation. Alternatively, the display component140may be a wide SVGA display with about 1024×600 resolution, an XVGA display with about 1,024×768 resolution, an SXGA display with 1,280×1,024 resolution or High Definition Television display with 1,920×1,080 resolution.

Such small, high-resolution active matrix liquid crystal displays (AMLCDs) are of the type generally described in issued U.S. Pat. No. 6,677,936 issued to Jacobson, et al. on Jan. 13, 2004 and assigned to Kopin Corporation, and as further described in a co-pending U.S. patent application Ser. No. 11/903,561, filed on Sep. 21, 2007, also to the same inventors and assigned to the same assignee.

The LCD may be fabricated using the thin film semiconductor processing techniques as described in co-pending U.S. patent application Ser. No. 11/893,594, filed on Aug. 16, 2007 and assigned to Kopin Corporation. With that technology, it has been found that the resulting thin film transistors reduce light photo sensitivity providing high display contrast.

The general circuit architecture for the LCD may be as described in issued U.S. Pat. No. 7,138,993 to Herrmann wherein integrated switches are used to handle high-resolution video signals at half the normal voltage levels. Shift register components used within the display electronics may be implemented according to co-pending U.S. patent application Ser. No. 11/985,347 filed on Nov. 14, 2007 and assigned to Kopin Corporation. This combination of these technologies provides low power operation suitable for running SVGA and higher resolution displays on battery power alone.

As illustrated and implied by the arrows inFIGS. 1B and 1C, the handheld wireless display device100may include accelerometers, Hall effect devices, metal-insulator-metal (MIM) diodes and/or other similar sensors or transducers as inputs. These devices inputs indicating lateral movements along and rotational gestures around the X, Y and Z axes to the control circuitry within the device to provide for user generated commands, user image or content control movements, scrolling image content and the like. These sensors are thus used to detect hand gestures which in turn allow the user to indicate a command to change pages while browsing the internet, or scroll up or down or across a large screen image, and or the like. The same movement input devices may be used for mobile game interface and other end uses.

Alternatively, as illustrated inFIGS. 1D and 1E, a scroll wheel108may be associated with the handheld wireless display device100, in which case a cover109may be used to prevent inadvertent activation of the scroll wheel. In other arrangements, the handheld wireless display device100may be controlled by voice commands, with simple and/or advanced voice recognition features built into the circuitry and software within the handheld wireless display device. Other ways to control the handheld wireless display device100may include a separate keyboard such as may be connected through the included Bluetooth interface. In an alternate embodiment, the keyboard may be made integral to the handheld wireless display device100and/or projected via an optical image on the microdisplay element140.

FIG. 2is a diagram illustrating wireless communications between an example embodiment handheld wireless display device100and host computing devices225. The handheld wireless display device100interrogates a host computing device225and is configured to establish two-way, or bidirectional a wireless communication link235with the host computing device225such that the host computing device225provides uplink and downlink data to the handheld wireless display device100in a bidirectional manner across the wireless communication link235. In one embodiment, the handheld wireless display device100receives uplink data that is suitable to display content on the microdisplay element140of the handheld wireless display device100.

The handheld wireless display device100also controls the host computing device225, such as, for example, a wireless laptop225a, to run business applications, retrieve e-mail, and run executable code, and applications from the laptop225aacross the wireless link235. In this regard, the handheld wireless display device100may include an input device that transmits a wireless input signal to the host computing device225. The input signal controls the host computing device225to provide control signals to run applications on the host computing device225.

In response to the control signals, the handheld wireless display device100receives content from the host computing device225across the wireless communication link235with a high data transfer rate. Thereafter, using suitable program instructions and a converter (not shown), the handheld wireless display device100converts the content received across the wireless communications link235to multimedia including graphical video data to display images on the microdisplay element140depending on the specific host computing device225.

The host computing device225then outputs a graphical output to the microdisplay element140for a remote display of applications operating at the host computing device225at the handheld wireless display device100, which may be located a distance away from the host computing device225. Host computing devices225source content250of various types for viewing on the microdisplay element140, including video250a, audio250b, computer data250c, and other types of information, such as calendar250d, email and any number of types of data that are regularly found from host computing devices225.

In one embodiment, the wireless communication link235uses short range or long range radio frequency (RF) signals over a designated channel to communicate content using a protocol known to both the handheld wireless display device100and host computing devices225. Preferably, the RF signals are low power and in a range of about 1.0 milliwatt (mWatt) to 100 mWatts. so as to transmit the RF signals across a desired distance, which may be from several feet or greater than twenty feet in length.

In one embodiment, the handheld wireless display device100uses a Bluetooth™237communication standard to communicate with the host computing device225. In one embodiment, the Bluetooth™ technology permits data communication at a data transfer rate of around 1 megabit per second (Mbps) with another computing device about 10 meters away using a 2.4 gigahertz (GHz) frequency. Although not preferred, wired interfaces such as USB, Recommended Standard (RS) 232 (RS-232) (serial) and/or RS-485 wired interfaces, an Ethernet interface, a telephone line interface, a modem interface, a digital subscriber line interface, a cable interface, or a personal area network interface may also be provided.

In another embodiment, the wireless communication link235may use Institute of Electrical and Electronics Engineers (IEEE) 802.11(b), or IEEE 802.11(g), or another standard. In yet another embodiment, the wireless communication link235may include Bluetooth™ 3.0 with a data transfer rate of about 480 Mbps, Ultra-Wide Band (UWB), Wireless USB (WUSB), Wireless High Definition (WirelessHD), Wireless High Definition Multimedia Interface (WHDMI), WiFi™, or any other high speed digital communication standard known in the art. In a further alternative embodiment, the handheld wireless display device100may communicate with the host computing device225using a wired connection, instead of link235such as, for example, a serial port, or a USB cable, or other wired connections. Alternatively, the wireless communication link235may include a Code Division Multiple Access (CDMA) standard, a Time Division Multiple Access (TDMA) standard, or Frequency Division Multiple Access (FDMA) standard or, alternatively, any other frequency hopping standard in spread spectrum communication known in the art to communicate data. Various protocol standards for wired and wireless communication are known in the art, and the present handheld wireless display device100is not limited to any specific link, or RF protocol.

Further, a software System Development Kit (SDK)260may be used by an application programmer to specify interfaces for host computing devices225, thereby permitting content250to be displayed on microdisplay element140. For a number of reasons, the handheld wireless display device100may not be able to simply display existing web and other types of content. In particular, the content250may need to be specially designed and implemented to fit the microdisplay element140. To encourage this, the developer SDK260enables developers to quickly and easily develop the graphical portion of their applications. The backend of these same applications is then coded into a programmer's language of choice for the particular handheld wireless display device100, as will be described in more detail below.

In certain embodiments in which the handheld wireless display device100is enabled with Microsoft Windows SideShow™, the host computing device225may run a Microsoft Windows SideShow™ gadget to make content available across the wireless communication link235to the handheld wireless display device100. Preferably, the Microsoft Windows SideShow™ gadget running on the host computing device225may be accessed by the handheld wireless display device100over a wireless Bluetooth™, 802.11(b), 802.11(c), or 802.11(g) connection, such that the handheld wireless display device100may be located far in distance from the host computing device225. Preferably, the handheld wireless display device100may be wirelessly connected to the host computing device225via the Internet. Therefore the handheld wireless display device100may connect to the host computing device225from anywhere in the world and may access data from a memory operatively connected to the host computing device225.

The handheld wireless display device100is not limited to communicating with any specific host computing device225, and the discussion above with regard to the laptop computer225is merely illustrative, and is not limiting. The handheld wireless display device100also may communicate with other host computing devices225including a personal computing device, such as, for example, a desktop or laptop computer that includes an operating system (OS), such as, for example, the Microsoft Windows Vista™ OS, Microsoft Windows Mobile™, Apple Mac OSX™ OS, Symbian OS compatible operating systems, Lenovo compatible operating systems, the Linux operating system, the UNIX operating system or another known suitable operating system that is Internet ready, and configured for wireless mobile operation.

Other host computing devices include a cell phone, Personal Digital Assistant (PDA), such as a PALM™ compatible device, desktop computer, tablet computer, mobile e-mail communication device, such as, for example, a Blackberry™ device or a Good Technology™ compatible device, or personal digital music or video player, such as, for example, an Apple I-Pod™ video and audio player, Microsoft Zune™ multimedia players, and other Motion Picture Experts Group (MPEG)-1 Audio Layer 3 (MP3) music players, digital video players, or drives. The host computing devices225also may include automotive systems, Global Position System (GPS) devices, Satellite Radio receivers or players, such as, for example, XM Satellite Radio™, or Sirius Satellite Radio™ compatible devices. The host computing devices225may also include mainframe computing devices, digital testing devices, diagnostic equipment, TIVO™ or other digital video recorder, set top cable box, or any other digital or analog device known in the art.

FIG. 3is a network diagram illustrating communications between an example embodiment handheld wireless display device100and host computing devices225, and communications between the host computing devices225and other external databases and the Internet350, for delivery of multimedia content to the handheld wireless display device100. The handheld wireless display device100preferably has program instructions stored on a memory to form a computer networking master/slave relationship with host computing devices225using a communication protocol. Once the master/slave relationship is established, the direction of control is directed from the handheld wireless display device100to the desired components. In this manner, the user need not carry heavy secondary components and may simply control those secondary components using the primary handheld wireless display device100over a wireless interface.

The host computing device225may communicate with remote databases, and may act as an intermediary between the handheld wireless display device100and a source of multimedia content, or site, so the user may view multimedia (in the peripheral vision of the wearer) without the associated heavy computing device and network connections associated with obtaining the multimedia content. The host computing device225obtains information along a bi-directional communication path(s) such as cellular service300a, WiFi300b, satellite service300c, broadcast television300d, and closed circuit communications300eto the Internet350or associated databases355for which to display content on the microdisplay element140of the handheld wireless display device100.

In one embodiment, the communication path300amay be a cellular mobile communication wireless path, and each path may be different or the same relative to the remaining bidirectional communication paths300bthrough300e. In one embodiment, the host computer225may obtain information using Sprint™ EV-DO Wireless Broadband Connection, and then communicate with the handheld wireless display device100using a Bluetooth™ wireless connection235.

In another embodiment, the communication path300bmay be a WiFi™ communication path, or similar RF signal communication link. The host computing device225may communicate with satellite services providers, digital video recorders, broadcast television providers, or closed circuit communication devices using paths300c,300d, or300e, respectively. Paths300athrough300emay also be associated with a public access wireless hot spot.

Example embodiment handheld wireless display devices100may be compatible with NASCAR Nextel Fan View™ to watch closed circuit television of sporting events, and/or kangaroo.tv broadcast devices for displaying closed circuit television events. The present handheld wireless display device100may be configured to receive live broadcasts, may receive multiple different broadcast views of sporting events in real time (of the same or different events), statistical information, and audio data.

The host computing device225may access a World Wide Web (WWW) server on the Internet350along paths300a,300b, and obtain information, which is held and displayed to the microdisplay element140along communication link235. In one embodiment, the content may be in a known data format such as, for example, Hyper Text Markup Language (HTML), Extensible Markup Language (XML), Joint Photographic Experts Group (JPEG), Waveform (WAV), Audio Interchange File Format (AIFF), Bitmap (BMP), Picture (PICT), Graphic Interchange Format (GIF), and Windows Media Video (WMV), or any other data format suitable for multimedia content including streaming video, and audio. The content may be obtained from the Internet from databases355along path300f. Various communication path configurations are possible and within the scope of the present disclosure.

The host computing device225may send and receive data along a wireless communication path300bto the Internet and other system web pages or information databases350using HTML along bidirectional communication path300b. The host computing device225may include Internet browsing software (such as known web browsers including, Microsoft Internet Explorer™, Opera™, Netscape Navigator™, and Mozilla Firefox™) to send and receive data along paths300aand300b. The host computing device225may be connected to the Internet by a cellular telephone network, and/or an Internet Service Provider Gateway Server.

Moreover, the handheld wireless display device100may be configured to receive push e-mail, pull e-mail or periodically forwarded e-mail from e-mail accounts, such as, for example MSN™ Hotmail, Google™ G-Mail, Yahoo!™ mail, AOL™ Mail, or any other e-mail provider or Internet site known in the art along path(s)300athrough300e. In one embodiment, the wireless link235, or communication paths300athrough300e, may be compatible for use with a Staccato Communication™ Ultra Wide Band (UWB) USB that includes a RF transceiver, a digital baseband, and an interface to provide for wireless connectivity up to 480 Mbps on a single chip footprint, which may be located in the handheld wireless display device100, or in the host computing device225.

Certain host computing devices225, such as those running a Microsoft Windows™ OS, may recognize the handheld wireless display device100as a secondary auxiliary display relative to the primary host computing device225primary display. The host computing device225may use the operating system to control the secondary handheld wireless display device100in a wireless manner.

The handheld wireless display device100may wirelessly interface with two or more host computing devices225, such as a first computing device, and a second computing device, in a substantially simultaneous manner over at least two independent wireless communication paths235. In this aspect, the handheld wireless display device100may synchronize with the first computing device, the second computing device, and other devices so that the handheld wireless display device100acts as a central hub.

In this aspect, the handheld wireless display device100may initiate a first wireless communication path with the first device and also simultaneously initiate a second wireless communication path with the second device. The first and the second communication paths may be the same or different, and may configured over a Bluetooth™ connection, or a modified Bluetooth™ connection, or another protocol. In one aspect, the communication path may be a Bluetooth™ 2.0 or 3.0 connection, an IEEE 802.11 or IEEE 802.15 wireless communication protocol, and the connection may be suitable to communicate over a number of channels simultaneously with a variable bit rate, and a variable buffer. In an alternative embodiment, the communication path may be a Bluetooth™ connection, and the connection may be suitable to communicate over all channels simultaneously with a variable bit rate, and a variable buffer.

Preferably, using the handheld wireless display device100, the viewer may control the handheld wireless display device100to remotely interrogate a first computing device over a wireless Bluetooth™ connection to pair with the first computing device. Thereafter, the handheld wireless display device100may output control program instructions to the first computing device to perform functions at the handheld wireless display device100.

The handheld wireless display device100(while communicating with the first computing device) may also interrogate a second computing device over a wireless Bluetooth™ connection to pair with the second computing device. This may be accomplished using a different or the same wireless interface. Thereafter, the handheld wireless display device100may output control program instructions to the second computing device.

Various computer communication configurations are possible and within the scope of the present disclosure, and the handheld wireless display device100may be configured to control any number of other computing devices, and/or peripheral devices, such as, for example, a wireless headset, a wireless memory, wireless speakers, etc. For example, the handheld wireless display device100may independently pair with two cell phones simultaneously. In this manner, the wearer may make independent calls using the two cell phones using program instructions transmitted from handheld wireless display device100.

Alternatively, the handheld wireless display device100may pair with a cell phone and a laptop computer having a wireless modem to make a call using the cell phone using the handheld wireless display device100, while controlling the laptop computer to play video, which is transmitted over a Bluetooth™ connection to be displayed on device100. Various configurations are possible and within the scope of the present disclosure, and the handheld wireless display device100may control three or more devices, or more by establishing more than one wireless communication link.

FIG. 4illustrates a simplified block diagram of a non-limiting example embodiment of the present handheld wireless display device100and an example host computing device225. The handheld wireless display device100includes a microdisplay element140connected to a display controller400, which may be a digital signal processor made by Intel™, Freescale Semiconductor™, or Advanced Micro-Devices (AMD)™. The controller400is connected to a bus405, such as a Peripheral Component Interconnect (PCI) bus. In one embodiment, the microdisplay140alternatively may be connected to a video graphics card (not shown) which is connected to the bus405. The video graphics card may be an Accelerated Graphics Port (AGP) video card that fits to an AGP video card slot in the handheld wireless display device100.

The handheld wireless display device100also includes memory410, such as a random access memory (RAM)415and a read only memory (ROM)420, which saves executable program instructions and communicates the program instructions to the controller400through bus405. Preferably, the handheld wireless display device100further includes a transmitter425and a receiver430, and/or a combined transceiver (not shown), both of which are connected to the bus405to form a wireless interface with the host computing device225. The transmitter425and receiver430also are connected to the display controller400over the bus405and receive instructions for control thereof.

The handheld wireless display device100also includes an input device435which may be a wireless mouse, trackball, or keyboard, other similar wireless device that may be wirelessly connected to the PCI bus405by a wireless link440, which is received by the receiver430. Similarly, lateral movements along and rotational gestures around the X, Y and Z axes may be detected by Hall effect sensors447, MIM diodes448, accelerometers449or other sensors/transducers. Alternatively, the input device435may be connected in a wired manner (not shown) to the bus405to provide an input signal to the controller400. The input device435may control screen prompts on the handheld wireless display device100, the host computing device225, or both, with the handheld wireless display device100and the host computing device225in a master/slave networked relationship.

The host computing device225includes a central processing unit (CPU)445, a memory having a RAM450, a ROM455, and also including a cached memory460. The host computing device225further includes a transmitter465and receiver470, and/or a combined transceiver (not shown). The host computing device225may also include a primary display475and an input device480which are both connected to a bus490, such as a PCI bus. The bus490also may be connected to a wired broadband connection (not shown), wireless broadband connection485, DSL line, cable modem, media player, music or video player, or any other suitable link to receive content.

Display controller400outputs control signals to the display140to display images. This allows the handheld wireless display device100to receive data stored on the cache memory460of the host computing device225. When the host computer225is not in use, or switched off, the data viewed on the handheld wireless display device100is from the cached memory460, and not updated. This data may be slightly older and not refreshed through the communication links300athrough300e, as compared with when the host computing device225is operational. The handheld wireless display device100and the host computing device225also may include audio devices495,495′ that receive a control signal and play audio in response thereto.

Alternatively, as will be discussed below in greater detail with reference toFIGS. 7 and 8A-8C, in a further example embodiment, the handheld wireless display device100may access the host computing device225across the wireless communication link235when the host computing device225is on, off, or in a reduced power state, such as a sleep or hibernate state. In this embodiment, the host computing device225operates at minimal power and periodically scans for an impromptu, spontaneous wake-up call or command from the handheld wireless display device100to trigger a low-level command in the host computing device225to wake up the host computing device225and provide content or services to the handheld wireless display device. The host computing device225may be configured with a predetermined input/output (I/O) port to be monitored for a wake-up call or command that triggers the low-level command to wake up the host computing device225. Ports include an Ethernet port or card, a WiFi™ port or card, a cellular port or card or a Bluetooth™ port or card suitable for wireless communication across the wireless communication link235. This port is also known to the handheld wireless display device100so that the wake up command may be sent properly to and received by the host computing device225.

Any external hardwire or external wireless interface may be accessed to permit a Microsoft Windows SideShow™ gadget to access data from the hibernating host computing device225. The host computing device225listens for a specific address number, name or command directed specifically to the hibernating host computing device225to wake-up. Receipt of the command at the host computing device225triggers a low-level command to wake the host computing device225. Once awake, the host computing device225furnishes any and all information and services requested by the handheld wireless display device100.

When the transfer is finished, the handheld wireless display device100may transmit a command over the wireless communication link235to the host computing device225. Upon receipt of that command, the Microsoft Windows SideShow™ gadget running on the host computing device225triggers a system-level command to cause the host computing device225to reenter hibernation, for example, until needed again later. Other reduced power states may be triggered, including sleep and off.

The handheld wireless display device100may provide many benefits to a user by taking advantage of the capabilities of Microsoft Windows SideShow™. Use of a Microsoft Windows SideShow™ gadget running on the host computing device prevents a user from having to carry a PC225, for example, around when mobile or traveling. A user whose PC225was running the Microsoft Windows SideShow™ gadget may remotely and spontaneously contact their PC225from anywhere, thereby instantly receiving the host computing device225information content and services needed, and then return their PC225to a hibernation state, as will be discussed below with reference toFIGS. 7 and 8A-8C.

Further, the handheld wireless display device100allows large facilities to reduce their computer and accessory power consumption by allowing users to not have to leave computers running when not attended while still providing their users immediate access to all or the PC information, computing services and their normal access to company computer resources at user demand. It also reduces general PC maintenance, repair and even damage during travel. Moreover, a reduction in running unattended PCs allows large facilities to reduce air-conditioning power requirements to cool un-attended PCs and allows unattended PCs, even many servers, to be placed in hibernation until the moment they are required.

The handheld wireless display device100also allows PC users to no longer have to wait for their PCs to boot-up (e.g., 5-10 minutes per boot-up cycle is not unusual). Whether the PC is in near proximity to the user (e.g., ≦30 feet) and accessed from hibernation by a Bluetooth™ wireless command, WiFi™ command or over a greater distance by cellular wireless command or even over the Ethernet interface, the PC is hibernating and ready to spring into action when called upon by the user. For example, after a PC is booted in the morning of a work day or just prior to taking a trip, the PC may remain in a hibernating mode and not have to be booted again, until absolutely necessary or desired by the user.

Further, a PC user may use the Microsoft Windows SideShow™ gadget to provide remote access to storage, contents, applications and services of the host computing device, and may operate remotely without requiring user interaction with the host computing device through protocols, such as Remote Display Protocol (RDP) and Virtual Network Computing (VNC), and commercial services, such as GoToMyPC.

FIG. 5provides a more detailed view of the electronic components incorporated into the handheld wireless display device100, which is connected to host computing devices225to receive a digital video signal over a Bluetooth connection. These components are described in greater detail in a co-pending patent application U.S. application Ser. No. 12/348,627, filed on Jan. 5, 2009, entitled Method And Apparatus For Transporting Video Signal Over Bluetooth Wireless Interface, which is incorporated herein by reference.

In the preferred embodiment, the handheld wireless display device100includes an Advanced Reduced instruction set computer (RISC) Machine (ARM)/Digital Signal Processor (DSP)512(which may be an Open Multimedia Application Platform (OMAP) 3500 series processor, available from Texas Instruments of Dallas, Tex.), memory514, Bluetooth interface516which may be provided by a Class 2 Bluetooth interface available from Cambridge Silicon Radio (CSR) of Cambridge, England), display driver519(which may, for example, be an SSD1508 display driver available from Kopin Corporation of Westborough, Mass.), video level shifter circuits520, a power supply522supported by a battery524, universal receiver transmitters (UART)526(such as may be used for debugging) and memory515. A Secure Digital (SD), eXteme Digital (xD), USB SD (uSD) memory517or other similar interfaces may be used to store application programs, kernel directives, or configuration data, and/or connect to devices such as a digital camera. A number of input device530may be associated with the device (e.g., switch 1/switch 2/switch 3 and reset inputs), Hall effect sensors547, MIM diodes548, accelerometers549, track pads and scroll wheels, and an LED output532(led1). A VGA or better quality microdisplay element140and audio input and output device(s)560, which may include microphone input562and stereo outputs564, are also provided.

The signal may be sent over the Bluetooth™ wireless communication link235established using Serial Port Profile (SPP) from the handheld wireless display device100to the host computing device225, as opposed to using any of the “advanced” Bluetooth modes, which provides greater throughput higher than the higher layer protocols imposed by such advanced modes that have been found not to be needed in this application. In the Bluetooth™ radio516, a video signal received over the Bluetooth™ connection is sent over the USB connection518to the processor512. One design consideration is to optimize data packet format, given known data buffer sizes. Internal to the Bluetooth™ radio516is a packet buffer default size of 1000 bytes. This may be modified to force streaming video signals to use only about a 990 byte buffer size. The processor512may expect the received video content to be encoded with the H.264 (Motion Picture Experts Group (MPEG)-4 part 10) formatting, using the so-called baseline profile or better.

In a preferred embodiment, the processor512may use a multi-tasking embedded operating system. The processor512operates on the received video signal as follows. An MPEG format container file (e.g., a .MP4 file) is made available. In one preferred embodiment, this may be a proprietary file format, although the specific details of the input .MP4 file format chosen are not important here, as long as the processor512is programmed to correctly process it. The processor512then opens a communication port to the host computing device225and receives the file over the USB interface518from the Bluetooth™ radio516.

An MP4 decoder in the processor512strips the file into respective audio and video streams. More particularly, the processor512decodes the input file H.264 compressed digital video signal into a YCbCr baseband component video signal. The processor512may also divide the associated compressed audio (formatted as an Advanced Audio Coding (AAC) format signal) into baseband stereo audio.

The processor512may output video in any suitable format such as an 8 bit, International Telecommunication Union Radiocommunication Sector (ITU-R) Recommendation BT.656 or Society of Motion Picture and Television Engineers (SMPTE) 293M 16 bit YUV progressive scan signals with separate sync signals, to the display driver519. The decompressed video signal is forwarded over an internal ARM bus of the processor512. The ARM bus then sends the content directly to the display driver519via the SMPTE 293M interface. The Intelligent Interface Controller (I2C) interface547is used to configure the microdisplay element140, The processor512also outputs the baseband audio to the audio output Compression/Decompression Module (CODEC)560. It may take mono or stereo audio input and produce suitable stereo output signals.

FIG. 6is a flow diagram of a method600of operation according to an embodiment of the handheld wireless display device. The method commences (605). Thereafter, the handheld wireless display device awaits (607) a user input request. This input may be any signal output from an input device, such as, for example, an output generated by user movement of the handheld wireless display device as detected by MIM diodes, Hall effect sensors or accelerometers, or from a wireless trackball, a wireless mouse, or a wireless key pad, or a button located on the housing of the handheld wireless display device.

In one embodiment, using an operating system, such as, Microsoft Windows Mobile™ operating system, and using a gesture, the user may double click an icon on the handheld wireless display device screen (e.g., microdisplay element140ofFIG. 1) to indicate to open an electronic mail message, or to open an application. Thereafter, the method600attempts to receive data from a source of content, in response to the request, and the method determines (610) whether the content source is located in a memory on the handheld wireless display device (e.g., memory410ofFIG. 4), such as, for example, on a camera output, or whether, the source is located at another remote location, such as, on the host computing device (e.g., host computing device225ofFIG. 2). If the data is indeed stored locally (612) and no wireless link is needed, then the local memory is accessed (615) and the data is configured to be retrieved and loaded for subsequent display on the display element. Once the method600accesses the local memory (615), the method600returns to wait for a new user input request (607).

However, if the data is located on a remote memory or in a memory not located on the handheld wireless display device (613) then a Bluetooth™ connection, or other previously described wireless connection(s), is started (620) to obtain the data as requested (607). Other wireless communication formats may also be used, as previously discussed, and the present method600is for illustration purposes only.

The device's transmitter (e.g., transmitter425ofFIG. 4) may be activated to interrogate the host computing device, and to send an initial configuration signal to the receiver (e.g., receiver470ofFIG. 4) of the host computing device (625). The host determines whether the Bluetooth™ signal is sufficiently powered and was received from the handheld wireless display device100(630). Once the signal is received, the host transmitter (e.g., transmitter465ofFIG. 4) sends a confirmation signal to the handheld wireless display device receiver (e.g., receiver430ofFIG. 4) using a second predetermined signal. If the signal was not received (632), then the handheld wireless display device continues to interrogate the host (625). A stronger or more directive signal is sent. If the signal is received correctly by the host computing device (634), then a bi-directional communication data path is formed across the wireless link (e.g., wireless link235ofFIG. 3) (635). Uplink and downlink signals may be communicated across the bidirectional connection data path to and from the devices (e.g., handheld wireless display device100and host computing device225ofFIG. 3), the present method being merely illustrative as various diagnostic, utility applications and signals that may be sent along the wireless link in addition to the nonlimiting method ofFIG. 6.

Once the bi-directional communication data path is formed (635), multimedia data files may be communicated from the host computing device to the handheld wireless display device. In one non-limiting embodiment, the bandwidth of the communication path is sufficient in bits per second (bps) that, when operating Microsoft Windows Vista™ Operating System at the host computing device, the graphical output of the host display output screen (e.g., host display475ofFIG. 4) is visible in real time at the microdisplay element (e.g., microdisplay element140ofFIG. 4), such that if both displays were held side by side, a cursor movement occurs on both screens substantially simultaneously to enable remote operation of the host computing system at the handheld wireless display device.

The display controller (e.g., controller400ofFIG. 4) sends a request for a video signal from the computing device (640). The request is communicated to the bus405, and to the transmitter and then sent across the link. Thereafter, the handheld wireless display device determines whether the video signal was received from the host computing system in a wireless manner (645). If the signal was received wirelessly (647), then the handheld wireless display device requests audio (650). If the signal was not received in a wireless manner (648), then the handheld wireless display device returns to send another request (640).

The display controller sends a request for an audio signal from the host computing device (650). The audio and the video signal may be sent as one continuous signal and the present disclosure is not limited by any such two signal embodiment. The request is communicated to the bus (e.g., bus405ofFIG. 4), to the transmitter, and then sent across the link. The handheld wireless display device then determines whether the audio signal was received from the host computing system in a wireless manner (655). If the audio signal was wirelessly received (647), then the handheld wireless display device displays video (660). If the audio data or signal was not received wirelessly (648), then the handheld wireless display device returns to send another request (650).

Program instructions cause the handheld wireless display device to display video on the microdisplay element by the display controller (660) and play audio using the audio device (e.g., audio device495ofFIG. 4) (665). Thereafter, a request for a further input signal is sent (670). It is then determined whether the process is complete (675). If the process is complete (677), then the method ends (680). If the process is not complete (678), a further user input request is awaited (607). Various control configurations are possible and within the scope of the present disclosure, and the present configuration is for illustration purposes only, and multiple other steps for encryption, and to decipher host computing or other external computing device formats may be carried out.

FIG. 7is a diagram illustrating an example embodiment handheld wireless display device, a host computing device, and communications between the handheld wireless display device and the host computing device to wake the host computing device from a hibernating reduced power state, provide content to the handheld wireless display device, and return the host computing device to the hibernating reduced power state.

During an initial stage of operation, a bi-directional wireless link235is established between the transmitter of the handheld wireless display device425and the receiver of the host device470and an authentication process occurs across the wireless communication path235. Thereafter, the handheld wireless display device100may wirelessly communicate with the host receiver470over a wireless communication link235, and the host transmitter465may transmit signals to the handheld wireless display device receiver430. In one embodiment, the handheld wireless display device100, from its transmitter425, may wirelessly communicate with the host receiver470using a Bluetooth™ 2.0 or 3.0 wireless radio frequency standard. In another embodiment, the handheld wireless display device100may wirelessly communicate using a wireless Ultra Wide Band communication link235, or using short-range radio frequency signals235.

In one non-limiting embodiment, the host computing device225executes program instructions and uses a Microsoft Windows SideShow™ gadget to interrogate the handheld wireless display device100to allow the handheld wireless display device to access the cached memory of the host computing device225. The handheld wireless display device110then retrieves the cached content from the host computing device225to be displayed on the microdisplay element140with the host computing device225is on, off, or in a reduced power state, such as a sleep or hibernate state.

At time T1, the host computing device225is in a reduced power state, such as a hibernating state. During time T1, the host computing device225continually monitors a specified port for a wake up command. At time T2, the handheld wireless display device100sends a wake up command705to the host computing device225over the wireless connection235. After the wake up command705is received by the host computing device225, the host computing device225calls a low-level function and enters a full power state to be awake at time T3. At time T4, the host computing device225optionally sends a wake up notification710to the handheld wireless display device100. Upon receiving the wake up notification710, the handheld wireless display device100is informed that the host computing device225is awake and ready to provide content250.

At time T5, the handheld wireless display device100sends a request for content715to the host computing device225. In response, the host computing device225gathers the requested content and, at time T6, sends the requested content720to the handheld wireless display device100. Some time later, at time T7, the handheld wireless display device100sends a sleep command725to the host computing device225to trigger an application, such as a Microsoft Windows SideShow™ gadget, running on the host computing device225to cause the host computing device225to enter a reduced power state, such as a hibernating or sleep state. In response to the command725, the application running on the host computing device225calls a system-level function to enter the hibernating state. At time T8, the host computing device225is hibernating again. This process may happen repeatedly.

FIGS. 8A-8Care flow diagrams illustrating example methods by which an example embodiment handheld wireless display device may wake a host computing device from a hibernating reduced power state, receive content from the host computing device, and return the host computing device to the hibernating reduced power state.

As illustrated in the flow diagram800aofFIG. 8A, an example method commences with a host computing device being in a reduced power state (805). As described above with reference toFIG. 7, a wireless connection between the host computing device and a handheld wireless display device (e.g., wireless connection235ofFIG. 2) has already been established. The host computing device monitors a specified port at intervals for a wake up command from the handheld wireless display device. Such monitoring may be performed by low-level functions of the host computing device, such as those provided by a BIOS or network interface device. The host computing device checks whether a wake up command has been received (815). If a wake up command has not been received (817), the host computing device continues to monitor at intervals. However, if a wake up command has been received (818), the host computing device calls a low-level function to enter a full power state (820).

Once in the full power state (825), the host computing device monitors for a request for content. Such monitoring may be performed by a software application running on the host computing device. The host computing device checks whether a request for content has been received (830). If a request for content has not been received (832), the host computing device continues to monitor for a request for content (830). However, if a request for content has been received (833), the requested content is retrieved by the host computing device (835) (e.g., content250ofFIG. 2).

The host computing device then sends the requested content to the handheld wireless display device (840). After the requested content is sent, the host computing device enters a reduced power state by calling a system-level function (855). Such a system-level function may be called by the software application running on the host computing device.

Alternatively, as illustrated inFIG. 8B, after sending the requested content to the handheld wireless display device (840), the host computing device may continue to monitor for a command. The host computing device checks whether a sleep command has been received (850). If a sleep command has not been received (852), the host computing device continues to monitor for a sleep command (850). However, if a sleep command has been received (853), the sleep command triggers the host computing device to enter a reduced power state by calling a system-level function (855).

Further, as illustrated inFIG. 8C, not only may the host computing device monitor for a sleep command (850), but the host computing device also may monitor for a command for further content (845). After sending the requested content to the handheld wireless display device (840), the host computing device may continue to monitor for a command. The host computing device checks whether a request for content has been received (845). If a request for content has been received (847), the requested content is retrieved by the host computing device (835) and the method continues as described above. However, if a request for content has not been received (848), the host computing device checks whether a sleep command has been received (850). If a sleep command has not been received (852), the host computing device continues to monitor for a command. However, if a sleep command has been received (853), the sleep command triggers the host computing device to enter a reduced power state by calling a system-level function (855).

FIG. 9is a high level software diagram indicating how the handheld wireless display device100may be used to control and manage various hosts225through a user interface. A software stack900includes a device application browser901which may run on top of the kernel of an operating system (OS), such as a Linux kernel902, drawing primitives, such as those provided by a Direct FB (DirectFB) stack903, and a graphical tool kit, such as a Gimp Tool Kit (GTK) window tool kit904. The device application browser901allows a user to access application software for handheld wireless display device100through an icon and menuing interface. This typically consists of custom code written for the particular handheld wireless display device100.

The OS902is ported to run on the processor in the handheld wireless display device100, such as the OMAP 3500 series ARM/DSP shown inFIG. 5. The kernel level902otherwise provides standard operating system functions. The drawing primitives layer903may be a somewhat thin graphical library that provides for graphic acceleration input device handling and abstraction integrated windowing system. The end result is a graphical user display910which has various applications available to the user, such as Bluetooth™ discovery911, a calculator912, media player913and a settings interface914.

Applications running within the context of the device application browser901may include a speech input921, a Virtual (Desktop) Network client922, and a web browser923. Virtual Network is a system that allows a personal computer (PC) to be controlled remotely. It does this by exporting an entire screen display to another device in the form of a bitmap. This bitmap is wrapped in a network protocol and received by the device and simply displayed. Similarly, any mouse movements or keyboard entry data detected by the local device are passed directly to the remote PC to be acted upon.

The speech command interface921provides or allows for voice input commands to control the application browser901. Thus, for example, a user may say the word “calculator” which is detected by the speech device, which causes the operating system902to launch the calculator application. In general, text labels displayed next to on-screen buttons or icons within the context of the application browser indicate a spoken word which activates the corresponding button. Digital inputs (e.g., MIM diodes, Hall effect sensors, accelerometers and switches as illustrated inFIGS. 1B, 1C, 4 and 5) also may be used to navigate and select menu functions allowing for full control and editing of applications and associated data.

Discovery application911, as will be understood shortly, allows not only for discovery of neighboring Bluetooth™ devices but also connecting them through to the application browser level. For example, shown in the example user display910is the fact that there are presently two connected devices, including a desktop computer927and a Blackberry™928. The devices927,928have been discovered through operation of the discover application911. This may be, for example, initiated on first power up of the handheld wireless display device100or by a user manually initiating a Bluetooth™ discovery process. The Bluetooth™ device discovery proceeds as per the Bluetooth™ specification, reporting any new Bluetooth™ layer devices as they are connected at a physical layer.

At this point, however, additional functionality is provided to permit communication with the Bluetooth™ devices at a network level. In particular, a client927,928is told to open a special port on a local host address that is local to the handheld wireless display device100. This device port acts as a proxy, always looking for such requests. When a request is received, it reports back an available network level address (i.e., such as a TCP/IP address) to be used by an individual device927,928for network level communication.

FIG. 10illustrates hardware interface functionality also provided by the browser application901ofFIG. 9which may receive and/or control various hardware functions on the handheld wireless display device100. Such functions may include handheld wireless display device detection1001, battery status1002, output device adjustment, such as headset button1003, speaker volume1004, microphone volume1005, media streaming functions1006, frame buffer switching1007, device drivers, and like functions.

FIG. 11illustrates a Bluetooth protocol stack implemented in the Bluetooth link237ofFIG. 2, with the addition of a special proxy function. The Bluetooth™ layer does provide for discovery of Bluetooth™ devices1100as in any standard Bluetooth™ device. However, handheld wireless display device100connected1110also provide for protocol information permitting data exchange with such devices1112. It may also connect to other types of headset devices1120, such as telephone headset devices which may provide for handling of incoming calls1122and outgoing calls1124.

FIGS. 12A-12B and 13show more detail of the proxy functionality provided by the Bluetooth™ interface237.

FIG. 12Aillustrates a traditional approach involving multiple direct TCP-layer connections to data sources. For example, each application running in the context of application browser901ofFIG. 9, such as a speech recognition application921, virtual network client922, and a web browser client923, might each require one or more TCP connections to the data sources provided by host computing devices225′. Traditional systems involve multiple direct TCP connections to data sources.

FIG. 12Billustrates how, although Bluetooth™ itself does not provide any direct connection to the Internet350or other high layer networks, a connection between the handheld wireless display device100and the Internet350may be supported by a proxy1230via an Internet enabled host computing device225. Bluetooth™ cannot connect directly to Internet; it must be proxied via an Internet enabled device. Thus, for example, applications such as the web browser923typically require host computing devices225to act as a networking proxy.

FIG. 13illustrates a preferred arrangement in which a single Bluetooth™ link237supports multiple applications921-923. The multiple application921-923require that the single Bluetooth™ connection237support multiple sockets, such as Transmission Control Protocol (TCP) connections. For example, while each application921-923might otherwise require multiple TCP connections, instead the Bluetooth™ proxy layer1310added between the standard Bluetooth™ layer and regular TCP protocol layer funnels the multiple requested TCP connections onto a single socket. The single socket provided by Bluetooth™ link237then transports the multiple connections to the host computing device225.

A similar inverse functionality1318provided on the host computing device side225to unravel packets to their respective connection921′-923′.

While Bluetooth™ itself does allow for multiple connection sockets between a host and client, many mobile phone operators impose a single connection limit. Thus, a single connection limit must be observed in many instances. This permits not only greater security, but avoids the possibility of having a wireless device be swamped with Bluetooth™ connection requests.

This approach also permits a standard web browser application923, for example, to operate without requiring modification to its use of TCP sockets. Thus, the operation of the Bluetooth proxy1310provided on the handheld wireless display device100and proxy function1318provided on the host computing device225insulate the applications921-923running within application browser901and also insulate the applications running on host computing device225from such modified socket functionality. For example, a virtual network running on a host computing device225now need not be modified.

FIG. 14illustrates device drivers provided to insulate the device application browser901from having to know specifics of content format for particular host devices. Thus, for example, a Blackberry server1401is provided for a Blackberry host225b, and a Windows Vista server1402is provided for a Windows machine host225c. This allows the user interface specifics for particular hosts computing devices225to be presented as a generic interface to the handheld wireless display device100, The servers1401,1402provide at least two functionalities, including the Bluetooth™ proxy functionality1318ofFIG. 13(i.e., unpacking TCP channel data into multiple required channels) and a content server.

FIG. 15illustrates processing of device content by the servers1401,1402ofFIG. 14. These may include a content format piece for each type of respective content including email inbox1501, contact list1502, stock ticker1503, media browser1504and the like. Each of these server functionalities1501-1504reformats its content using a page markup language. The page markup language may then be interpreted by the content browser901on the handheld wireless display device. The content browser901may now interpret the page markup language generically to fit the various requirements of the handheld wireless display device100.

In alternate embodiments, a function such as a Microsoft Windows SideShow™ may take formatted content from a Windows device and format it according to SideShow requirements. Microsoft Windows SideShow is a technology introduced with the Windows Vista release of the Microsoft™ operating system that enables Windows PC to drive a variety of auxiliary display devices connected to a main PC. These devices may be separate from or integrated in to the main PC, for example, and display embedded on the outside of a laptop lid, etc.

With the virtual network and/or Microsoft Windows SideShow™ functionality, the handheld wireless display device100may also become a “chameleon”, in effect taking on the same user screen, same graphical user interface, and familiar user control of the host computing device225. Even if the handheld wireless display device100accepts several host computing devices225at the same time (i.e., a blackberry, a cell phone, and a PC), a user is permitted to switch between the host devices. Each time the user makes such a switch, the user may see and still recognize the familiar slave or host and device user screen, the same graphical user interface (GUI), and same familiar controls and commands.

It is thus now understood how content may be viewed by the handheld wireless display device100in different ways, all selectable by the user, including new applications written for the device itself; device applications, web applications, a web browser, etc., and Microsoft Windows SideShow™ applications, or native applications via a virtual network connection.

With the Bluetooth proxy support, the effect of pushing through original hosted device GUI interface, screens, command and control interfaces, may be supported for multiple devices at the same time.

Various other modifications and adaptations may be made to the handheld wireless display device100as shown and described above. For example,FIGS. 1A-1Eillustrate a “single-eye” or monocular embodiment. However, a binocular arrangement with two displays is also possible. In such biocular example embodiments, an inter-pupillary distance (IPD) adjustment device may be included. With the IPD adjustment device, the requirements for optics may be relaxed. In return, other optical characteristics such as distortion may be improved so that the resolution is good across the entire plane of the image. The eye relief may be fairly large so that one wearing eyeglasses may use the unit comfortably.

Further, after wide acceptance, device makers may incorporate the microdisplay into their own devices. For example, cell phone or laptop or Mobile Internet Devices (e.g., the Apple iPhone) may converge to such a device. Such devices might incorporate the viewing unit as a removable or non-removable element to support a secondary “large image” experience (similar to the regular TFT screen of 10 inches or more) in a small form factor.

In some instances and for some users, it may not be possible or comfortable to hold the handheld wireless display device100in one's hand for long term viewing, such as when watching a movie. In those instances, the handheld wireless display device100may be placed on a stand or may be tied to a head band, etc.