# Patent

## Title
Portable high speed communication device

## Abstract

A host computer system which receives information, rasterizes it, compresses it and transmits it to a portable device which decompresses the image to display it on a screen. The image can be decompressed in whole or in parts to be viewed as the user scrolls through the image. An electronic touch screen keyboard is featured, which is used to input text characters in a text area on the screen of the device. Thereafter, text is transmitted to specific areas on a virtual browser in the host computer as a string of characters, or individually, with refreshed images of the virtual browser sent back to the device for each transmission. The host computer system is also capable of translating locations on the touch screen of the device into text characters or commands.

## Background
BACKGROUND OF THE INVENTION
1. Field of the Invention
The invention relates to a host computer system, which receives information, rasterizes it, compresses it and transmits it to a portable device which decompresses the image to display it on a screen. The result is a cost effective Internet access solution which allows interaction between the device and a host computer.
2. Description of the Prior Art
The background of the present invention includes U.S. Pat. No. 5,925,103, Internet Access Device, which describes an improved Internet access system, vastly different from the present invention. Other prior art would include palm top computers, hand-held computers and cellular telephones that have limited processing power due to design restrictions. Thus, these computers are much slower for accessing the Internet and World Wide Web.
SUMMARY OF THE INVENTION
The present invention relates to a portable high speed Internet access device that can access the internet and World Wide Web as a wireless device.
A principal embodiment has a Web server connected to the Internet. This server contains a virtual browser which takes the image displayed in the browser and converts this image into a bit map which is compressed, and communicates via telephone lines to a cellular telephone. The cellular telephone is connected to the high speed internet access device of the invention commonly referred to as a PDA (Personal Digital Assistant) which is comprised of a display screen, battery and related micro-electronics. This enables the PDA to receive, decompress and view the bit map image sent from the virtual browser, and more importantly, through cellular phone connectivity to be able to input data from the PDA directly onto the server. In particular, the host computer or server receives vector information or compressed data in the form of HTML, JPEG, etc., which is displayed on a web page. The virtual browser virtually displays a virtual image on the server. That image, in whole or parts, is recompressed and sent to the PDA. The recompressed data format sent to the PDA, is not necessarily in the same format as the compressed data format first received by the server.
Another embodiment of the invention involves the server receiving vector information such as HTML or text and then rasterizing it to bit map format. It can then shown in memory through the virtual browser and is recompressed through a “loss less” method and sent to the PDA.
One embodiment of the invention comprises the PDA with an electronic touch screen keyboard, which remains invisible and only appears on a portion of the display screen when called upon by touching the keyboard icon. The entire display screen is covered with a transparent touch panel, which is essentially a matrix array of electrodes, which can detect the location of any pressure points applied to it. The keyboard disappears when touching a minimizing icon, revealing a refreshed image of the virtual browser. When the user is viewing the image displayed by a virtual browser on the PDA, and a text message needs to be entered at a specific location on the display, the user would have to point to this specific location, and pressing on the display screen's touch panel with a stylus tip, the cursor appears at that exact location, ready to input text. The keyboard would then be activated by pressing on the keyboard icon with a stylus tip, whereby a miniature keyboard layout would appear at the bottom of the display screen, with a portion of the display screen above the keyboard layout reserved to view text messages generated by the user, to be inputted in the image of the virtual browser at a later time. As the user enters text characters by pressing on various locations of the touch panel above the keyboard layout, the text message appears in the area above the keyboard, and when the user is finished inputting text, pressing on the send or return icons would send the entire text message to the specific location on the web page as viewed through the virtual browser on the server. The PDA device translates strokes on the touch panel above the keyboard layout into characters, and the message is sent as a string of characters. A refreshed portion of virtual browser is sent back to the PDA, which displays the specific portion of the virtual browser that text was entered into, to verify that text was inputted at the correct location.
In a further embodiment of the invention, an automatic keyboard feature is available to the user when scrolling through the image of the virtual browser on the PDA, and a text message is to be entered at a specific location. The user would point at the desired location to enter text and a keyboard layout automatically appears ready for text input. As text is typed, the text message appears in the area above the keyboard layout, and after the send or return icons are selected, the keyboard layout disappears and the message is sent to the specific location on the virtual browser.
In another embodiment, which communicates with the virtual browser in a similar fashion, the method of text transfer to the virtual browser is different. The display screen would have the keyboard layout at the bottom, with two smaller areas above, one of which displays text characters comprising the message being typed, and the other area displaying a background portion of the virtual browser. For each text character that is selected and appears in the text area, a message is sent to the virtual browser that tells which character is typed, and that specific text character is entered in the virtual browser in the portion of the image selected for text input. A refreshed portion of virtual browser is sent back to the PDA, which displays the specific portion of the virtual browser that text was entered into, to verify that text was inputted at the correct location.
In a further embodiment, which communicates with the virtual browser in a similar fashion, the method of text transfer to the virtual browser is different. The display screen would have the keyboard layout at the bottom, with two smaller areas above, one of which displays text characters comprising the message being typed, and the other area displaying a background portion of the virtual browser. For each text character that is inputted in the text window, a message is sent to the virtual browser informing of the specific matrix location selected on the keyboard window. This matrix location is translated at the server end to determine what character is selected as the mapped layout of each character on the PDA keyboard is known, and this character entered in the virtual browser at the specific location selected. A refreshed portion of virtual browser is sent back to the PDA, which displays the specific portion of the virtual browser that text was entered into, to verify that text was inputted at the correct location.
In another embodiment of the invention, an external keyboard is featured which is used to enter text characters as required. The keyboard interface can be wired or wireless. When the user wishes to enter text in the virtual browser, the specific location is selected by pressing on the touch panel and a text window appears in a portion of the display screen ready for text input. The keyboard connected to the PDA is then used to input text, and when the enter key is pressed, the message gets sent and the text window disappears. The text message is entered in the virtual browser at the specific location selected. A refreshed portion of virtual browser is sent back to the PDA, which displays the specific portion of the virtual browser that text was entered into, to verify that text was inputted at the correct location.
In other embodiments of the invention, the image displayed in the virtual browser is compressed at the server in various amounts by different methods before sending to the PDA device.
Different parts of the image are compressed in different ways. Parts of the image that is text image are compressed by G4 compression techniques. Other parts of the image containing pictures are compressed by JPEG compression techniques. The entire image is converted to a raster image but different parts are converted at different depths of color. Text portions can be compressed by “loss less” techniques, which will result in complete image reproduction with no errors in text upon decompression, whereas pictures can be compressed by “lossy” techniques which upon decompression give a slightly degraded image quality for each compression. An image with black and white text and color graphics portions would be converted to a raster image, but only the text part of it reduced to black and white 1 bit and other graphics parts to 24 bit or other color raster images. Hence different parts of the image can be converted or reduced to different depths of color to resemble an actual web page with picture in color and text in black and white. The depths of color can be set by the user depending on the quality of image required, which affects the speed of refreshing the screen which also depends on the amount of graphics displayed. Text and pictures from a web page would get compressed separately at the server and then sent to the PDA. In the PDA, text or black and white portions of the image get decompressed first and displayed on the screen. Color portions get decompressed and are overlain in the image on the screen shortly after, enabling the user to view black and white portions of the image in advance.
A further embodiment would take the entire image to be viewed including all text and pictures and convert it to 1 bit raster. This file is compressed by G4 or other loss less compatible methods and sent to the PDA. When received by the PDA, this file is decompressed for the user to view the image, and the black and white portions are displayed first which can be done quickly and the graphics portions are overlaid progressively with color. This enables an image to be viewed quickly without the fine details of graphics, which follow moments after.



BRIEF DESCRIPTION OF THE DRAWINGS
The invention is described in more detail below with respect to an illustrative embodiment shown in the accompanying drawings in which:
FIG. 1 illustrates elements in the host computer, which communicates with a remote user and the device of the invention.
FIG. 2 illustrates the image to be displayed compared with the displayable area of a browser window.
FIG. 3 shows a typical subdivision of the image to be displayed.
FIG. 4 illustrates file formats received and sent by the host computer.
FIG. 5 illustrates the displayable area of the device with respect to portions of the image, which are sequentially decompressed prior to viewing.
FIG. 6 illustrates the display screen of the device with a stylus tip used to select icons or other elements in the display.
FIG. 7 illustrates the display of the device containing a keyboard layout.
FIG. 8 illustrates the display of the device containing a keyboard layout and a text area.
FIG. 9 illustrates the device interfaced with an external keyboard layout.
FIG. 10 illustrates the display of the device containing a keyboard layout with saved files represented by icons.
FIG. 11 illustrates icons on the device and icons on the host computer.
FIG. 12 illustrates a device with an external keyboard according to one embodiment of the present invention.



DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
To facilitate description, any numeral identifying an element in one figure will represent the same element in any other figure.
The principal embodiment of the present invention aims to provide a device that allows a user to access the Internet or the World Wide Web (WWW), which is a device similar to a palm top computer. It is a further aim of the present invention, to offer a cost-competitive device. It is a further aim of the present invention, to increase the speed of refreshing the screen when the user clicks on a link and commands another page to be displayed.
Currently, existing palm top devices such as the Palm Pilot VII and Windows CE type devices contain an operating system, and within the operating system a mini-browser to interpret information received from the WWW or Internet and then display this information on the screen. This requires a powerful microprocessor, which is not advantageous in conserving power for portable applications and also minimizing costs.
With reference to application Ser. Nos. 09/496,172, 09/501,585, 09/504,809, 09/504,808 and 09/504,807 whose embodiments are incorporated herein, the present invention discloses a method and system of storing previously viewed pages on the device. Thus a user is able to utilize a pointer or stylus tip to select and press a “back” button or a “forward” button to view previously accessed pages, and which pages are stored directly in the device. The invention further discloses a method of enabling the used to scroll to a specific area thereby initiating downloading in that area, or by the user clicking on a specific area to initiate the downloading.
The principal embodiment of the present invention is disclosed in FIG. 1. A host computer 1 is depicted which is connected to the Internet, and that host may also be a Web server. Running in the host computer, is a Web server program 2. When a remote user 3 requests to view a Web page (or electronic message etc.) the Web server software receives HTML, JAVA, or other types of information and transmits this information to another software, the Browser Translator 4. This software translates the information, (i.e. the entire image comprising graphics and text) received in the form of HTML, Java, etc. (as information may be gathered from different sources) and translates it to a black and white bit map or raster image. In another embodiment, the software translates the information into a raster or color image. The image 5, as shown in FIG. 2, contains the information that would normally be displayed on a single Web page. The translation program therefore, also acts as a virtual browser 6. As can be seen in FIG. 2, the image 5 to be displayed in a browser window 6 is usually larger than the displayable area of the browser window 6. The cellular telephone 12 of FIG. 1 is connected to the high speed internet access device 18 of the invention commonly referred to as a PDA (Personal Digital Assistant) which is comprised of a display screen 19, battery and related micro-electronics. This enables the PDA to receive, decompress and view the bit map image sent from the virtual browser 6, and more importantly, through cellular phone connectivity to be able to input data from the PDA directly onto the server. In particular, the host computer or server receives vector information or compressed data in the form of HTML, JPEG, etc., which is displayed on a web page. The virtual browser virtually displays a virtual image on the server. That image, in whole or parts, is recompressed and sent to the PDA. The recompressed data format sent to the PDA, is not necessarily in the same format as the compressed data format first received by the server 1, as illustrated in FIG. 4. For example, the incoming data from a Web page may be in the form of JPEG which is decompressed and displayed on the virtual browser. This data is recompressed and sent to the PDA but can be in the form of TIFF G4 or other formats, and not necessarily JPEG as initially received.
Another embodiment of the invention involves the server receiving vector information such as HTML or text and then rasterizing it to bit map format. It can then shown in memory through the virtual browser and is recompressed through a “loss less” method and sent to the PDA.
The image 5 of FIG. 2 is further divided into sections 7, 8, 9, and 10, as shown in FIG. 3. The image is divided after the bitmap or raster is created. The reason for the division (as will be explained later) is for the purpose of display priority on the user's display. The image 5 is then sent to another program 11 running on the host computer 1 (FIG. 1), which compresses the image using a loss-less compression method. The compression method may be group 3 or group 4, or another method. The programs 4 and 11 can have multiple instances running simultaneously on the host server for the purpose of connecting to multiple users. The compressed image, after being processed by program 11, is sent to the user, using a protocol in which information may be broken down into packets.
The information is received by the device 18 of the invention in FIG. 5 which has the ability to display a monochrome image 20, in its display window 19. The information is decompressed and displayed in the order of priority such that part of image 7 of FIG. 5, which substantially or completely covers the displayable area 19 of the device, is decompressed and displayed first and then sequentially the portions 8, 9 and 10 of the image are decompressed, and stored in an internal memory of the device to be displayed later when the user scrolls up, down, or sideways to these parts of the image.
In a further embodiment, the information received from the server by the device 18 of the invention in FIG. 5 remains compressed, and only the area viewed by the device is decompressed, since the area of a web page to be viewed is larger than the device's display area. As the user scrolls up, down or sideways, only the parts of the image to be displayed are decompressed prior to viewing.
A CPU resident in the device therefore has the ability to decompress a bit map or raster image that may be larger than the size of the display and allow the user to traverse this bit map or raster image. The primary method of traversing the image is through conventional scroll bars positioned at the sides of the image. The resident CPU on the device has no ability to determine which part or parts of the image, that is being displayed, represent links to other Web pages etc. Thus, the translator program 4 (FIG. 1) translates the image in the virtual browser 6 such that the words that represent links on the page 5 (FIG. 2) are translated to be slightly bolder. The user may therefore consider text that is bold to be links.
One embodiment of the invention comprises the PDA 18 of FIG. 6 with an electronic touch screen keyboard, which remains invisible and only appears on a portion of the display screen when called upon by touching the keyboard icon 21. The entire display screen 19 is covered with a transparent touch panel, which is essentially a matrix array of electrodes, which can detect the location of any pressure points applied to it. The keyboard disappears when touching a minimizing icon, revealing a refreshed image of the virtual browser. When the user is viewing the image displayed by a virtual browser on the PDA, and a text message needs to be entered at a specific location on the display, the user would have to point to this specific location, and pressing on the display screen's touch panel with a stylus tip 22, the cursor appears at that exact location, ready to input text. The keyboard would then be activated by pressing on the keyboard icon 21 with a stylus tip 22, whereby a miniature keyboard layout 23 would appear at the bottom of the display screen 19 of FIG. 7, with a portion of the display screen 24 above the keyboard layout reserved to view text messages generated by the user, to be inputted in the virtual browser at a later time. As the user enters text characters by pressing on various locations of the touch panel on the keyboard layout, the text message appears in the area 24 above the keyboard, and when the user is finished inputting text, pressing on the send or return icons would send the entire text message to the host computer at the specific location on the web page, at which time the server inserts text in the text area or text box in the virtual browser. The virtual browser takes a refreshed image of the web page, rasterizes or draws it in its memory. This refreshed portion of the virtual browser is sent back to the PDA as an image, which displays the specific portion of the virtual browser that text was entered into, to verify that text was inputted at the correct location.
The pointing device may be a touch screen or tracking ball, etc. As soon as the user clicks on part of an image, the shape of the pointer changes from an arrow to an hourglass. A message is sent to the host computer, transmitting the location of the clicked down event. A program 14 of FIG. 1 interprets the message and provides a virtual click down in the virtual browser created in the translator program 4. If the user has pressed or clicked in an area of the image that does not represent a link or text box, a message is dispatched to the device which immediately changes the hourglass shape of the pointer back to an arrow (in the case of a touch screen, from an hour glass to nothing). Further to this, if the user has pressed or clicked on a part of the image which represents a link, a new Web page is extracted from the Internet or WWW, translated by translator program 4 of FIG. 1 into a bit map or raster, and compressed by compression program 11 and dispatched to the device where a new page is displayed. In a further embodiment, the image 5 of FIG. 2 may be continuously updated and translated and sent to the device where it is continuously being refreshed. This occurs once every few seconds.
In a further embodiment of the invention, an automatic keyboard feature is available to the user when scrolling through the image of the virtual browser on the PDA, and a text message is to be entered at a specific location. The user would point at the desired location to enter text and a keyboard layout 23 of FIG. 7 automatically appears ready for text input. How this happens is that a message gets sent to the host computer which knows the user has selected an area which can accept text, whereby the host responds with a message to the PDA device that it is ready to accept the keyboard entry sequence, at which time the PDA automatically pulls up the keyboard layout which appears at the bottom of the display screen 19. As text is typed, the text message appears in the area 24 above the keyboard layout, and after the send or return icons are selected, the keyboard layout disappears and the message is sent to the specific location on the virtual browser. A refreshed portion of the virtual browser is sent back to the PDA 18 as an image, which displays the specific portion of the virtual browser that text was entered into, to verify that text was inputted at the correct location.
In another embodiment, which communicates with the virtual browser in a similar fashion, the method of text transfer to the virtual browser is different. The display screen 19 of FIG. 8 would have the keyboard layout 23 at the bottom, with two smaller areas above, one being a text area 25 which displays text characters comprising the message being typed, and the other area 26 displaying a background portion of the virtual browser. For each text character that is selected and appears in the text area 25, a message is sent to the virtual browser 6 that tells which character is typed, and that specific text character is entered in the virtual browser in the portion of the image selected for text input. A refreshed portion of the virtual browser is sent back to the PDA 18 as an image, which displays the specific portion of the virtual browser that text was entered into, to verify that text was inputted at the correct location.
In a further embodiment, which communicates with the virtual browser in a similar fashion, the method of text transfer to the virtual browser is different. The display screen 19 of FIG. 8 would have the keyboard layout 23 at the bottom, with two smaller areas above, one is a text area 25 which displays text characters comprising the message being typed, and the other area 26 displaying a background portion of the virtual browser. For each text character that is inputted in the text area 25, a message is sent to the virtual browser 6 informing of the specific matrix location selected on the keyboard window. This matrix location is translated at the server end to determine what character is selected as the mapped layout of each character on the PDA keyboard is known, and this character entered in the virtual browser at the specific location selected. A refreshed portion of the virtual browser is sent back to the PDA 18 as an image, which displays the specific portion of the virtual browser that text was entered into, to verify that text was inputted at the correct location.
In another embodiment of the invention, an external keyboard 27 of FIG. 9 is featured which is used to enter text characters as required. The keyboard interface 28 can be wired or wireless. When the user wishes to enter text remotely in the virtual browser 6 (e.g., as illustrated in FIG. 11), the specific location for text entry is selected by pressing on the touch panel 19 directly over the text entry location, and a text window 29 appears in a portion of the display screen ready for text input. The text window is equipped with conventional scroll bars 30 which enable the user to have a wider viewing access, since the entire image sent from the virtual browser is decompressed and stored in the PDA 18. The keyboard connected to the PDA is then used to input text, and when the enter key is pressed, the message gets sent as a string of text characters and the text window 29 disappears. The text message is entered in the virtual browser at the specific location selected. A refreshed portion of the virtual browser is sent back to the PDA as an image, which displays the specific portion of the virtual browser that text was entered into, to verify that text was inputted at the correct location.
In a further embodiment of the invention, an external keyboard 27 of FIG. 12 is also featured which is used to enter text characters as required. The keyboard interface 28 can be wired or wireless. When the user wishes to enter text remotely in the virtual browser 6 (e.g., as illustrated in FIG. 11), the specific location for text entry is selected by pressing on the touch panel 19 of the PDA 18 directly over the text entry location. For each text character that is directly inputted through the keyboard, a message is sent to the virtual browser 6 (e.g., as illustrated in FIG. 11) that tells it which character is typed, and that specific text character is entered in the virtual browser in the portion of the image selected for text input. A refreshed portion of the virtual browser is sent back to the PDA 18 as an image, which displays (e.g., in area 26) the specific portion of the virtual browser that text was entered into, to verify that text was inputted at the correct location.
In other embodiments of the invention, the image displayed in the virtual browser is compressed at the server in various amounts by different methods before sending to the PDA device. Different parts of the image are compressed in different ways. Parts of the image that are text images are compressed by G4 compression techniques. Other parts of the image containing pictures are compressed by JPEG compression techniques. The entire image is converted to a raster image but different parts are converted at different depths of color. Text portions can be compressed by “loss less” techniques, which will result in complete image reproduction with no errors in text upon decompression, whereas pictures can be compressed by “lossy” techniques which upon decompression give a slightly degraded image quality for each compression. An image with black and white text and color graphics portions would be converted to a raster image, but only the text part of it reduced to black and white 1 bit and other graphics parts to 24 bit or other color raster images. Hence different parts of the image can be converted or reduced to different depths of color to resemble an actual web page with picture in color and text in black and white. The depths of color can be set by the user depending on the quality of image required, which affects the speed of refreshing the screen which also depends on the amount of graphics displayed. Text and pictures from a web page would get compressed separately at the server and then sent to the PDA. In the PDA, text or black and white portions of the image get decompressed first and displayed on the screen. Color portions get decompressed and are overlain in the image on the screen shortly after, enabling the user to view black and white portions of the image in advance. At the browser, the priority of decompression is determined by the depth of color, with the minimum depth being decompressed first.
A further embodiment would take the entire image to be viewed including all text and pictures and convert it to 1 bit raster. This file is compressed by G4 or other loss less compatible methods and sent to the PDA. When received by the PDA, this file is decompressed for the user to view the image, and the black and white portions are displayed first which can be done quickly and the graphics portions are overlaid progressively with color. This enables an image to be viewed quickly without the fine details of graphics, which follow moments after.
In another embodiment of the invention, the user may save and store the rasterized Web pages in the memory of the device, and therefore be able to view offline the stored rasterized pages, at a later time. The advantage of this embodiment is that the user does not have to connect to the host server to view the saved Web pages.
In a further related embodiment, when not connected to the server the user can generate multiple text files which are stored in internal memory on the PDA device 18 of FIG. 10, which is equipped with flash RAM, a microprocessor, and related micro electronics. This is particularly useful in creating or responding to emails or other text related documents that are lengthy and may consume a lot of time to respond to. At a later time when the user is connected to the server, which has internet connection, the user can access an email account in which emails have to be responded to, or new ones sent. The exact location where text is to be entered in the virtual browser is selected with the stylus tip and the keyboard icon selected (or the keyboard appears automatically). The keyboard layout 23 appears at the bottom of the display screen 19 and a list of all saved files is displayed above this, represented by icons 31. Pointing on each icon 31 allows the user to review each saved file in the area 32 and when the enter or send icon is pressed on the keyboard, the selected file is sent to the exact location on the virtual browser. A refreshed portion of the virtual browser is sent back to the PDA as an image, which displays the specific portion of the virtual browser that text was entered into, to verify that text was inputted at the correct location. The user can then send the file as an email or store it on the server as done conventionally.
In another embodiment of the invention, the server 1 contains the virtual browser 6 displaying part of a web page 34 such that the virtual browser contains some of the icons 35 displayed in the display screen 19 of the PDA 18, as illustrated in FIG. 11. These icons on the virtual browser may not be the same icons in the display screen of the PDA, but there are different ways to communicate between the PDA icons and the virtual browser's icons in conjunction with menu driven commands. The PDA may contain more icons than displayed on the virtual browser, so that an icon selected on the PDA screen may represent a command on the virtual browser not represented by an icon. In this particular embodiment, the PDA does the translation of which command is executed when a stylus is used to select an icon on the display screen's touch panel, and a message is sent to the virtual browser to execute that command at specific locations on the virtual browser. For example, pressing the “back” icon on the PDA 18 is translated by the PDA and this command linked to the “back” icon on the virtual browser 6, which can be in a different location. The PDA contains in its memory a mapped location address of all icons and menu commands on the server, so when an icon is selected on the display screen of the PDA, the PDA would link to the appropriate command or commands on the server, which are immediately executed. A single command executed from the PDA 18 can also represent a sequence of commands on both the PDA and the virtual browser 6. For example, when the address icon is selected on the PDA 18 a text box 36 appears below and the keyboard automatically appears on the PDA display screen 19, ready to input data into the text box. The PDA 18 would link the address in the text box 36 to the address box on the virtual browser and all text entered on the PDA gets inputted on the virtual browser. A single command executed from the PDA 18 can also be linked to menu driven commands on the virtual browser 6. For example, when the user wishes to change the font size on the PDA display screen which may not always be suitable for a variety of users, the font size icon 37 is selected from the display screen 19 and a link is made to pre-selected font sizes on the menu items on the server. Hence, selecting the font size icon on the PDA screen would change the size of the font displayed on both the server and the PDA. Repeatedly selecting the font size icon takes the user progressively through all the pre-selected font sizes.
In another related embodiment, the server 1 of FIG. 11 does all the translation of commands executed by the PDA 18 of the invention. Hence, the server has a mapped location of all icons on the PDA display screen 19. When a command is executed by pressing on the touch screen of the PDA, a message is sent to the server informing of the specific location selected. The server would translate this location to a command as intended by the user. A refreshed portion of the virtual browser is sent back to the PDA 18 as an image.
In another embodiment of the present invention, images are only refreshed when an event occurs such as a mouse down event on a link or in a text box.
In a further embodiment only those portions of the image that changes may be transmitted from the host computer to the PDA device. Other images in the virtual browser that are continuously changing, such as banner advertisements, may be the only other images sent to the PDA device as they change.
The PDA device only contains enough memory to store the current displayable page. When the user presses a back or forward button, a message is sent to the host server, and the host server sends the reference page. The back and forward buttons etc. may be hard wired into the PDA device, or may be part of the display area.
Further to this, parts of the image representing buttons (and other elements) on the virtual browser may be sent as part of the compressed image and buttons such as forward and back may be treated the same way as links are handled as previously described. In the principle embodiment therefore the back and forward buttons are hard coded as part of the device.
In another embodiment, the PDA device comprises a modem that permits the device to connect to a cellular telephone in digital format.
In another embodiment, the connection to the cellular telephone is made through an analog modem connected to an ear jack of the cellular telephone.
In yet another embodiment of the present invention, the modem is replaced by an analog modem that has the capability to be connected to a landline providing a standard 56 kbps-type connection.
Further embodiments may provide connections through ISDN, cable modems etc.
In a further embodiment, the PDA device may contain a large screen to be used in a fashion similar to a home Internet appliance.
The invention has been described in detail with particular reference to the preferred embodiments thereof, but it will be understood that variations and modifications can be effected within the spirit and scope of the invention.

## Claims

1. A method implemented on a server to serve documents, the method comprising:
receiving, at the server from a remote device, a request for a document, the document including text and one or more links;
transmitting, from the server, a request over a network to have the document delivered to the server and receiving the document, at the server, in response to the request transmitted from the server;
rendering, at the server and for displaying on a screen attached to the remote device, an image of the entire document in response to the request, the image being larger than a screen area on the remote device available for displaying the document, the image including non-linkable graphical representations of the one or more links; and
sending, from the server to the remote device, a portion of the image in a compressed format as a response to the request for the document; and
receiving, at the server from the remote device, a message to indicate a location of a user input being received at the remote device relative to a location on the portion of the image displayed in the screen area.

2. The method of claim 1, wherein the document is retrieved from the Internet by the server in response to the request for the document from the remote device.

3. The method of claim 1, further comprising:
receiving, at the server from the remote device, a message to indicate a text input, the text input being received at the remote device relative to a location on the portion of the image displayed in the screen area;
entering, at the server, the text input into the document at a location corresponding to the location on the portion of the image displayed in the screen area to render a refreshed portion of the image; and
sending, from the server to the remote device, the refreshed portion of the image.

4. The method of claim 3, wherein the text input is received at the remote device from a touch screen keyboard; the message includes one or more matrix locations selected on the touch screen keyboard; and, the method further comprises:
determining, at the server, one or more text characters from the one or more matrix locations to enter the text characters into the document.

5. The method of claim 3, further comprising:
sending, from the server to the remote device, a message to accept keyboard entry in response to a determination that the document accepts text input at the location corresponding to the location on the portion of the image displayed on the screen.

6. The method of claim 5, wherein the message to accept keyboard entry causes the remote device to display a keyboard layout on the remote device.

7. The method of claim 1, wherein the image is in a plurality of sections rendered from the document; a first one of the plurality of sections is compressed in a first format; and, a second one of the plurality of sections is compressed in a second format.

8. The method of claim 7, wherein the first format is lossless; and, the second format is lossy.

9. The method of claim 8, wherein the first one of the plurality of sections is rendered from a text portion of the document; and, the second one of the plurality of sections is rendered from a graphics portion of the document.

10. The method of claim 7, wherein the first one of the plurality of sections and the second one of the plurality of sections have different color depths.

11. The method of claim 1, wherein the image rendered from the document comprises:
a first layer in a reduced color depth; and
one or more graphics portions with fine details to be overlaid over the first layer.

12. The method of claim 11, wherein the first layer is monochrome.

13. A method as in claim 1 wherein the rendering at the server renders display pixels to be displayed at the remote device such that the remote device does not render display pixels.

14. A method implemented on a portable device to access remote documents, the method comprising:
sending, from the device to a remote server, a request for a document, the document having vector information including text the request causing the remote server to transmit a further request over a network to have the document delivered to the remote server so that the remote server can render the image;
receiving, at the device, an image in a compressed format from the remote server, the image being rendered at the remote server from the entire document in response to the request, the image including a non-linkable graphical representation of at least one link;
storing the image in the compressed format on the device;
according to a user input to the device, selectively displaying only a portion of the image on a screen attached to the device according to the image stored on the device; and
receiving, at the device, a user input of a location on the portion of the image displayed on the screen;
transmitting, from the device to the remote server, a message to indicate the location of a user input relative to the location on the portion of the image displayed on the screen.

15. The method of claim 14, wherein the image comprises a plurality of sections; a first section of the plurality of sections that is not displayed on the device remains compressed on the device while one or more sections of the plurality of sections corresponding to the portion of the image displayed on the device are decompressed.

16. The method of claim 14, wherein said selectively displaying the portion of the image comprises:
scrolling the image on the screen at exclusive control of the device.

17. The method of claim 14, further comprising:
receiving, at the device, a text input relative to a location on the portion of the image displayed on the screen;
sending, from the device to the remote server, a message to indicate that the text input is to be entered into the document;
receiving, at the device from the remote server, a refreshed portion of the image, the refreshed portion of the image being rendered at the remote server after entering the text input into the document at a location corresponding to the location on the portion the image displayed on the screen; and
displaying the refreshed portion of the image on the screen.

18. The method of claim 17, wherein the text input comprises a string of text characters; and, the message is sent from the device to the remote server in response to receiving, at the device, a command to send.

19. The method of claim 18, wherein the text input is received at the device through one or more selections on a keyboard layout displayed on the screen; and, the command to send causes the keyboard layout not being displayed on the screen.

20. The method of claim 17, wherein the text input is a single text character; and, the message is sent from the device to the remote server in response to receiving, at the device, the single text character.

21. The method of claim 17, wherein the text input is received at the device from a touch screen keyboard; the message includes one or more matrix locations selected on the touch screen keyboard; and, the remote server determines one or more text characters from the one or more matrix locations to enter the text characters into the document.

22. The method of claim 17, further comprising:
receiving, at the device from the remote server, a message to accept keyboard entry when the remote server determines that the document accepts text input at the location corresponding to the location on the portion of the image displayed on the screen; and
displaying a keyboard layout on the screen in response to the message to accept keyboard entry.

23. The method of claim 14, further comprising:
receiving text inputs at the device;
storing text characters in a text file on the device according to the text inputs;
retrieving the text characters from the text file; and
sending, from the device to the remote server, a message to enter the text characters into the document on the remote server at a location corresponding to a location on a portion of the image displayed on the screen.

24. The method of claim 23, wherein the text inputs are received while the device is not in communication with the remote server.

25. The method of claim 23, wherein the text inputs comprise an electronic mail message; and, the document comprises a web page for sending the electronic mail message.

26. The method of claim 14, further comprising:
retrieving at least a portion of an image of a previously requested document from a memory of the device, the image of the previously requested document being previously received from the remote server and stored in the memory of the device in a compressed format; and
displaying at least the portion of the image of the previously requested document.

27. The method of claim 14, wherein the image rendered from the document is received at the device in a plurality of sections; a first one of the plurality of sections is compressed in a first format; and, a second one of the plurality of sections is compressed in a second format.

28. The method of claim 27, wherein the first format is lossless; and, the second format is lossy.

29. The method of claim 28, wherein the first one of the plurality of sections is rendered from a text portion of the document; and, the second one of the plurality of sections is rendered from a graphics portion of the document.

30. The method of claim 27, wherein the first one of the plurality of sections and the second one of the plurality of sections have different color depths.

31. The method of claim 30, wherein the device decompresses sections of the image for display on the screen in a priority according to color depth.

32. The method of claim 14, wherein the image rendered from the document comprises:
a first layer in a reduced color depth; and
one or more graphics portions with fine details to be overlaid over the first layer;
wherein the first layer is decompressed for display on the screen before the graphics portions are decompressed.

33. The method of claim 32, wherein the first layer is monochrome.

34. The method of claim 14, further comprising:
displaying a plurality of icons with at least a portion of the image on the screen; and
responsive to receiving a selection of one of the plurality of icons, transmitting from the device to the remote server a message to execute a command with respect to the document at the remote server.

35. The method of claim 34, further comprising:
determining at the device one or more commands from the selection;
wherein the message comprises the one or more commands.

36. The method of claim 34, wherein the message comprises information about the selection; and, the remote server determines the command from the information about the selection.

37. A method as in claim 14 wherein the remote server renders display pixels to be displayed at the device such that the device does not render display pixels.

38. A machine readable medium containing executable computer program instructions which when executed by a data processing system cause said system to perform a method implemented on a server to serve documents, the method comprising:
transmitting, from the server, a request over a network to have the document delivered to the server and receiving the document, at the server, in response to the request transmitted from the server;
receiving, at the server from a remote device, a request for a document, the document including text and one or more links;
rendering, at the server and for displaying on a screen attached to the remote device, an image of the entire document in response to the request, the image being larger than a screen area on the remote device available for displaying the document, the image including non-linkable graphical representations of the one or more links;
sending, from the server to the remote device, a portion of the image in a compressed format as a response to the request for the document; and
receiving, at the server from the remote device, a message to indicate a location of a user input being received at the remote device relative to a location on the portion of the image displayed in the screen area.

39. The medium of claim 38, further comprising:
receiving, at the server from the remote device, a message to indicate a text input, the text input being received at the remote device relative to a location on the portion of the image displayed in the screen area;
entering, at the server, the text input into the document at a location corresponding to the location on the portion of the image displayed in the screen area to render a refreshed portion of the image; and
sending, from the server to the remote device, the refreshed portion of the image.

40. The medium of claim 39, further comprising:
sending, from the server to the remote device, a message to accept keyboard entry in response to a determination that the document accepts text input at the location corresponding to the location on the portion of the image displayed on the screen.

41. The medium of claim 38, wherein the image is in a plurality of sections rendered from the document; a first one of the plurality of sections is compressed in a first format; and, a second one of the plurality of sections is compressed in a second format.

42. The medium of claim 41, wherein the first format uses a lossless technique; and, the second format uses a lossy technique.

43. The medium of claim 41, wherein the first one of the plurality of sections and the second one of the plurality of sections have different color depths.

44. The medium of claim 38, wherein the image rendered from the document comprises:
a first layer in a reduced color depth; and
one or more graphics portions with fine details to be overlaid over the first layer.

45. A medium as in claim 38 wherein the rendering at the server renders display pixels to be displayed at the remote device such that the remote device does not render display pixels.

46. A machine readable medium containing executable computer program instructions which when executed by a data processing system cause said system to perform a method implemented on a portable device to access remote documents, the method comprising:
sending, from the device to a remote server, a request for a document, the document having vector information including text the request causing the remote server to transmit a further request over a network to have the document delivered to the remote server so that the remote server can render the image;
receiving, at the device, an image in a compressed format from the remote server, the image being rendered at the remote server from the entire document in response to the request, the image including a non-linkable graphical representation of at least one link;
storing the image in the compressed format on the device;
according to a user input to the device, selectively displaying only a portion of the image on a screen attached to the device according to the image stored on the device; and
receiving, at the device, a user input of a location on the portion of the image displayed on the screen;
transmitting, from the device to the remote server, a message to indicate the location of the user input relative to the location on the portion of the image displayed on the screen.

47. The medium of claim 46, wherein the image comprises a plurality of sections; a first section of the plurality of sections that is not displayed on the device remains compressed on the device while one or more sections of the plurality of sections corresponding to the portion of the image displayed on the device are decompressed.

48. The medium of claim 46, wherein said selectively displaying the portion of the image comprises:
scrolling the image on the screen at exclusive control of the device.

49. The medium of claim 46, further comprising:
receiving, at the device, a text input relative to a location on the portion of the image displayed on the screen;
sending, from the device to the remote server, a message to indicate that the text input is to be entered into the document;
receiving, at the device from the remote server, a refreshed portion of the image, the refreshed portion of the image being rendered at the remote server after entering the text input into the document at a location corresponding to the location on the portion the image displayed on the screen; and
displaying the refreshed portion of the image on the screen.

50. The medium of claim 49, further comprising:
receiving, at the device from the remote server, a message to accept keyboard entry when the remote server determines that the document accepts text input at the location corresponding to the location on the portion of the image displayed on the screen; and
displaying a keyboard layout on the screen in response to the message to accept keyboard entry.

51. The medium of claim 46, further comprising:
receiving text inputs at the device;
storing text characters in a text file on the device according to the text inputs;
retrieving the text characters from the text file; and
sending, from the device to the remote server, a message to enter the text characters into the document on the remote server at a location corresponding to a location on a portion of the image displayed on the screen.

52. The medium of claim 46, further comprising:
retrieving at least a portion of an image of a previously requested document from a memory of the device, the image of the previously requested document being previously received from the remote server and stored in the memory of the device in a compressed format; and
displaying at least the portion of the image of the previously requested document.

53. The medium of claim 46, wherein the image rendered from the document is received at the device in a plurality of sections; a first one of the plurality of sections is compressed in a first format; and, a second one of the plurality of sections is compressed in a second format.

54. The medium of claim 53, wherein the first format uses a lossless technique; and, the second format uses a lossy technique.

55. The medium of claim 54, wherein the first one of the plurality of sections is rendered from a text portion of the document; and, the second one of the plurality of sections is rendered from a graphics portion of the document.

56. The medium of claim 53, wherein the first one of the plurality of sections and the second one of the plurality of sections have different color depths.

57. The medium of claim 56, wherein the device decompresses sections of the image for display on the screen in a priority according to color depth.

58. The medium of claim 46, wherein the image rendered from the document comprises:
a first layer in a reduced color depth; and
one or more graphics portions with fine details to be overlaid over the first layer;
wherein the first layer is decompressed for display on the screen before the graphics portions are decompressed.

59. The medium of claim 46, further comprising:
displaying a plurality of icons with at least a portion of the image on the screen; and
responsive to receiving a selection of one of the plurality of icons, transmitting from the device to the remote server a message to execute a command with respect to the document at the remote server.

60. A medium as in claim 46 wherein the remote server renders display pixels to be displayed at the device such that the device does not render display pixels.

61. A server to serve documents, the server comprising:
means for receiving, at the server from a remote device, a request for a document, the document including text and one or more links;
transmitting, from the server, a request over a network to have the document delivered to the server and receiving the document, at the server, in response to the request transmitted from the server;
means for rendering, at the server and for displaying on a screen attached to the remote device, an image from of the entire document in response to the request, the image being larger than a screen area on the remote device available for displaying the document, the image including non-linkable graphical representations of the one or more links;
means for sending, from the server to the remote device, a portion of the image in a compressed format as a response to the request for the document; and
receiving, at the server from the remote device, a message to indicate a location of a user input being received at the remote device relative to a location on the portion of the image displayed in the screen area.

62. The server of claim 61, further comprising:
means for receiving, at the server from the remote device, a message to indicate a text input, the text input being received at the remote device relative to the location on a portion of the image displayed in the screen area;
means for entering, at the server, the text input into the document at a location corresponding to the location on the portion of the image displayed in the screen area to render a refreshed portion of the image; and
means for sending, from the server to the remote device, the refreshed portion of the image.

63. The server of claim 62, further comprising:
means for sending, from the server to the remote device, a message to accept keyboard entry in response to a determination that the document accepts text input at the location corresponding to the location on the portion of the image displayed on the screen.

64. The server of claim 61, wherein the image is in a plurality of sections rendered from the document; a first one of the plurality of sections is compressed in a first format; and, a second one of the plurality of sections is compressed in a second format.

65. The server of claim 64, wherein the first format is lossless; and, the second format is lossy.

66. The server of claim 64, wherein the first one of the plurality of sections and the second one of the plurality of sections have different color depths.

67. The server of claim 61, wherein the image rendered from the document comprises:
a first layer in a reduced color depth; and
one or more graphics portions with fine details to be overlaid over the first layer.

68. A portable device to access remote documents, the device comprising:
means for sending, from the device to a remote server, a request for a document, the document having vector information including text the request causing the remote server to transmit a further request over a network to have the document delivered to the remote server so that the remote server can render the image;
means for receiving, at the device, an image in a compressed format from the remote server, the image being rendered at the remote server from the entire document in response to the request, the image including a non-linkable graphical representation of at least one link;
means for storing the image in the compressed format on the device; and
means for, according to a user input to the device, selectively displaying only a portion of the image on a screen attached to the device according to the image stored on the device;
means for receiving, at the device, a user input of a location on the portion of the image displayed on the screen; and
means for transmitting, from the device to the remote server, a message to indicate the location of a user input relative to the location on the portion of the image displayed on the screen.

69. The device of claim 68, wherein the image comprises a plurality of sections; a first section of the plurality of sections that is not displayed on the device remains compressed on the device while one or more sections of the plurality of sections corresponding to the portion of the image displayed on the device are decompressed.

70. The device of claim 68, wherein said means for selectively displaying the portion of the image comprises:
means for, scrolling the image on the screen at exclusive control of the device.

71. The device of claim 68, further comprising:
means for receiving, at the device, a text input relative to a location on the portion of the image displayed on the screen;
means for sending, from the device to the remote server, a message to indicate that the text input is to be entered into the document;
means for receiving, at the device from the remote server, a refreshed portion of the image, the refreshed portion of the image being rendered at the remote server after entering the text input into the document at a location corresponding to the location on the portion the image displayed on the screen; and
means for displaying the refreshed portion of the image on the screen.

72. The device of claim 71, further comprising:
means for receiving, at the device from the remote server, a message to accept keyboard entry when the remote server determines that the document accepts text input at the location corresponding to the location on the portion of the image displayed on the screen; and
means for displaying a keyboard layout on the screen in response to the message to accept keyboard entry.

73. The device of claim 68, further comprising:
means for receiving text inputs at the device;
means for storing text characters in a text file on the device according to the text inputs;
means for retrieving the text characters from the text file; and
means for sending, from the device to the remote server, a message to enter the text characters into the document on the remote server at a location corresponding to a location on a portion of the image displayed on the screen.

74. The device of claim 68, further comprising:
means for retrieving at least a portion of an image of a previously requested document from a memory of the device, the image of the previously requested document being previously received from the remote server and stored in the memory of the device in a compressed format; and
means for displaying at least the portion of the image of the previously requested document.

75. The device of claim 68, wherein the image rendered from the document is received at the device in a plurality of sections; a first one of the plurality of sections is compressed in a first format; and, a second one of the plurality of sections is compressed in a second format.

76. The device of claim 75, wherein the first format is lossless; and, the second format is lossy.

77. The device of claim 76, wherein the first one of the plurality of sections is rendered from a text portion of the document; and, the second one of the plurality of sections is rendered from a graphics portion of the document.

78. The device of claim 75, wherein the first one of the plurality of sections and the second one of the plurality of sections have different color depths.

79. The device of claim 78, wherein the device decompresses sections of the image for display on the screen in a priority according to color depth.

80. The device of claim 68, wherein the image rendered from the document comprises:
a first layer in a reduced color depth; and
one or more graphics portions with fine details to be overlaid over the first layer;
wherein the first layer is decompressed for display on the screen before the graphics portions are decompressed.

81. The device of claim 68, further comprising:
means for displaying a plurality of icons with at least a portion of the image on the screen; and
means for, responsive to receiving a selection of one of the plurality of icons, transmitting from the device to the remote server a message to execute a command with respect to the document at the remote server.