Close captioning system in windows based graphics system

A method and apparatus for correcting distortion of characters included in an auxiliary data signal received with a video signal. The distortion is corrected by generating a signal representing a background and foreground of both a first character and a second subsequent character. The background and foreground of the first and subsequent adjacent character are then rendered. It is then determined whether the first character is rendered in italics. If so, a foreground color of the first character is re-rendered. Additionally, where a replacement character is received for the first character, it is determined whether the first character is rendered in italics. If so, the foreground and background color of at least a portion of the second subsequent character is re-rendered. A signal representing a background and foreground of a replacement character is generated. The foreground color and the background color of a replacement character superimposing the first character is then rendered.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The invention involves processing auxiliary information, such as closed caption character information, in video signal processing systems and, more particularly, to a system for preventing and/or correcting distortion of the rendering of one character that results from an attribute or format, such as italics, of another character.

2. Description of the Prior Art

User interface (UI) systems based on Microsoft Windows 32 bit platform architecture (Win32), e.g., Microsoft Windows Compact Edition (WinCE) operating system for handheld devices, implement a font system and text drawing routines that are designed to print out strings of characters. Examples of systems requiring this type of character generation capability are video signal processing systems that include auxiliary information processing capability, e.g., teletext systems and/or closed captioning systems such as those processing auxiliary information in accordance with the EIA-608 and/or EIA-708 standards. The EIA-608 standard is the broadcast video format used in television sets built in accordance with standards set by National Television Standards Committee (NTSC), which defines a video screen having a 4:3 aspect ratio. The EIA-708 standard is the standard for digital television (DTV) captioning. DTV offers a dramatically higher-quality picture, and provides a display in a wider 16:9 aspect ratio format, e.g., as seen in a movie theater. EIA stands for Electronic Industries Alliance—a trade organization alliance of the US electronics industry.

Closed captioning that complies with the above referenced standards provides characters for display that appear to be superimposed, or on top of, a video image. The characters provide textual content corresponding to the audio portion of a video program, e.g., to aid hearing impaired users. For analog television signals, such as NTSC, the standard television signal in the United States, the strings of text data are present in the vertical blanking intervals. That data is extracted and converted to character data for display on a screen at the same time as the video data is being processed. In digital television signals, the captioning data may be included as a particular group or stream of digital data packets.

Regardless of the signal type or data-delivery means, the closed caption data is used to produce close captioning characters having a foreground and a background color. In addition to the color characteristics, the characters can be stylized or have attributes or a particular format, such as being italicized. Italics is a particular way of formatting characters, for example, tilting the character to the right. The captioning characters are received one at a time for display one at a time using the graphics display capability of the operating system, e.g., Windows text drawing routines. Close captioning systems process characters one at a time to provide increased performance as no assembly of strings of characters is required. Consecutive characters are displayed one at a time on a display.

When the above described systems generate an italicized or tilted character for display, adding the italicized attribute or format to a normal character can cause the italicized character to shift or increase in width and occupy more display area than allotted for display of one character. That is, when italicized, a character can extend into and overlap the space or cell allotted for the adjacent character. Thus, an attribute or format of one character can interfere with the rendering of another character, e.g., adjacent character, and distort or corrupt the rendering of the other character. For example, since the characters are drawn or rendered one at a time, drawing the next character with the appropriate background color can cause at least a portion of the character in the previous character cell or space to be cut-off or clipped. As a result, the character display may appear distorted.

SUMMARY OF THE INVENTION

The present invention involves, in part, recognizing the described problems and, in part, providing a system and method for solving the described problems. An aspect of the invention involves a method of processing auxiliary information included in a video signal comprising the steps of processing the auxiliary information to produce character data comprising data representing a first character and a second character; rendering the first character and the second character in response to the character data; determining if the first character exhibits a predetermined format; and re-rendering a portion of one of the first character and the second character in response to the first character exhibiting the predetermined format. Another aspect of the invention involves a system and method comprising providing a signal indicative of the background and foreground colors of a next character to be displayed and then providing only the foreground color of the adjacent preceding character. Such is performed upon determining the preceding adjacent character is rendered in an italicized form. Another aspect of the invention involves a system and method for replacing a previously rendered character. First, the invention generates a signal indicative of and re-renders the foreground and background colors of the adjacent character rendered after the character to be replaced. Preferably, only an adjoining portion of the adjacent character is re-rendered. Then, a signal indicative of the background and foreground colors of a new character is generated and the background and foreground colors of the new character are rendered in a position on the display screen where the character to be replaced was previously displayed. If the italicized character immediately preceding the newly replaced character is obscured, the previous method for correcting distortion is utilized to correct the text.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT

The inventive system is implemented in character rendering devices able to receive auxiliary data signals for display. The devices may take the configuration of any set top box, computer ranging from mainframes and personal computers (PCs) to digital telephones, hand held devices, e.g., Palm Pilot™ and television signal processing systems (e.g., television signal receivers that either include a display device (e.g., a TV set) or do not include a display device (e.g., a set top box, VCR, etc.). This application discloses exemplary embodiments that involve use of the inventive system and method in processing closed caption data. However, the present system and method is applicable for any auxiliary information including character data received by the device. Other examples of such auxiliary information include teletext data, Gemstar data, etc. Furthermore, the present system may include a display device or generate signals which may be provided to a display device.

FIG. 1shows a progression of the present system and method for correcting distortion in a close captioning character10apositioned within a character cell14having a cell area indicated by a borderline12. In the Figures, the characters10a-10cand the background of the cell area16are shown in black and white, however, Win32 graphics and fonts as well as other graphics and processing software programs may render both the foreground and background in numerous other colors. The cell area16behind the character10awould typically be filled by a background color. When character10ais rendered in italicized form, shown as character10b, at least a portion13of the character foreground color, i.e., the letter10b, extends beyond the cell area14into an adjacent cell area15. That is, the format of the first character, i.e., italics of10b, causes the first character to interact or interfere with the space occupied by the second character,10c. As a result, the rendering of the second character subsequent to the rendering of the first character causes a disruption or corruption of the first character. As described herein, this corruption is eliminated by re-rendering of a portion of the first character, e.g., a foreground portion, in response to determining that the first character has a predetermined format, e.g., italics. In practice, many italicized characters produce a graphic that extends or bends the character over into the adjacent cell area15.

The present disclosure refers to italicized characters, indicating tilting of a character to the right. It should be understood that the invention is directed to correcting distortions created by any manipulation of the printed character causing the character to extend beyond its cell area and occupy portions of the cell area of adjacent characters. The direction of the tilt is not significant and the reference to the character as italicized is not significant.

Because characters are rendered or displayed one at a time, rendering of the second character10c, without regard to the extension13of character10bcauses the background and/or foreground color of the second character10cto cover and thereby cut off the protruding portion13of the first character10bextending or protruding into the cell area15of the second character10c.

Assuming that the italicized character10bextends beyond the allotted cell area14into the second character cell area15, when the second or next character10cis rendered having a background color17in the cell area15, the background color17of the character10cwill overwrite the protruding part13of the previous italicized character10b. Furthermore, in situations where the background color17is not used, obfuscation of the protruding section13of the character10bmay occur when the italicized or tilted character10bprotruding out of the allotted cell area14is followed by a normal not tilted character10d.

In order to correct or properly display the italicized character10bit is not practical to re-render all text for real-time on-line systems such as close captioning. This is because of the real-time requirements of characters being received and displayed. In real-time systems there is simply not enough time to fix all the errors, misprints, or distortions of the displayed text. Thus, an embodiment of the system and method of the present invention comprises generating a signal indicative of and re-rendering only the foreground of the italicized character10bafter rendering of the foreground and background of the next adjacent character10cto produce the result shown inFIG. 1.

Re-Rendering the Character without Replacing the Background

An exemplary embodiment of a system and method for solving the problem described above is now described with reference toFIGS. 1,2and3.FIG. 1illustrates the progression for correcting character distortions followed by the system and method of the present invention.FIG. 2illustrates a flowchart of a correction routine30in accordance with the system and method of the present invention.FIG. 3illustrates two adjacent text characters having distortions caused by italicization corrected by the system and according to the method ofFIG. 2. When text is to be displayed, a signal indicative of a foreground and background of a first character20is generated for rendering on a display, as shown inFIG. 3and discussed in step S30. In step S32a signal indicative of a next or second character22including its foreground and background colors is generated for rendering adjacent the first character20. In step S34it is determined whether the previous or first character20immediately preceding the second character22is italicized. The location of the preceding character20is based on the direction in which the text is being rendered, e.g. left to right, right to left, up, down, etc.

If the first character20is italicized, then it is anticipated that rendering the background color for the current character has resulted in the portion25of the first character20protruding into cell area24of the next character22being obfuscated. The edge of the cell area24of the next character22intersects the protruding section23of the first character22. In step S36, such obfuscation is corrected by generating a signal indicative of the foreground of the first character20without re-rendering its background26on a display. The generated signal indicative of the foreground of the first character20is then provided for re-rendering. It is understood that where the decision step S32determines that the preceding character is not italicized, no corrective action needs to be taken. The method then continues by generation of a signal indicative of the foreground and background of a subsequent adjacent character for rendering on a display. The next character22is then treated as the first character20this process continues until all text has been displayed.

More specifically, with regard to the example illustrated inFIG. 3, the system detects that the “W” character20is italicized and, therefore, a top right portion23of the character will be obscured by the subsequent adjacent “M” character22when displayed. The correction routine30controls rendering the “M” character22and then re-rendering the foreground “W” character20without re-rendering the background color of the cell area26associated with the “W” character20. The inventive correction routine30enables parsing and display of one character at a time, preventing corruption or obfuscation of the graphical rendition of italicized or tilted letters that protrude into the adjacent character's cell area.

Replacing the Character

An alternate embodiment of the present invention involves replacing characters on a display. Characters rendered on displays that are EIA-608 and/or EIA-708 compliant can be modified. A character may be modified for any of numerous reasons such as incorrect rendering of a character, correcting a misspelling, etc. Replacement of a character requires replacing an already rendered character in an existing stream. For example, as shown inFIG. 4, the progression40of replacing a previously rendered italicized character “M”42with a non-italicized character “M”42is shown.

As can be seen from this figure, first, it is determined whether the character “M”42is italicized. If this character is determined to be italicized, the immediately following character, the “J” character44in this instant, must be re-rendered to remove any distortion that might remain in the background46of the “J” character44caused by the italicized character “M”42. The inventive solution lies in generating a signal representative of the background46and foreground colors of the “J” character44and re-rendering the background46and foreground colors of the “J” character44.

The present inventions saves time by causing re-rendering of only the left half of the foreground and background of the adjacent cell to the right of the replaced character, in this instance italicized character “M”42. Illustratively, the re-rendering of the adjacent cell re-renders ½ the width portion48of the “J” character44defined to the left of the dotted line. Alternatively, any portion of the adjacent cell may be re-rendered. Re-rendering of the adjacent cell is not limited to ½ the cell width. Furthermore, for other languages such as Hebrew, which is read from right to left, the rendering and re-rendering of cells are performed in a direction opposite that described herein.

Updating only half of the adjacent cell prevents the cascading effect of fix-ups that may be required for characters that follow the adjacent cell. The cascading effect is created when re-rendering the whole of character42may overflow onto and obscure the character that follows if character42is italicized. This will require the character44that follows character42to be fixed, and so on.

After the correction of the character44following the character being replaced42, the new character50is rendered and the character52, preceding the new character50, is checked to determine if it is italicized. As discussed above the preceding italicized character may be obscured when the following character is rendered and therefore its foreground, i.e., the letter, is re-rendered as shown to assure that the new character does not obscure it.

FIG. 5illustrates an inventive correction routine60that performs character replacement as discussed above inFIG. 4. In step S62a determination is made whether a character is to be replaced. If a character is not to be replaced, the display of characters continues according to the display process implemented. If it is determined a character, e.g. the replacement character42illustrated inFIG. 4, is to be replaced, it is determined if the character is italicized in step S64. If the character, in step S64is determined to be italicized a signal representative of the background and the foreground of the adjacent half of the cell following the replacement character42is generated and re-rendered as discussed in step S66. If the character to be replaced is determined in step S64not to be italicized, a signal representative of the background and the foreground of the replacement character e.g. character50shown inFIG. 4, is generated and rendered on the screen as stated in step S68.

In step S70, a determination whether the character52to the left of the re-rendered character50is italicized is made. If the determination is in the affirmative, a signal representative of the foreground of that character is generated and re-rendered in step S72in a manner similar to that described with reference toFIG. 3.

In one illustrative embodiment shown inFIG. 6, the inventive system100includes a receiver80for receiving a video signal78. The received video signal78is forwarded to a signal processor82. The received video signal78includes an image signal and an auxiliary data signal. The auxiliary data signal may include data such as close caption data to be superimposed on the video signal.

The signal processor82extracts the auxiliary data signal and processes the video signal. The video signal is then passed to the video superimpose device86. If the signal processor82detects auxiliary data encoded in the video signal, the auxiliary data83will be separated from the video signal and forwarded to an auxiliary data processor84. The auxiliary data processor84decodes the components of the auxiliary data signal83. The components of the auxiliary data signal include at least characters for display or to be superimposed on a video signal, the position at which the characters are to be superimposed on the video signal, and a font and font style of the characters. The decoded components of the auxiliary data signal are then provided to the video superimpose device86for combining the video signal and the auxiliary data signal to form a composite signal. The superimpose device86may be connected to a video screen88as shown for display of the composite signal.

The caption characters can be displayed in any position on display screen88defined by the auxiliary data signal. Each character of the data is generally displayed with a white foreground color, e.g., letter color, inside a black box as a background. However, any desired foreground and background colors may be used to display.

When displaying characters on the display screen, the superimpose device86checks the characters to determine if the characters are italicized and then corrects the display of the characters in accordance with the method described herein before with reference toFIG. 1-5.

The video screen88may be combined with the system of the present invention such as in a television set. Alternatively, the system can operate as a set top box processing the auxiliary data signals for providing the signals to a separate display device for display of the composite signal including the auxiliary data.

From the above description it can be seen that the system of the present invention is able to overcome the shortcomings of prior art by providing a system and method of replacing characters and correcting the display of text rendered in auxiliary information processing systems, e.g., close caption systems, where italicized characters are generated for display sequentially on a video display apparatus. The inventive method generates a signal indicative of the background and foreground colors of a next character and then re-renders only the foreground color of the adjacent preceding character. Such is performed upon determining if the preceding adjacent character is rendered in an italicized form.

The invention is further able to perform replacement of a previously rendered character. First, the invention generates a signal indicative of the background and foreground colors of an adjacent character and re-renders the foreground and background colors of the adjacent character rendered after the character to be replaced. Preferably, only an adjoining portion of the subsequent adjacent character is re-rendered. Then, a signal indicative of the background and foreground colors of a new character are generated and rendered to overwrite the character to be replaced. If the italicized character immediately preceding the replaced character is obscured, only the foreground of the preceding character is re-rendered to correct the text.