# Patent

## Title
Protection of audio or video data in a playback device

## Abstract

Method and apparatus to prevent hacking of encrypted audio or video content during playback. Hackers, using a debugging attachment or other tools, can illicitly access encrypted data in memory in a playback device when the data is decrypted during playback and momentarily stored in digital form. This hacking is defeated here by methodically “poisoning” the encrypted data so that it is no longer playable by a standard decoder. The poisoning involves deliberate alteration of certain bit values. On playback, the player invokes a special secure routine that provides correction of the poisoned bit values, for successful playback.

## Background
FIELD OF THE INVENTION
This invention relates to Digital Rights Management (DRM) for protection of audio and video data in a playback device such as a computer or audio or video media player, and especially to protection of such data from illicit copying.
BACKGROUND
The protection of digital content transferred between computers over a network and transferred from a computer to an associated playback device is important for many organizations. The DRM process often involves encrypting the pieces of content (e.g., encrypting the binary form of the content) to restrict usage to those who have been granted a right to the content, which is typically pieces of music or video programs.
Cryptography is the traditional protection method, but for many digital file transfer situations, a party that legitimately receives the content might try to break the DRM protection scheme, so as to give illicit access to third parties. An identified weak leak in the DRM security is in the overall process, rather than the encryption scheme. For instance, one of the more successful DRM systems distributes music and video content via the Internet. The DRM system distributes to a user's computer content that has been encrypted. The user's computer then decrypts the received content, generates local keys for encrypting the content, and uses these local keys to re-encrypt the content. Typically the content in encrypted form may also be downloaded, via a local connection, to an associated playback-only device such as an audio or video media player, which similarly decrypts and re-encrypts the content before playing same.
The present inventors have identified a potential security issue with this approach. As indicated above, during the playback process (which can also occur in the user's computer) the decrypted data is resident for a time in memory in the host computer and/or other playback device. One such memory location is a buffer memory which temporarily stores one or more packets or frames of the decrypted content bitstream. For audio content, the usual encoded format of the data is referred to as AAC (Advanced Audio Coding ISO 13818-7) which is a compression standard with associated codecs (coder-decoder) commercially available in hardware and software. For video, the usual encoded format is H.264, a similar standard with compression, also with commercially available codecs.
During the playback process, portions of the decrypted content (packets for audio, frames for video), are temporarily stored in a buffer prior to being supplied to the AAC or H.264 or other decoder. Hackers (illicit copiers) may be able to access the decrypted data in this buffer using a standard software tool known as a debugger attachment. The hacker can then copy the accessed data out of the buffer, store it, and as the content is played thereby have a decrypted copy of the entire content, without having to break the actual encryption.
This process is illustrated in FIG. 1, where a conventional video and/or audio player 10 is shown in a block diagram, with only relevant portions shown for simplicity. Note that player 10 may be part of a conventional computer, or a media player only, or part of a cell phone, PDA, or other electronic device. The encrypted content is stored in the non-volatile or other memory 12, which is for instance flash memory, a disk drive, etc. or DRAM (dynamic random access memory). When the user selects content (such as a song) for play, the song is transferred portion by portion (such as packet by packet) to decryptor 16, which applies a decryption key thereto and decrypts the portion. The decrypted data is then stored in a buffer (memory location) 18, designated here as a parser buffer. The parser buffer assembles the data into suitable packets for transfer to the AAC (or other standard type) decoder 20, which is part of a conventional codec.
The hacker's attack uses a debugger attachment 22 to access the data in buffer 18, and transfer it to another memory, such as in a computer (not shown), where he can effectively copy the entire content free of any encryption as it is played for later illicit distribution or use (it is assumed the content is copyrighted so the use is illicit, but that is not relevant technically).
SUMMARY
In accordance with this invention, the above hacker attack is prevented or defeated by “poisoning” the decrypted bit stream so it is unusable by the hacker, when he extracts it from the buffer memory. This poisoning process and the associated hardware and/or software to carry it out are resident in the playback device, such as a computer, dedicated media player, cell phone, PDA, etc. The poisoning process in one embodiment involves slightly modifying at least one portion of the decrypted data (such as one or more bits therein, the data being digital and in standard binary form), such as an AAC packet or H.264 frame, before transferring it to the decoder portion of the codec in the playback device. Thus the data when later intercepted by the hacker is unusable, since the nature of the modification is not known to him.
Of course, the associated decoder then is also modified so it can recover either the original data or some other piece of information which provides accurate decoding of the modified data. It is believed that the first option is less secure since then the original data must reappear during the decoding process, making it available to the hacker. The second option is believed to be more secure, avoiding this, but requires that the part of the decoding process using the other piece of information be executed, e.g. in software, in a secure manner or a secure location in the playback device (not accessible to the hacker) so the hacker cannot guess the original data.



BRIEF DESCRIPTION OF THE FIGURES
FIG. 1 depicts a hacking attack, to which this disclosure is directed to preventing.
FIG. 2 depicts data encoding and storage in accordance with this disclosure.
FIG. 3 depicts data decoding (playback) in accordance with this disclosure.



DETAILED DESCRIPTION
The present method and associated apparatus has two phases. The first phase is to change the data, so it is modified (poisoned) to make it useless when later decoded by a standard decoder as used by a hacker. This usually happens when the data is first downloaded into the playback device, and stored in its transitory (e.g., volatile) memory. The second phase is to decode the data, typically during playback, to recover the data so it can be played.
The encoding operation is as follows:
1. The encrypted data (e.g. a song or video program) is downloaded from a server or host computer to the playback device, by conventional means.
2. The data is conventionally decrypted.
3. The resulting decrypted bitsteam is conventionally parsed into packets (each packet being a number of bits of predetermined length with header information).
4. The values of certain specific bit locations in each packet (or certain packets) are modified. The modifications are such that the resulting packet is parseable by a standard decoder, but not playable. Thus in one embodiment the bit modifications do not corrupt the structure of the audio packet (or video frame) itself.
5. In one embodiment, the original values of the modified bits are stored in a secure memory location in the playback device readable only by the DRM scheme associated with the device, and hence not accessible to the hacker. In a second embodiment, there is no storage of the modified bits.
6. In one embodiment, not every packet/frame (data portion) is so modified. This is accomplished by providing a set of rules (logic) which determines which portions are subject to modification. For instance, the AAC standard defines certain required blocks and optional blocks of bits. Required blocks include the section_data block, the scale_factor_data block, and the spectral_data block, while the pulse_data block and the tns_data blocks are optional. Hence in one embodiment the modifications of the bits are of those which are most likely to appear, and so poisoning the required blocks is preferred. Also, to speed up the encoding (enhance performance) in another embodiment a particular block may be poisoned (modified) only in certain cases. An example is to poison (in an AAC packet) the sect_cb bits in the section_data block only if the particular current window is of a certain length. Advantageously this may further confuse a hacker. Note the tradeoff here between performance (less poisoning) and security (more poisoning), to be selected for various implementations.
7. For the actual bit modification process, the value of each selected bit is replaced with a specific bit value, which preferably is a reserved (normally unused) value according to the relevant encoding standard. This enhances the later decoding, but has the drawback of weakening security since the hacker can more readily identify a poisoned portion of the data, although he would not know how to operate on such a bit even if he identified it.
This encoding process is illustrated in FIG. 2 which shows the encoding aspects of a player 23 having some elements the same as in FIG. 1. Here the encrypted data is received from an outside source; decrypted by decryptor 16 as in FIG. 1, and parsed by frame parser 18. Next, a new element is the poisoning logic 14 (embodied in hardware or software which applies the above rules to determine if a particular portion of data is to be poisoned or not. If not, the portion of data is conventionally encoded by encoder 20, re-encrypted by encryptor 24, and stored in content memory 12.
If the logic 14 determines to poison a particular portion of the data, logic 15 as described above determines which bits m thereof are to be modified, and to what values. As described above, in one embodiment the original values of bits m are stored in secure memory location 36. Logic 32 then carries out the actual bit modifications, and reassembles the data portion (packet or frame, for instance.) The reassembled data portion is then transferred to encoder 20 for further conventional processing.
The decoding/playback process and associated apparatus 23′ are as follows, and are complementary to the encoding process and apparatus, see FIG. 3. (Of course, the actual playback apparatus typically includes all elements of FIGS. 2 and 3.)
1. The previously stored and encrypted song or video program is conventionally downloaded from nonvolatile content memory 12.
2. The encrypted data is decrypted by decryptor 16, conventionally, and passed to frame parser 18.
3. Decoding logic 17, for each data portion, detects the reserved bit values at the predetermined bit locations. If no such reserved bit values are detected, processing defaults to the conventional decoding at coder 20 and playing. This means no bit poisoning was done on that frame/packet or other data entity.
4. If the reserved bit values are detected or any other pertinent information is detected, this means poisoning has taken place. The logic 17 then invokes (e.g. in software, but not so limited) a secure de-poisoning routine, which is stored in secure memory location 36. (Such a secure location is known in the DRM field and readily implemented by those skilled in the art.)
5. At this point, there are two options (embodiments.) In the first (path a in FIG. 3), the de-poisoning routine uses a routine to access the original bits (pre-poisoning) earlier stored in the secure memory location and in logic 44 substitutes those bits for the identified poisoned bits. This is the less secure approach as described above. In the second and more secure approach (path b in FIG. 3), the de-poisoning routine returns or invokes a modified decoder 42 and that modified decoder 42 performs the actual decoding, skipping decoder 20, and plays the content via the conventional audio/video circuitry, not shown.
Both the above processes and associated apparatuses of FIGS. 2 and 3 are implemental in a combination of computer hardware and software, conventionally. The computer software is conventionally coded in the same language as used for the other portions of the DRM scheme resident in the playback device.
This disclosure is illustrative and not limiting; further modifications will be apparent to one skilled in the art in light of this disclosure and are intended to fall within the scope of the appended claims.

## Claims

1. A method of playing secure video or audio data on a playback device, comprising the acts of:
receiving encrypted audio or video data from storage in the device, the audio or video data in addition to being encrypted having only predetermined portions poisoned according to logic wherein the encrypted audio or video data are parsable but not playable when decoded by a standard decoder, wherein the standard decoder conforms to the AAC or H.264 standard and the poisoning does not corrupt the structure of the poisoned portions;
decrypting the data;
parsing the decrypted data into portions;
in each decrypted and parsed portion, detecting the value of at least one predetermined bit location so as to determine whether that portion has been poisoned, wherein the value of the predetermined bit location is a reserved value according to the standard;
when the detected value does not match a predetermined value, indicating the absence of the poisoning, decoding the portion using the standard decoder, and playing the decoded portion;
when the detected value matches the predetermined value, indicating the presence of the poisoning in the decrypted and parsed portion, accessing a routine from a secure memory location in the playback device; and
decoding the poisoned portion using the routine and playing the decoded portion.

2. The method of claim 1, wherein each portion is a data frame or data packet.

3. The method of claim 1, wherein the predetermined bit location is in at least one of a section data block, a scale factor block, and a spectral data block.

4. The method of claim 1, wherein the values of a plurality of predetermined bit locations are detected to determine the presence of the poisoning.

5. The method of claim 1, wherein the routine is a modified AAC or H.264 decoder which decodes the portion.

6. The method of claim 1, wherein the routine accesses data from the secure memory location to substitute for the value in the predetermined bit location.

7. A non-transitory computer readable medium carrying computer code for carrying out the method of claim 1.

8. Computer enabled apparatus for carrying out the method of claim 1.

9. The method of claim 1, wherein the playback device is a computer or audio or video player.

10. The method of claim 1, wherein the values of at least one predetermined bit location are not detected.

11. Apparatus for playing secure video or audio data, comprising:
storage for storing audio or video data in encrypted form, the audio or video data in addition to being encrypted having only predetermined portions poisoned according to logic wherein the encrypted audio or video data are parsable but not playable when decoded by a standard decoder, wherein the standard decoder conforms to the AAC or H.264 standard and the poisoning does not corrupt the structure of the poisoned portions;
a decryptor coupled to the storage to decrypt the data;
a parser coupled to the decryptor to parse the decrypted data into portions;
a logic element coupled to the parser to detect the value of at least one predetermined bit location in each decrypted and parsed portion so as to determine whether that portion has been poisoned, wherein the value of the predetermined bit location is a reserved and normally unused value according to the standard, and to determine whether the detected value matches a predetermined value indicating the presence of the poisoning in the decrypted and parsed portion, and accessing a routine from a secure memory location in the apparatus in event of a match;
wherein the poisoned portion is decoded for play using the routine, and
wherein the portion is otherwise decoded for play in the absence of a match, indicating the absence of the poisoning, by the standard decoder which is coupled to the logic element.

12. The apparatus of claim 11, wherein each portion is a data frame or data packet.

13. The apparatus of claim 11, wherein the predetermined bit location is in at least one of a section data block, a scale factor block, and a spectral data block.

14. The apparatus of claim 11, wherein the values of a plurality of predetermined bit locations are detected to determine the presence of the poisoning.

15. The apparatus of claim 11, wherein the routine is a modified AAC or H.264 decoder which decodes the portion.

16. The apparatus of claim 11, wherein the routine accesses data from the secure memory location to substitute for the value in the predetermined bit location.

17. A non-transitory computer readable medium carrying computer code for carrying out the apparatus of claim 11.

18. The apparatus of claim 11, wherein the apparatus is a computer or audio or video player.

19. A method of providing secure audio or video data for a playback device, comprising the acts of:
receiving encrypted audio or video data from a source external to the playback device;
decrypting the data;
parsing the decrypted data into portions according to the AAC or H.264 standard;
in each portion, identifying according to a predetermined criteria whether a value of a predetermined bit location is to be modified wherein the portion is poisoned;
when the value is to be modified, modifying the value of the predetermined bit location according to logic, wherein the poisoned portions are parsable but not playable when decoded by a decoder conforming to the standard and the poisoning does not corrupt the structure of the poisoned portions and the value of the predetermined bit location is a reserved value according to the standard;
reassembling the portion with the modified value;
encoding the portion;
re-encrypting encoded portion; and
storing the re-encrypted portion in memory in the device for later playback.

20. The method of claim 19, wherein the encoding is according to the AAC or H.264 standards.

21. The method of claim 19, wherein each portion is a data frame or data packet.

22. The method of claim 19, wherein the predetermined bit location is in at least one of a section data block, a scale factor block, and a spectral data block.

23. The method of claim 19, wherein the values of a plurality of predetermined bit locations are detected.

24. The method of claim 20, wherein the matching value of the predetermined bit location is a reserved value according to the standard.

25. The method of claim 19, wherein the routine decodes the portion.

26. The method of claim 19, wherein the routine accesses data from a secure memory location to substitute for the value in the predetermined bit location.

27. A non-transitory computer readable medium carrying computer code for carrying out the method of claim 19.

28. Computer enabled apparatus for carrying out the method of claim 19.

29. The method of claim 19, wherein the playback device is a computer or audio or video player.

30. Apparatus for playing secure video or audio data, comprising:
a port adapted to receive encrypted audio or video data from a source external to the playback apparatus;
a decryptor coupled to the port for decrypting the received data;
a parser coupled to the decryptor for parsing the decrypted data into portions according to the AAC or H.264 standard;
a logic element coupled to the parser and which identifies, according to a predetermined criterion, whether a value of a predetermined bit location in each portion is to be modified wherein the portion is poisoned; wherein the value of the predetermined bit location is a reserved value according to the standard;
a secure memory location coupled to the logic element;
wherein the logic element modifies the value of the predetermined bit location according to a routine stored in the secure memory location, and reassembles the portion, wherein the poisoned portions are parsable but not playable when decoded by a decoder conforming to the standard and the poisoning does not corrupt the structure of the poisoned portions and the value of the predetermined bit location is a reserved value according to the standard;
an encoder coupled to the logic element and which encodes the poisoned portion;
an encryptor coupled to the encoder and which re-encrypts the encoded poisoned portion; and
storage coupled to the encryptor and which stores the re-encrypted poisoned portion for later playback.

31. Apparatus for video or audio play, comprising:
an input portion including:
a port adapted to receive encrypted audio or video data from a source external to the playback apparatus;
a decryptor coupled to the port for decrypting the received data;
a parser coupled to the decryptor for parsing the decrypted data into portions according to the AAC or H.264 standard;
a logic element coupled to the parser and which identifies, according to a predetermined criterion, whether a value of a predetermined bit location in each portion is to be modified wherein the portion is poisoned; wherein the value of the predetermined bit location is a reserved value according to the standard;
a secure memory location coupled to the logic element, wherein the original value of the predetermined bit location is stored in the secure memory location; and
wherein the logic element modifies the value of the predetermined bit location, and reassembles the portion, wherein the poisoned portions are parsable but not playable when decoded by a decoder conforming to the standard and the poisoning does not corrupt the structure of the poisoned portions and the value of the predetermined bit location is a reserved value according to the standard;
an encoder coupled to the logic element and which encodes the poisoned portion;
an encryptor coupled to the encoder and which re-encrypts the encoded poisoned portion; and
storage coupled to the encryptor and which stores the re-encrypted poisoned portion for later playback;
and an output portion comprising:
a logic element coupled to the parser to detect the value of the at least one predetermined bit location in each portion, and to determine whether the value of the at least one predetermined bit location matches a predetermined value indicating the presence of the poisoning, and accessing a routine from a secure memory location in the apparatus in event of a match;
wherein the portion is decoded for play using the routine, and PS wherein when the detected value does not match the predetermined value, indicating the absence of the poisoning, the portion is not decoded for play.

32. The method of claim 1, wherein the predetermined bit location is in a data block which is specified by the standard as being a required data block.

33. The method of claim 1, wherein the standard is the AAC standard and each portion is a data packet having a plurality of data blocks including a section data block, and the predetermined bit location is in the section data block only if a current window of the audio data is at least of a predetermined length.