# Patent

## Title
Command queuing for multimedia storage devices

## Abstract

A multi-media device interface (18) couples a multi-media device (16) to a portable electronic device (10). Multi-media and other information can be loaded into the portable electronic device (10) from the multi-media device (16) or stored in the multi-media device (16) from the portable electronic device (10). The multi-media device interface (18) queues commands to the multi-media device (16) from the portable electronic device (10) while the multi-media device (16) completes a previously-issued command.

## Background
RELATED CO-PENDING APPLICATION
This application is a divisional of co-pending U.S. application Ser. No 10/335,139 filed Dec. 31, 2002, entitled “COMMAND QUEUING FOR MULTIMEDIA STORAGE DEVICES”, having as inventors Christopher Becker, Michael Doll, Joseph Hansen, and owned by instant assignee.


BACKGROUND OF THE INVENTION
Portable electronic devices such as cellular telephones and personal digital assistants are now available with the capability to present multimedia. Examples of multimedia include graphics or pictures, video, MP3 audio files, and combinations thereof.
The Multi-Media Card Association and the SD Association promote an industry-standard that specifies electrical and physical specifications for multi-media devices for use with portable communications equipment such as cellular telephones. When used with a cellular telephone, a so-called multi-media device can provide ring tones, games, pictures, video, audio files and the like. A problem with multi-media devices such as multi-media cards (hereafter referred to as multi-media devices), however, is that an electronic device to which they are coupled, can effectively slow down because of the rate at which commands to the multi-media devices are executed and the data rate at which information is sent to and received from such devices.
By way of example, in the prior art, a multi-media device interface couples a processor or other controller for a portable electronic device such as a portable radio or cellular phone, to a multi-media device. When the portable electronic device sends a command to the multi-media device, it passes through a multi-media device interface, which sends the data request to the multi-media device. If the controller for the portable device requests a data transfer, it will usually specify the amount of data that should be read as well. The multi-media device will send a response to the data request and begin sending data. The amount of data specified by the controller for the portable electronic device will be sent by the multi-media device. The ability to send commands to the multi-media device at any time would improve the performance of portable communications devices to which a multi-media device is coupled.
Another problem associated with data transfer, more specifically sending write data in a streaming mode to the multi-media storage device, is the synchronization of a stop data transmission command with the write data. For synchronization, once a stop data transmission command is executed, the multi-media storage device expects to receive a final six packets of write data, wherein a data packet is typically a byte of data.
Previous solutions to overcoming this limitation include the usage of a direct memory access (DMA) controller, which contains a control bit that is activated in response to the stop data transmission command. Once the control bit is activated, the DMA then writes the final six packets of write data stored in a FIFO buffer. Thereby, the DMA controller must keep track of the number of data packets being transferred and also must maintain a reserve of data packets for when the stop data transmission command is generated. Another such example of a multi-media interface controller requires pre-programming of the total number of write data packets to be written to the multi-media storage device, such as disclosed by an ARM PrimeCell multi-media interface card, available from ARM, Inc., which requires tracking of the write data so the timing of the stop data transmission command is properly aligned with the end of the write data provided to the multi-media storage device.



BRIEF DESCRIPTION OF THE DRAWINGS
FIG. 1 shows a portable electronic device and a multi-media storage device in accordance with one embodiment of the invention.
FIG. 2 shows one example of a multi-media device interface as part of a portable communications device in accordance with one embodiment of the invention and a multi-media storage device coupled to the multi-media device interface.
FIG. 3 shows one example of a block diagram depiction of a method for coupling a multi-media storage device to a personal communications device in accordance with one embodiment of the invention.
FIG. 4 shows the continuation of one example of a block diagram depiction of a method for coupling a multi-media storage device to a personal communications device in accordance with one embodiment of the invention.
FIG. 5 shows one embodiment of a multi-media device interface with electronic devices.
FIG. 6 shows another example of a portable electronic device and a multi-media storage device in accordance with one embodiment of the invention.
FIG. 7 shows one example of a block diagram depiction of a method for synchronizing data transfer between a portable electronic device and a multi-media storage device.



DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
FIG. 1 shows a portable electronic device 10 embodied as a cellular telephone and a multi-media storage device 16. The multi-media storage device 16 is preferably embodied as a circuit card 12-2. As shown in FIG. 1, the card 12-2 can be inserted into a mating receptacle 12-1 in the portable electronic device 10 where electrical contacts of the card 12-2 make electrical contact with complementary electrical contacts with the portable electronic device 10 but which are not shown in FIG. 1 for clarity.
For purposes of claim construction, the term “portable electronic device” should be construed to encompass all radio transmitter, radio receiver and transceiver devices that provide either one-way or two-way communications capability, regardless of the type of modulation (analog, CDMA, TDMA, GSM, et al.) or the frequency spectrum in which they operate (800 MHz., 900 MHz., and higher) but also including optical or infrared signals as well as acoustic signals. Examples of radio devices include two-way radios, pagers and GPS devices. The term “portable electronic device” should also be construed to include personal digital assistants (PDAs), MP3 players, digital cameras and “Internet appliance,” which can include any device by which Internet access (web browsing, e-mail or other forms of packetized data) is sent and received. In a preferred embodiment, the portable electronic device 10 includes a radio device, such as a cellular telephone, which is considered to include the radio circuitry by which two-way communications can be provided.
With respect to a cellular telephone embodiment, the term “portable electronic device” includes the radio communications circuitry, i.e., the transmitter and/or receiver and/or transceiver, used in portable and mobile two-way cellular devices, regardless of the frequency spectrum in which such devices operate or the type of modulation they use.
FIG. 2 shows a preferred embodiment of a multi-media device interface 18 (i.e., an interface for a multi-media device) as part of the portable electronic device 10. In FIG. 2, the portable electronic device 10 is a cellular telephone and includes a radio 26. For a cellular telephone, the radio 26 would include a radio transmitter/receiver or transceiver by which two-way communications would be provided.
The multi-media device interface 18 operatively couples the portable electronic device 10 to a multi-media storage device 16 (also referred to herein as a “multi-media device”) so that the portable communications device can effectively send commands to the multi-media storage device 16 while the multi-media storage device 16 is sending data to the portable device 10.
In a preferred embodiment, a first processor 30 (hereafter the “MCU”) of the portable electronic device 10 sends a command to the multi-media device 16, requesting a file. The MCU 30 will notify or inform a second processor 28, of the size of the file requested from the multi-media device 16. Thereafter, the second processor 28 will monitor data that it receives from the multi-media device 16.
Information-bearing signals, i.e., data signals, can be exchanged between (i.e., sent to and received from) the multi-media storage device 16 and the portable electronic device 10 according to specifications of the Multi-Media Card Association but also according to the SD Card Association Although the preferred embodiment of the invention transfers information between the multi-media storage device 16 and the portable electronic device 10 via electrical signals, alternate and equivalent methods of transferring information would include the use of infrared signals, acoustic, optical signals or radio frequency signals. Infrared data transmission techniques and circuitry, acoustic data transmission techniques and circuitry and RF data transmission techniques and circuitry, are well-known to those of ordinary skill in the art.
By way of example, the multi-media storage device 16 might store audio files for use as ringer tones by the portable electronic device 10. The multi-media storage device 16 might also store pictures, video streams or MP3 audio files for playback on the portable electronic device 10 display screen, output from a speaker or other input/output (I/O) device 24 with which the portable electronic device 10 is equipped. An even more general embodiment of portable electronic device 10 includes devices identified in FIG. 5, which include devices such as a CD player, an MP3 player, a DVD player, an Internet appliance or a PDA, (all identified by reference numeral 100) which are equipped with the multi-media device interface 18 described herein.
As the file transfer from the multi-media storage device 16 proceeds, a second command can be issued to the multi-media storage device 16 from the MCU 30 whereupon the multi-media device interface 18 will receive the second command and store it in a command queuing buffer 42 (also known as “buffer 42”) until such time that the multi-media storage device 16 can execute it.
The multi-media device interface 18 reduces processing overhead associated with data transfer between the multi-media storage device 16 and the portable electronic device 10. A principal function of the multi-media device interface 18 is to enable a processor in the portable electronic device 10 that is controlling the multi-media storage device 16, to issue commands to the multi-media storage device 16, even when the multi-media storage device 16 is unable to process them. In the embodiment shown in FIG. 2, the multi-media device interface 18 enables the MCU 30 to issue a first command to the multi-media storage device 16.
An example of a command to the multi-media storage device 16 would be to request the transfer of a file from the multi-media storage device 16 to the portable electronic device 10. During the time that the multi-media storage device 16 executes the first command, the multi-media device interface 18, enables the MCU 30 to issue another command to the multi-media storage device 16. The multi-media device interface 18 includes a command queuing buffer 42 where the second command is queued until the multi-media storage device 16 is able to execute the second command. In a preferred embodiment, a queued, i.e., “second” command will be executed by the multi-media storage device 16 after a previously-issued, i.e., “first” command is completed. The MCU 30 does not need to wait until one command to the multi-media storage device 16 has been executed before issuing another command.
In a preferred embodiment, the multi-media device interface 18 includes a command processor 32, which receives information 34 (commands, but also possibly including data) from at least one of the processors 28 or 30 of the portable electronic device 10. After the command processor 32 receives a command from the processor MCU 30, it forwards those commands to a multi-media interface controller 36, which can be embodied as a processor, such as a microcontroller or microprocessor as well as a DSP or combinational and/or sequential logic. The command processor 32 is preferably embodied as combinational logic, a gate, array or an application specific integrated circuit.
In a preferred embodiment, the MCU forms a command by configuring registers in the command processor 32. The command processor 32 provides for error correction by way of a cyclic redundancy check or CRC, added to the commands issued to the multi-media storage device 16 from the MCU 30.
Commands to the multi-media storage device 16 are passed by the command processor 32.The multi-media interface controller 36 controls when the command is sent to the multi-media device 16. If the multi-media storage device 16 is capable of executing it, the multi-media interface controller 36 can forward a command directly to the multi-media storage device 16. The interface 36 also queues commands to the multi-media storage device 16 in the command queuing buffer 42.
The command processor 32 receives responses from the multi-media storage device 16 and validates those responses, typically by checking a cyclic redundancy check or CRC. attached to the response. The command processor 32 will notify the portable communications device controllers, that a response was received from the multi-media storage device 16 and that the multi-media storage device 16 is available to execute another command.
Another function of the multi-media interface controller 36 is to monitor the execution of the commands sent,to the multi-media storage device 16. The multi-media interface controller 36 monitors the status or execution of commands by testing the responses 38 that are received from the multi-media storage device 16 in response to commands 40 that are sent to it.
The command queuing buffer 42, which is coupled to the command processor 32 as well as the multi-media face controller 36, stores commands to the multi-media device until they can be executed. In the preferred embodiment, the command queuing buffer 42 is embodied by 48-bit shift register. Commands can be written into the buffer 42 in parallel but shifted out in a serial fashion. Alternate embodiments include using a semi-conductor random access memory (RAM) device, however, in such an embodiment, sending information serially would require some sort of parallel-to-serial conversion.
As set forth above, the command queuing buffer 42 stores commands from the MCU 30 until such time the multi-media storage device 16 is able to execute them. The determination of when the multi-media storage device 16 can execute another command is determined in the second processor 28 notifying the MCU 30 that a previously-issued command has been completed.
By way of example, the controller/MCU 30 may request a file from the multi-media storage device 16. In order to do so, the controller/MCU 30 will issue a command that will be received by the command processor 32. The command processor can determine the status of the multi-media storage device 16 by monitoring current or most recent responses 38. If, for instance, the multi-media storage device responses 38 indicate that the multi-media storage device 16 is not busy, the command to send a file will be sent to the queuing buffer 42. The multi-media interface controller 36 can gate or transfer the command 40 to transfer a file from the multi-media storage device 16 by selecting the command from the queuing buffer 42 and causing the command queuing buffer 42 to write the command 40 to the multi-media storage device 16.
By tracking or monitoring the execution of commands sent to the multi-media storage device 16, the controller 36 substantially unburdens the controller/MCU 30 and the second processor (e.g., a DSP) 28 of the portable electronic device 10, freeing them to perform other tasks. The controller/MCU 30 does not need to wait until a data transfer is complete before issuing a command to the multi-media device 16.
Included within the multi-media device interface 18 is a data processing controller 46. The data processing controller 16 receives data 44 from the storage device 16 and converts it to an appropriate-sized parallel format. In instances where data must be sent to the multi-media storage device 16 from the portable electronic device 10, the data processing controller 46 can perform a parallel to serial conversion.
The data processing controller 46 includes an amount of random access memory, or RAM, into which, data from the multi-media storage device 16 can be stored pending the availability of the second processor/DSP 28 to transfer the data into the radio 26 or elsewhere in the portable electronic device 10.
FIG. 3 shows a method of coupling a portable electronic device to a multi-media storage device 16.
At step 302, a multi-media device interface 18 will receive a command for the multi-media storage device 16. In step 304, the command to the multi-media storage device will be queued in a buffer until the multi-media storage device 16 concludes executing a previously-issued command. By queuing the command to the multi-media storage device, the portable electronic device can perform other tasks instead of waiting until the multi-media storage device is available.
In step 306, the conditions for sending a queued command are tested. When the multi-media storage device 16 is able to execute the command issued to it, as determined by monitoring the data from or to the multi-media storage device 16, a queued command is sent to the multi-media storage device 16 in step 308.
At step 310 in FIG. 4, the execution of the command by the multi-media storage device 16 is monitored and/or tested by the multi-media device interface 18 by monitoring and/or testing data that is received by the multi-media device interface 18 from the multi-media device 16. The responses 38 received from the multi-media storage device 16 (sometimes embodied as the cessation thereof) will indicate when a previously-issued command is completed. In step 308, part of the testing of data from the multi-media storage device 16 is the testing integrity is to insure that data from the multi-media storage device 16 is received intact, which in some embodiments is by way of checksums added to streams of data, parity bits added to data bytes or cyclic redundancy checks, all of which are considered to be equivalent embodiments of data integrity testing.
Data is transferred to and from the multi-media device in a serial fashion. The portable electronic device 10 on the other hand uses parallel data. Accordingly, in step 312, data that is received from the multi-media storage device 16, is converted to a serial form. Conversely, in step 314, data directed to the multi-media storage device 16 from the portable electronic device 10 is converted from a parallel format.
Those of skill in the art will appreciate that by coupling a portable electronic device 10, such as a portable phone, pager, or personal digital assistant to a multi-media storage device through an intelligent controller or interface, the processing power of the portable communications device can be freed to perform other tasks with the multi-media device interface monitoring the status of commands and the availability of the multi-media storage device to respond.
One complication to be overcome for providing data transfer in a streaming mode between the multi-media storage device 16 and the portable electronic device 10 is the synchronization of the data 44 with respect to a stop data transmission command 40. FIG. 6 illustrates one embodiment for overcoming such synchronization problems by the inclusion of a data FIFO 60 operably coupled between the data processing controller 46 and the CPU 20 of the multi-media storage device 16. As recognized by one having ordinary skill in the art, the data FIFO 60 may be any suitable type of memory device capable of storing data transmission, but one embodiment may be a first in first out memory buffer for providing the transfer of data 44 therethrough.
The portable device 10 operates as discussed above with respect to FIG. 2, but further includes the ability to store a predetermined number of data packets within the data FIFO 60 for synchronizing data transfer. Furthermore, the data processing controller 46 is operably coupled to the first processor 30 for providing data 62 to the data processing controller 46. During the writing of data 44 to the multi-media storage device 16, synchronization must be achieved by providing for a reserve of a predetermined number of data packets, typically a data byte, for synchronization with the stop data transmission command, such as command 40, provided from a command queuing buffer 42. It is further recognized that the multi-media interface controller 36 may provide the stop data transmission command which may be generated by the command processor 32. Regardless thereof, once the electronic portable device 10 generates a stop data transmission command, in one embodiment, six more bytes of write data must be transferred to the multi-media storage device. Therefore, the data processing controller 46 provides for the predetermined number of data packets, in this embodiment the predetermined number of data packets is seven bytes of data, to be stored in the data FIFO 60.
While FIG. 6 illustrates one embodiment of the structural representation of the portable device 10 having the data FIFO 60 for synchronization of a write data transfer, FIG. 7 illustrates one example of the steps of operation of the processor 10. A first determination is made if there are seven bytes available within the data FIFO 60, step 700. If there are seven or more bytes available, the portable device 10 may thereupon write data 44 to the multi-media storage device 16, step 702. Another determination is made as to whether a stop data transmission command should be sent to the multi-media storage device 16, step 704. In the event that a stop data transmission command should not be sent, another determination is made as to whether there are six bytes of data available from the data FIFO 60, step 706.
If there are six bytes available in the data FIFO 60, the next step is to once again write data 44 to the multi-media storage device 16, step 702. If there are less than six bytes available in the data FIFO 60, the portable electronic device 10 should thereupon wait for data, step 708. Once the data 44 has been written to the multi-media storage device 16, step 702, the determination step 704 is repeated. In the event that a stop data transmission command should be sent, the portable electronic device 10 should thereupon write the last six bytes from the data FIFO 60 to the multi-media storage device 16. In one embodiment, the stop data transmission command includes 48 bits of command data, designated as element 40 in FIG. 6, including a start bit, such as a “0” bit, a transmitter bit, such as a “1” bit, content bits that include 38 bit representing the command, an error correction code block of seven bits and an end bit, such as a “1” bit.
Referring back to step 700, if there are less than seven bytes available in the data FIFO 60, a determination should be made as to whether a stop data transmission command should be sent 712, similar to step 704. If the determination is that a stop data transmission command should not be sent, the determination of step 700 is once again repeated to determine if there are seven data bytes available in the data FIFO 60. Otherwise, if a stop data transmission command should be sent and there are less than seven bytes available, the electronic portable device 10 should thereupon stall the write operation until enough of the command has been sent to the end of the data and the end of the command are synchronized. As a packet of data 44 is transmitted at the same time that a stop data transmission command is provided to the multi-media storage device, the final step includes writing the last six bytes from the data FIFO 60 to the multi-media storage device 16, step 710. As such, in one embodiment, at least 49 data bits are written to the multi-media storage device 16, corresponding to the 48 command bits included within the host command and a final data bit transmitted concurrently with a high impedance state command bit, such as a “1” bit.
Thereupon, through the utilization of a data FIFO 60, the portable electronic device 10 may effectively synchronize a write data transfer within the multi-media storage device 16 without the use of a DMA to coordinate the timing required by having a final six data bytes provided to the multi-media storage device 16 upon reception of the stop data transmission command. Furthermore, through the utilization of the data FIFO 60, the portable electronic device 10 further does not need to monitor or track the data transfer after the predetermined number of data bits is reserved within the data FIFO, and may effectively transfer data on a first in first out manner to the multi-media storage device 16.
While the principles of the invention have been described above in connection with specific apparatus, it is to be clearly understood that this description is made only by way of example and not as a limitation on the scope of the invention.

## Claims

1. A portable electronic device comprised of:
a first processor, operatively coupled to, and operative to send commands to, and receiving responses from, a removable multi-media storage device having a processor therein, the removable multi-media storage device coupled to the portable electronic device;
a second processor in the portable electronic device, responsive to commands from the first processor and operative to receive information from the removable multi-media storage device;
a multi-media device interface in the portable electronic device, operatively coupled and external to both the first and second processors, the multi-media device interface being operative to monitor and respond to operational information from the removable multi-media storage device to delay and queue a transmission of a second command to the removable multi-media storage device from the first processor in response to the operational information indicating the removable multi-media storage device and the second processor are engaged in the execution of a first command from the first processor, the multi-media device interface operative to provide the information to the second processor to complete the execution of the first command; and
a radio device, operatively coupled to at least one of the first and second processors and operative to provide two-way communications capability for the portable electronic device.

2. The portable electronic device of claim 1 further comprising a data buffer operably coupled to the second processor such that the data buffer may receive write data from the second processor and provide the write data to the removable multi-media storage device in synchronization with a stop data transmission command.

3. The portable electronic device of claim 2, wherein the data buffer is a shift register.

4. The portable electronic device of claim 1 wherein the radio device includes a cellular telephone transceiver.

5. The portable electronic device of claim 1 wherein at least one of the first and second processors is a digital signal processor, a microprocessor, or a microcontroller.

6. The portable electronic device of claim 1 wherein signals are exchanged between the portable electronic device and the removable multi-media storage device via electrical signals, infrared signals, optical signals, acoustic signals, or radio frequency signals.

7. The portable electronic device of claim 1, wherein the removable multi-media storage device comprises a circuit card or a multi-media card constructed according to the standards of the Multi-Media Card Association or the SD Association.

8. The portable electronic device of claim 1, wherein the removable multi-media storage device is configured to store pictures, video streams, or MP3 audio files for playback on the portable electronic device.

9. The portable electronic device of claim 1 wherein the portable electronic device includes a personal digital assistant, an Internet appliance, a CD player, an MP3player, a DVD player, a digital camera, or a cellular telephone.

10. A portable electronic device comprised of:
a first processor, operatively coupled to, and operative to send commands to and receiving responses from, a removable multi-media storage device coupled to the portable electronic device;
a second processor, in the portable electronic device, responsive to commands from the first processor and capable of receiving information from the removable multi-media storage device;
a multi-media device interface in the portable electronic device, operatively coupled and external to both the first and second processors, the multi-media device interface being operative to monitor and respond to operational information from the removable multi-media storage device to delay and queue transmission of a second command to the removable multi-media storage device from the first processor in response to the operational information indicating the removable multi-media storage device and the second processor are engaged in the execution of a first command from the first processor, the multi-media device interface operative to provide the information to the second processor to complete the execution of the first command; and
an electronic device, operatively coupled to at least one of the first and second processors.

11. The portable electronic device of claim 10 wherein the portable electronic device includes a personal digital assistant, an Internet appliance, a CD player, an MP3player, a DVD player, a digital camera, or a cellular telephone.

12. The portable electronic device of claim 10, further comprising a data buffer operably coupled to the second processor such that the data buffer may receive write data from the second processor and provide the write data to the removable multi-media storage device in synchronization with a stop data transmission command.

13. The portable electronic device of claim 12, wherein the data buffer is a shift register.

14. The portable electronic device of claim 10, further comprising a radio device operatively coupled to at least one of the first and second processors and operative to provide two-way communications capability for the portable electronic device.

15. The portable electronic device of claim 14, wherein the radio device includes a cellular telephone transceiver.

16. The portable electronic device of claim 10, wherein the electronic device comprises a radio transmitter, radio receiver, or transceiver device that provides either one-way or two-way communications capability.

17. The portable electronic device of claim 10, wherein signals are exchanged between the portable electronic device and the removable multi-media storage device via electrical signals, infrared signals, optical signals, acoustic signals, or radio frequency signals.

18. The portable electronic device of claim 10, wherein the removable multi-media storage device comprises a circuit card or a multi-media card constructed according to the standards of the Multi-Media Card Association or the SD Association.

19. The portable electronic device of claim 10, wherein the removable multi-media storage device is configured to store pictures, video streams, or MP3audio files for playback on the portable electronic device.

20. The portable electronic device of claim 10, wherein the multi-media device interface further comprises a command processor configured to perform at least one of the functions that include:
adding a cyclic redundancy check to the commands from the portable electronic device;
detecting an error correction code in responses from the removable multi-media storage device;
receiving responses from the removable multi-media storage device;
validating responses from the removable multi-media storage device; or
notifying the portable electronic device that a response was received from the removable multi-media storage device.