Insertion of sound segments into a voice channel of a communication device

The disclosure is directed to a software and hardware system that includes recording and storing audio data (digital or analog) for introduction into a voice channel of a communication device. The disclosure also includes establishing a voice channel (e.g., a phone call), using one or more keystrokes on a number pad of a voice communication channel to retrieve the audio data (e.g. audio segments) that are stored in the voice communication device and mixing the audio data with the voice data in the voice channel so that the audio data is audible along with the voice data during a conversation using the voice communication device.

BACKGROUND OF THE INVENTION

1. Field of Invention

The present invention relates to communication devices that establish a voice channel for the transmission of voice communications.

2. Description of the Related Arts

Mobile communication devices, e.g., wireless or cordless phones, that establish a voice channel for transmission of voice communications include, for example, conventional telephones and cellular phones. Once these mobile communication devices establish a voice channel, sound segments from within the devices themselves or other independent sources cannot be mixed into that established voice channel (other than those sounds transmitted conventionally through the built-in microphone and dial tones generated by the device keypad). Specifically, unique sound segments (or sound bytes) that are stored in data chips or on an analog medium on the device itself cannot be mixed into the voice channel because separate chips or chip sets process the voice channel from the data or analog applications. This limits functionality, flexibility, and enjoyment of use of the mobile communication device during a conversation over these devices.

Therefore, there is a need for a communication system and method that allows for mixing a sound segment (or sound byte) represented by digital data or an analog signal directly into an established voice channel between two mobile devices where the sound segment is independent of the voice information.

SUMMARY OF THE INVENTION

The present invention includes an electronic device and/or chip set for use with a wireless communication device that establishes a voice channel (audio transmission) for communications. The device may be external to the communication device or may be integrated within the communication device.

In one embodiment, the present invention includes a conductor unit that is configured for providing recorded sound segments (audio that may be digital data or an analog signal) within a voice channel by selecting recorded audio to be played, injecting the recorded audio into the voice channel, and outputting the combination of the voice from the communication devices' built-in microphone and the recorded audio so that it can be heard by both the sender and receiver. In another embodiment, the conductor unit may also be configured for recording and storing audio sound segments as discrete sound samples that can be selected, triggering selection of the discrete sound samples, and mixing and outputting the discrete sound samples into a voice or audio transmission of the voice communication device. In yet another embodiment, the conductor unit is configured for inserting sound segments (e.g., recorded audio data) into an audio transmission established by a voice communication device, the system including a selection mechanism that connects with a storage element to select a sound segment from storage, and a mixer that receives the sound segment and mixes it with available audio in a voice transmission.

DETAILED DESCRIPTION OF THE INVENTION

The present invention includes a software and/or hardware system that includes recording and storing audio data (digital or analog) for introduction into a voice channel (e.g., a phone call) established between two or more communication devices (e.g., voice transmission communication devices). In one embodiment, the communication device is a mobile communication device, e.g., a cellular phone, a cordless phone, or a wireless communicator. The audio data may be referred to as sound segments and can be pre-stored in a storage system for later retrieval. Alternatively, the audio data may be recorded and stored from an external source, for example, downloaded through a network (e.g., the Internet) or media device (e.g., an MP3 player, a tape device, a CD player, or DVD player). In yet another embodiment, the audio data (or sound segment) is simply received from the media device and passed through the system and mixed with the voice channel. Further, it is noted that the audio data may be in any audio file format, including analog, audio interchange file format, audio video interleave, WAVE, broadcast WAVE, MPEG-2, AU, AES-31, MP3, MP4, PCM, Dolby Digital, DTS, Real Audio, Sony Dynamic Digital Sound, and the like.

Looking first atFIG. 1a, it illustrates a voice channel sound insertion system100in accordance with one embodiment of the present invention. The voice channel sound insertion system100includes a conductor unit110, a communication device (e.g., a phone)120, and an audio device130, which is optional. The conductor unit110includes an input port115and a communications device interface (“CDI”)125.

The conductor unit110provides a source of sound segments (e.g., analog or digital audio data) that may be introduced into a voice channel that carries voice data (or voice stream). It is noted that inFIG. 1a, the conductor unit110is shown as a stand-alone device that couples with a communication device120through the CDI125. The conductor unit110may also include the input port115(e.g., an audio (or stereo) jack, a Universal Serial Bus (“USB) port, or a communication transceiver such as a wireless LAN or Bluetooth transceiver) that is configured to receive audio from the audio device130(e.g., an MP3 player, a tape device, a network computer, a personal computer, a handheld computer, a CD player, or a DVD player). Audio received from the audio device130can be either passed through the conductor unit110for immediate mixing into the voice channel or stored as a sound segment in the conductor unit110for later recall and mixing into the voice channel.

The communication device120is a conventional device that establishes (or is used for) a voice channel, e.g., a telephone, cellular phone, wireless communicator, or Internet Protocol phone. The CDI125is a communication interface for coupling the conductor unit110with the communication device120.

FIG. 1billustrates a second embodiment of a voice channel sound insertion system101having an exploded view of the conductor unit110that is internal to the communication device120in accordance with one embodiment of the present invention. In this embodiment, the conductor unit110may be configured to reside within a communication device120that establishes a voice channel. For example, the conductor unit110may be a self-contained chip or chip set that is configured to connect with the other communication chips or chip sets in the communication device.

Alternatively, the functionality of the conductor unit110may be integrated into a preexisting chip or chip set of the communication device120. Moreover, if a voice and data chip are closely integrated or merge with regard to functionality and design, the principles of the present invention allow for another embodiment in which the functionality of the conductor unit may be comprised of a software application or firmware that functions in conjunction with that chip, and if necessary other components such as a microcontroller or microprocessor, to insert audio data into a voice channel.

FIG. 2illustrates a system configuration200of the conductor unit110in accordance with one embodiment of the present invention. The conductor unit110includes a microcontroller205, a storage210(e.g., an EEPROM, a flash memory, an optical or magnetic disk drive, or a battery backed SRAM or DRAM), a sound input/encoder215, a sound decoder220, a mixer225, a display230, a power supply235(e.g., battery), one or more sound trigger mechanisms240, function controls245, and an ON/OFF switch250. The function controls245include particular functions that are specific to the device, such as recording new sound segments.

Generally, the microcontroller205couples with the storage210, the display230, the power supply235, the sound input/encoder215, the sound decoder220, the sound trigger mechanisms240, the function controls245, and the ON/OFF switch250. The sound decoder220couples with the sound input/encoder215, the sound decoder220, and the mixer225. The mixer225also couples with a volume control255, the communication device120(e.g., a cellular phone is illustrated inFIG. 2) and an optional microphone extension260.

The microcontroller205is a conventional microcontroller that executes instructions and provides functionality for the conductor. For example, the microcontroller205executes instructions for the processes illustrated inFIGS. 3,4a, and4b. For example,FIG. 3illustrates a flow diagram of a process for introducing and outputting a sound segment within a voice channel in accordance with one embodiment of the present invention. In addition,FIG. 4aillustrates a flow diagram of a process of retrieving a sound segment from a network for storage in a conductor unit in accordance with one embodiment of the present invention.FIG. 4billustrates a flow diagram of a process for recording a sound segment from an external source for storage in a conductor unit in accordance with one embodiment of the present invention. The processes in these Figures will be further described below.

The microcontroller205also provides functionality for other operations. For example, the microcontroller205functions with the sound input/encoder215to operate on an analog or digital data input to receive the data (e.g., audio, text, graphic, etc.) and prepare it for storage in the storage210or contemporaneously mix it with a voice channel through the mixer225(e.g., via the sound decoder220). As another example, the microcontroller205functions with the sound decoder220to retrieve stored data from the storage210and process the stored data for mixing with the voice channel through the mixer225.

The encoder215serves to convert the incoming audio information from its native format into the proper format to be stored within the conductor unit110, or to be mixed with the voice program. For example, the encoder215can convert analog audio into the PCM format, or WAVE format to PCM, etc. The decoder220functions to provide a converse of the encoder215—it converts the stored information from the format used by the storage210into the proper format to be mixed into the voice channel. For example, the decoder220would convert PCM data to MP3, PCM to analog, MP3 to analog, etc.

The microcontroller205may also be configured to function with the storage210to provide data and database storage functions. For example, storing the input data may also include setting up and creating categories in some other catalog or database format that provides organization for the data. This allows for easy retrieval and organization, for example, through menus and files visible on the display230and controlled through the function controls245and/or the trigger mechanisms240, all of which function with the microcontroller205. It is noted that the data in the storage210may be stored in analog or digital format and may be compressed to allow for greater storage capacity. Further, the storage210may also be used for storing data such as pictures, graphics, and the like.

The microcontroller205is also configured to function in conjunction with the trigger mechanisms240and the function controls245. The trigger mechanisms240can be switches that allow for selection of sound segments from the storage. The selection options may be viewable to a user through the display. The trigger mechanisms240can be dedicated buttons, switches, or dials. Alternatively, the trigger mechanisms240can also be configured to work with established triggers, for example, a keypad or number pad on a communication device120.

In yet another embodiment, the trigger mechanism240can be a touch screen that may integrated with the display230or on a display of the communication device120. In addition, the trigger mechanism240may also be a graffiti or handwriting recognition area integrated in with the display area230or with the communication device120, e.g., a graffiti section on a on a personal information device (e.g., a PDA) having voice channel capability. The microcontroller205may also provide functionality to control power levels in the conductor, e.g., shutting it on or off if the device is not in use for some predetermined time. The function controls245may be configured to provide user functionality such as “Repeat Selection”, “Set Selection” (e.g., “sets” of files to play), auto power on/off, and the like.

The mixer225allows for injection of a selected sound segment into a voice channel. Specifically, the mixer225adds two or more audio channels together and merges them into a signal stream. For example, once a voice channel is established, a user may inject a sound segment to be incorporated into that voice channel. The mixed sound segment and voice data gets output through a speaker in a communication device receiving the sound from the sending communication device120. Note that in the transmitting phone, the mixed signal is transmitted into the voice channel. In one embodiment, the mixer functions as an analog device. In this embodiment, audio out of the storage210via the decoder220would be analog, and would add with the user's voice, which is also analog, in the mixer225. In this embodiment, mixing may be done through, for example, “forced summing” or “summing amplifier.”

In the forced summing process, two or more analog signals are simply isolated from each other with resistors and tied together. This method creates a single stream output, but may add some noise to the circuit. In addition, in this embodiment signal sources often are of similar electrical impedance so as not to interfere with each other. In the summing amplifier process, two or more analog signals are resistively summed at the high-impedance inverting input of an audio amplifier. The high-impedance input provides near total isolation between the signal sources. This method allows the noiseless summing of various types of signals.

In an alternative embodiment, if the audio data is signals from a digital domain, mixing of the data is through conventional digital data mixing techniques using an appropriately configured microprocessor or digital signal processor (“DSP”). In an example of this embodiment, a device mixing digital data would take two or more audio data streams and perform the necessary mathematical computations to create a new data stream containing both sets of information.

FIG. 3illustrates a flow diagram of a process for introducing and outputting a sound segment within a voice channel in accordance with one embodiment of the present invention. For purposes of an illustrative example, the process will be described with regard to a phone-type communication device.

Once the process starts305, a user (e.g., a first party) may initially establish310a phone call using the communication device120between that user and a person receiving a call (e.g., a second party). In this example, this may be referred to as establishing a voice channel. During a course of a conversation between the user and the person receiving the call, a user may decide to inject particular sound segments into the voice channel. To do this, the user may use the display screen230to display315and navigate through menus and/or lists of available sound segments in the storage210. Alternatively, the sounds may be preprogrammed to be associated with specific trigger mechanisms240or a combination of two or more trigger mechanisms240so that that use of the display230may not be necessary.

Once the user determines which sound segment they want, this selection is received320by the microprocessor205and it is retrieved from the storage210. The sound segment is forwarded to the sound decoder220, where it is decoded330and sent to the mixer225. The sound segment is then injected335, e.g., mixed, into the same voice channel as the voice communication. The mixed sound segment and voice communication is then output340through a microphone in the communication device120for the receiving user to hear through a speaker on that user's communication device. The process may then end345. Hence, if the selected sound segment was, for example, the first three chords of the song “Oh! Suzanna,” these chords would be injected into the voice channel and heard with the voice communication by both the person receiving the call and the person sending the transmission.

FIGS. 4aand4billustrate examples of additional processes that allow for populating the storage210of the conductor unit110with additional sound segments.FIG. 4aillustrates a flow diagram of a process of retrieving a sound segment from a network for storage in a conductor unit in accordance with one embodiment of the present invention. The network may be an Internet site to which the user would access and gain access to additional pre-recorded sound segments for downloading into the storage210. These sound segments may be in any audio data format, for example, such as those listed above.

Generally, the process starts405with the user accessing410a web site (e.g., HTTP, HTTPS, FTP or other connection). The user selects415a sound segment for download to the conductor unit110. The user may elect to associate420a name with the sound segment or associate one or more of the trigger mechanisms240with the sound segment. The sound segment is then downloaded (or transferred)425into storage before the process ends430.

It is noted that in one embodiment the user may connect to the web site through, for example, a web enabled communication device120that couples with the conductor unit110. In this embodiment sound segments may be made immediately available to the conductor unit110. Alternatively, the user may connect to the web site through a personal computer or the like, download the sound segment, and forward it to the conductor unit110at a later time, e.g., download through a USB port connection between personal computer and the CDI on the conductor unit110.

FIG. 4billustrates a flow diagram of a process for recording a sound segment from an external source for storage in a conductor unit in accordance with one embodiment of the present invention. The recorded sound segment can be through a recording mechanism, e.g., a microphone, that is built into the conductor and that is coupled with the microprocessor, function controls, and storage so that the sound can be recorded and stored directly by the conductor.

Generally, the process starts435with a user recording440a sound segment. Optionally, this recorded sound segment may be converted445into a digital format. In addition, the user may elect to associate450a name with the recorded sound segment or associate one or more of the trigger mechanisms240with the recorded sound segment. The sound segment is then downloaded (or transferred)455into storage before the process ends460.

Alternatively, external media sources such as MP3 players, CD players, tape players, or the like, may be a source of sound segments and may connect with the conductor unit110through the input port115, e.g., an audio (or stereo) jack. In yet another embodiment, the sound segments may be from a computer device, e.g., a stored audio data on a computer that connects to the conductor through a USB port or a communication transceiver. The sound from these external media sources can then be captured and stored in the storage. It is also noted that the sound segments from the external sources may also be passed through the conductor and mixed with the voice channel before being output through the speaker. In such embodiments, the sound segments would not need to be stored in the conductor.

In general, the present invention beneficially provides a system and a method for selecting and injecting audio data into a voice channel of a communication device so that both the person on a receiving end of voice data communication, and the person on the transmitting end, hear not only the voice communication through the voice channel, but also the selected audio data. Thus, a system and method in accordance with the present invention increases flexibility and use of the communication device and also enhances enjoyment of such a device.

Upon reading this disclosure, those of skill in the art will appreciate still additional alternative structural and functional designs for a technique for integrating sound segment directly within a voice channel in accordance with the disclosed principles of the present invention. In addition, the principles described herein may also apply to inserting motion or still frame video having associated sound segments into a voice channel. Thus, while particular embodiments and applications of the present invention have been illustrated and described, it is to be understood that the invention is not limited to the precise construction and components disclosed herein and that various modifications, changes and variations which will be apparent to those skilled in the art may be made in the arrangement, operation and details of the method and apparatus of the present invention disclosed herein without departing from the spirit and scope of the invention as defined in the appended claims.