Reproducing apparatus for karaoke use

Abstract: A reproducing apparatus (10) for a recording medium (1) recorded with compressed image data, audio data relating to musical accompaniment, character data relating to musical accompaniment, data showing the musical accompaniment scale, scale data for a scale change position and a position after a scale change and data showing a time passage relating to an audio signal relating to the musical accompaniment has an image reproducing unit, a reproducing unit (11), a signal generating unit (45, 67) and a mixer (44, 53). The image reproducing unitt decodes and reproduces image data read-out from the recording medium (1). The reproducing unit (11) reproduces audio signals relating to musical accompaniment, character data and data displaying a scale from the recording medium. The signal generating unit (45, 67) generates a harmony signal which becomes a chord for the audio signal outputted from a microphone (41) based on data displaying the scale played back by the playback part. The mixer (44, 53) mixes and outputs the audio signal outputted from the microphone (41), the audio signal reproduced be the reproducing unit (11) and the harmony signal from the signal generating unit (45, 67).

Description: The present invention relates to a reproducing apparatus for a medium for karaoke use. From JP-A-4 042 296 (=US 5,446,238) and from GB-A-2013386 are known voice processors for converting input voice signals to come in consonance with a chord information from an electronic music instrument. From EP-A2-0 282 458 is known an electronic instrument for automatically and simultaneously reproducing tones with preset frequency intervals (harmonies) based on tables. WO 88/05200 discloses an electronic entertainment device wherein audio signals receiver over a microphone and audio signals relating to background music (which may be prerecorded) are mixed such that the first mentioned audio signals are adapted to data associated to the last mentioned audio signals such that those a pleasant in the context. With karaoke apparatus, additional reverberation processing or frequency characteristic compensation is carried out on the singers voice i.e. the audio signal of singers, in order to enhance the results of the singers' singing. This processing and correction is widely used as good results can be obtained regardless of the song or lyrics etc. which are sung. However, as echo processing and frequency characteristic correction are widely used and common, marked effects cannot be obtained. It is therefore an object of the present invention to provide a reproducing apparatus for a medium which resolves the above-mentioned problem. The invention is set forth in the independent claims. Further features are set forth in the dependent claims. Embodiments of the invention are described in detail with respect to the accompanying drawings. FIG. 1 is a block diagram relating to a disc reproducing apparatus of a first embodiment of the present invention; FIGS. 2A and 2B are explanatory diagrams for describing the disc track format of a recording medium used for the present invention; FIG. 3 is a view showing an example of a data table; FIGS. 4A and 4B are views for describing musical interval difference; FIG. 5 is a view showing an example of a data format of a disc taken as a recording medium for a second embodiment of the present invention; and FIGS. 6A and 6B are views showing a data contents example. DESCRIPTION OF THE INVENTION (First Embodiment) The following is a detailed description, with reference to the drawings, of a reproducing apparatus for a recording medium for a first embodiment of the present invention. In the example disclosed in the following, a description is given taking as an example a case where the recording medium is a disc-shaped recording medium. In FIG. 1, a reference numeral 1 denotes a video CD taken as a disc recording medium for karaoke use and a reference numeral 10 denotes it's reproducing apparatus. The disc 1 is rotatably driven at a constant linear velocity by a rotational driving device not shown in the drawings. As shown in FIG. 2A, the disc 1 has a lead-in track at it's head portion, followed by N (N ≤ 99) data tracks TRK1 to TRKN and a lead-out track. Each of the various types of information and data relating to the disc i.e. the video CD contents are recorded on the first track TRK1 of the tracks TRK1 to TRKN. It is also recorded on track TRK1 that the disc 1 is a video CD for Karaoke use. An (N-1) song Karaoke data table is prepared at this first track TRK1, as shown in FIG. 2B. This table is referred to as the "sequence item table" and is constructed independently for every one song part. i.e. (N-1) sequence item tables SIT1 to SIT(N-1) corresponding to each karaoke song are provided. FIG. 3 shows a structure of an SITi (i = 1 to (N-1)) table with 64 clause sections. There are required and optional clauses but the contents of the clause sections can vary in length. For example, clause number 9 is taken as a song title section and it's contents is data displaying the song title as text data. Clause number 18 is taken to be the lyric clause section, with the lyrics being stored in text data form. Clause number 19 is prepared with data showing the scales (musical intervals) C, C# and Cm. The clause sections 22 to 31 of clause numbers 22 to 31 are left open for the manufacturer or the maker which manufactures recording media for karaoke use. The data of the video signal and the data of the audio signal of the karaoke for the first program is recorded in data compressed form on a second track TRK2. In this case, the data of the video signal, for example, a luminance signal and two color difference signals are data-compressed using an MPEG (Moving Picture Expert Coding Group) method and then recorded. With the data of the audio signal also, left and right channel signals are put into single blocks on every prescribed number of samples and each of these blocks are then data compressed and recorded. These video and audio signals are recorded in sector units but the sequence and number of video signal sectors and audio signal sectors i.e. the ration between the number of audio signal sectors and video signal sectors in not fixed. Because of this, data showing whether the signal recorded in a sector is a video signal or an audio signal is recorded together with other information at the head portion of each sector. The karaoke video signals and audio signals for the second to (N-1)th songs are recorded in data compressed states on the third to Nth tracks TRK3 to TRKN, respectively. At the reproducing apparatus 10, a signal recorded on the disc 1 is read out by an optical pick-up 11. The output signal from the optical pickup 11 is then supplied to a playback decoder 13 through a playback amplifier 12, where processes such as EFM demodulation and error correction are carried out. The signal processed by the playback decoder 13 is supplied to a CD-ROM decoder 14 where selector unit decode processing is carried out and each signal is outputted. The data for the first track TRK1 of the output signals from the decoder 14 is taken up by a system controller 66 constructed from a microcomputer and is hereafter used by the system controller 66 for reproduction control. The data of the video signal of the output signals from the decoder 14 are inputted to the decoder 21 and decoded into video signals i.e. a luminance signal and two chrominance signals. This decoded video signal is then D/A converted into an analog signal at the D/A converter 22. This D/A converted video signal is supplied to an NTSC encoder 23, encoded into an NTSC color composite video signal and outputted to a terminal 24. The data of the audio signal of the output signals from the decoder 14 is inputted to an MPEG decoder 31 and decoded into an audio signal, i.e. left and right channel audio signals relating to musical accompaniment for karaoke use. This decoded audio signal is supplied to a musical interval converting circuit 32. This converting circuit 32 makes it easy to sing by adjusting the musical interval of the provided audio signals into an audio band in which the singer can sing. A musical interval inputting unit 61 is therefore provided at the reproducing apparatus 10 in order to achieve this. When data designating the musical interval is inputted from this inputting unit 61, the inputted data is supplied to the converting circuit 32 through the system controller 66. This means that the musical interval of the audio signal being provided to the converting circuit 32 is transposed to the musical interval designated by the data inputted from the inputting unit 61. Further, an operator 62 for adjusting song speed is provided at the reproducing apparatus 10. The output of this operator 62 is supplied to the system controller 66. The rotational speed of the disc 1 and the playback speed of the video signal and audio signal controlled by the decoder circuits 21 and 31 are then changed in accordance with the output of the operator 62. Variations in a signal occurring due to changes in this speed are then corrected. The audio signal from the converting circuit 32 is supplied to a mixer 53 through an equalizer 33. In this case, the equalizer 33, for example, divides the karaoke audio signal into a number of bands and corrects the level for each band. An audio signal corresponding to the singers voice is supplied to an A/D converter 43 through an amplifier 42 and is A/D converted. This A/D converted audio signal is supplied to the aforementioned mixer 53 via an equalizer 51 and before being supplied to the mixer 53, through an echo processor 52. In this case, the equalizer 51 divides the signal corresponding to the singers voice up into a plurality of bands and corrects the level for each band. The echo processor 52 adds the desired reverberation to the audio signal corresponding to the singers voice provided. The audio signal read and reproduced from the disc 1 and the audio signal outputted from the microphone 41 are mixed at the mixer 53 i.e. an audio signal which is the singers voice with karaoke musical accompaniment is obtained. The audio signal outputted from the mixer 53 is supplied to the D/A converter 54, D/A converted, and outputted to the terminal 55. In the case of this invention, a harmony audio signal is formed from the audio signal outputted from the microphone 41 and this is added to the audio signal inputted through the microphone 41. Namely, the audio signal from the microphone 41 which is converted to a digital signal by the A/D converter 43 is supplied to a musical interval detection circuit 45 and the musical interval of the audio signal from the microphone 41 is detected. The detection signal which designed this musical interval is then supplied to a musical interval controller 67 composed of a microcomputer (CPU). The interval controller 67 generates musical interval data displaying a musical interval related to a chord with respect to a musical interval of an audio signal from a microphone 41 detected by the detection circuit 45. In this case, according to chord theory, the chord relationship is separated with respect to the musical interval of the audio signal from the microphone 41, i.e. the voice musical interval by +/- 3 tones or +/- 5 tones. However, according to experiment, if audio of a musical interval of +3 or +5 tones i.e. harmony is added, the singers musical interval tends to be drawn-into the musical interval of that which is added. Also, for a -5 tone musical interval which the musical interval of the singers voice is low, the harmony becomes too low and some of the harmonizing effect is lost. So, in the embodiments of the present invention, musical interval data showing a musical interval which is three tones down from the musical interval of the singers voice detected by the detection circuit 45 is generated at the interval controller 67. However, at this time, the musical interval difference (frequency ratio) of a musical interval three tones down from the vocal musical interval differs depending on the scale of the song. For example, in FIG. 4A a C-minor scale is shown but the musical interval 3 tones lower than Ab is F, with the musical interval difference being 300 cent. However, as shown in FIG. 4B, with a C-major scale the musical interval 3 tones lower than A is F# but the musical interval difference here is 400 cent. Also, in the C-minor scale in FIG. 4A, Eb is three tones lower than G, with the musical interval difference being 400 cent. Further, let specific numeric values be considered. i.e. fv: frequency of audio signal coming from microphone Δf: correction value of the frequency due to the converting circuit 32 Now, for example, by making fv = 437.4 Hz (= Ab4 + 2.9%) and Δf = +50 cent (= +2.9%) the vocal frequency when Δf = 0 is: fv - Δf = 427.4 (Hz) X 2** (-50/1200) = 415.3 (Hz) = Ab4 (x**y is x to the power of y). F is present 3 tones below Ab, and in the case of C-minor, the musical interval difference can be seen to be 300 cent from FIG. 4. Also, for example, by making fv = 403.5 Hz (= G4 + 2.9%) and Δf = +50 cent (= +2.9%), the vocal frequency when Δf = 0 is: fv - Δf = 403.5 (Hz) X 2**(-50/1200) = 392 (Hz) = G4 Here, Eb is present 3 tones down from G, and at the time of a C-scale, it becomes clear from FIG. 4A that the musical interval difference is 400 cent. So, in this embodiment of the present invention, a table showing the musical interval difference for each musical interval for every scale i.e. a musical interval difference table, is provided at the interval controller 67, as shown, for example, in FIGS. 4A and 4B. Also, data showing the scale of the karaoke musical accompaniment recorded in item number 19 (Fig. 3) is taken out from the data for the table SITi of the data for the first track TRK1 taken up by the system controller 66. This scale data is then supplied to the interval controller 67. At the interval controller 67, musical interval difference tables for each of the scales of the kind shown in FIGS. 4A and 4B are selected by the scale data recorded at item number 19. Musical interval data is then formed for a musical interval 3 tones down with respect to the musical interval of the singers voice using this selected musical interval difference table. Then, the audio signal from the microphone 41 converted into a digital signal by the A/D converter 43 is supplied to the musical interval transposer 46 and musical interval data is supplied from the interval controller 67 to the musical interval transposer 46. The audio signal from the microphone 41 is transposed to an audio signal for the musical interval transposer 46 for which the musical interval is 3 tones down, i.e. transposed to a harmony audio signal. This harmony audio signal is supplied to the mixer 44 and is mixed with the original audio signal i.e. the audio signal of the singers voice. An audio signal is therefore outputted from the mixer 44 which is the audio signal from the microphone 41 with harmonies added. An audio signal relating to the singers voice with harmonies added with the karaoke musical accompaniment reproduced from the disc 1 as background is then outputted from the terminal 55. According to the disc 1 and reproducing apparatus shown in FIG. 1, karaoke can be enjoyed. However, in this case, and in particular according to the aforementioned disc 1 and reproducing apparatus 10, harmonies can be automatically added to the singers vocals. As a result of this, during a song, and particularly in portions where the atmosphere comes to a climax and it is desired to sing, i.e. at a crescendo portion, harmonies can be added in an extremely effective manner. Harmonies can also be added in a manner which is in line with musical theory by using scale data included in the table SITi. Also, in cases where harmonies are added to the vocals by preparedly mixing and recording a harmonizing audio signal with an audio signal relating to karaoke musical accompaniment, the harmony is constant. According to the. present invention, by attaching harmonies in accordance with a singers vocals in such a manner that, for example, the harmonies disappear if the vocals disappear and the harmonies go out of time if the singers voice goes out of time, a very effective karaoke apparatus for public use can be obtained. Also, a key-change may occur midway, depending on the song. In doing so, the musical interval difference table is preparedly selected in accordance with the data for the scale recorded in item 19 (Fig. 3) of the table SITi, so the harmony structure will fall apart for this key-changed portion and become rather unpleasant. (Second Embodiment) As a result of this, the case described in the following for the second embodiment of this invention also corresponds with key changes in the middle of a song. The following description of the second embodiment describes portions which are distinct from the first embodiment. Other portions are constructed in the same way as for the first embodiment. In this second embodiment, the contents of, for example, item number 22 of item numbers 22 to 31 of the table SITi (Fig. 3) are made to be data showing a time position for the key change and the scale after the key change. As shown in FIG. 5, an eight-byte area for a one-time key change is allotted to item number 22 of the table SITi. The first and second bytes of these bytes are, for example, for the data EDS and EDK showing the scale after a key change, as shown in FIGs 6A and 6B. For example, when EDS = 20H (H denotes hexadecimal form), it is shown that the scale after key change is major, and when EDS = 21, a minor scale is shown. Also, when EDK = 30H, it is shown that the scale after key change is C and when EDK = 31H, Db is shown. Further, the third byte to the eighth byte are taken for data ET for displaying the minute, second and frame of the time of the key change. This minute, second and frame are written into an absolute address showing a reproducing position on the disc 1 i.e. written into the leading header portion of each sector of the disc 1. This key-change position is designated using absolute time data displaying the passage of time from the leading portion of this song. When a key change is carried out three or more times, the aforementioned eight bytes of data EDS to ET are taken to be one group and the data contents corresponding to each key change are repeated. This data EDS to ET is read out from the disc 1 when the disc 1 is installed in the reproducing apparatus 10 and is stored by the system controller 66. While the song is being reproduced, the key change time data ET from the data EDS to ET stored at the system controller 66 and the absolute time data played back from each sector of the disc 1 in real time are compared. When the absolute time position data ET and the absolute time data from the disc 1 both coincide, the scale data EDS and EDK for after the key change which has become a group with the key-change time position data ET which has coincided is transmitted to the interval controller 67. The musical interval difference table for the interval controller 67 is selected using the transmitted scale data EDS and EDK. Musical interval data is then generated designating a musical interval which is 3 tones down from the musical interval of the singers vocals using this selected musical interval difference table. This musical interval data is supplied to the musical interval transposer 46 and a harmony signal of a musical interval which is three tones down from the musical interval of the vocal audio signal after the key change is generated. Therefore, harmonizing of the correct chord structure can be achieved even if the key changes midway through a song. In the above, processing such as correcting frequency characteristics and echo processing can be carried out independently for the harmony audio signal. Also, rather than just being used for key changes, the data EDS and EDK can also be used for allowing and prohibiting the forming of a harmony audio signal. In this case, harmonies may be assigned only to a specific part of a singers vocals. In the above, a description has been given of the present invention applied to a disc such as a karaoke format video CD disc taken as a recording medium and it's reproducing apparatus. However, the present invention may also be applicable to, for example, with use of a usual music CD, an optical video disc or a karaoke system using communication network, as long as there is an audio signal for karaoke musical accompaniment and a medium having data displaying the karaoke scale.

Claims: A reproducing apparatus for a medium (1), the medium (1) having an audio signal related to musical accompaniment and data showing the scale of said musical accompaniment, said apparatus comprising: reproducing means (10) for reproducing from said medium (1) an audio signal relating to said musical accompaniment and the data showing the scale thereof, signal generating means (45, 67) for generating a harmony signal forming a chord suitable to an audio signal outputted from a microphone (41) based on said data showing the scale being reproduced by said reproducing means (10), and mixing means (44, 53-55) for mixing and outputting the audio signal outputted from the microphone (41), the audio signal reproduced by said reproducing means (10), and the harmony signal generated by said signal generating means (45, 67). A reproducing apparatus for a medium according to claim 1, wherein said signal generating means (45, 67) comprises a musical interval difference table having data displaying a musical interval difference of each musical interval of every scale, and selects musical interval difference data from said musical interval difference table based on data (EDS, EDK) displaying the scale being reproduced by said reproducing means (10) so as to generate the harmony signal forming the chord with respect to the audio signal outputted from the microphone (41) using the selected musical interval difference data. A reproducing apparatus for medium according to claim 2, wherein said signal generating means (45, 67) further comprises a musical interval transposing means (46), said signal generating means (45, 67) generates musical interval data based on the selected musical interval difference data, and said musical interval transposing means (46) transposes the audio signal outputted from the microphone (41) to the harmony signal forming the chord based on the generated musical interval data. A reproducing apparatus for a medium (1) according to anyone of claims 1 to 3, said medium (1) further comprising character data relating to the musical accompaniment, data displaying a key change position and scale data relating to before and after said key change, wherein said reproducing means (10) further reproduces said character data, said scale data, and said key change position data, said signal generating means (45, 67) is further controlling the scale of the harmony signal being generated based on said scale data and said key change position data generated by said reproducing means (10). A reproducing apparatus for a medium according to claim 4 when dependent on claim 2 or 3, wherein said signal generating means (45, 67) selects the musical interval difference data from said musical interval difference table so as to generate the harmony signal forming the chord using selected musical interval difference data, the harmony signal being a key-changed harmony signal based on said scale data reproduced by said reproducing means (10) after key-changing. A reproducing apparatus for a medium according to claim 5, when dependent on claim 3, wherein said musical interval transposing means (46) transposes the audio signal outputted from the microphone (41) based on the generated musical interval data to a harmony signal forming a chord and key-changed based on scale data reproduced by said reproducing means (11) after a key change. A reproducing apparatus for a recording medium (1), according to anyone of claims 4 to 6, the recording medium (1) further having data (EDS, EDK, ET) relating to a time passage relating to the audio signal relating to the musical accompaniment and further comprising control means (66) for detecting data displaying the time passage relating to the audio signal relating to the musical accompaniment recorded on the recording medium (1), controlling said signal generating means (45, 67) based on data showing said key-changed position reproduced by said reproducing means (10) and changing the key of the harmony signal based on scale data reproduced by said reproducing means (11) after a key-change. A reproducing apparatus for a recording medium according to claim 7 when dependent on claim 6, wherein said reproducing apparatus (10) further comprises speed changing means (62) for changing a record medium playback speed and said musical interval transposing means (46) transposes an audio signal relating to the audio accompaniment reproduced by said reproducing means (11) at a playback speed changed by said speed changing means (62).

Inventors: NAKAMURA JUNICHI, NAKAMURA, JUNICHI, NAKAMURA, JUNICHI, C/O SONY CORPORATION
Applicants: SONY CORP, SONY CORPORATION
Application year: 1995
Main classification: G10H1
IPC codes: G10H1, G11B20, G10K15