Sound generation control apparatus

A sound generation control apparatus displays in a loop region a music data image corresponding to music data to be generated as time progresses, such that progression of the music data corresponds to a lengthwise position of the loop region. The sound generation control apparatus outputs time information indicating the time that progresses from a start of generation of music sound. The sound generation control apparatus controls the generation of the music sound based on the music data according to a relationship between a lengthwise position of the loop region and a displayed location of the music data image in the loop region. The sound generation control apparatus displays a plurality of the music data images in the loop region, and simultaneously generates a plurality of music sounds corresponding to the plurality of the music data images as the time progresses.

BACKGROUND OF THE INVENTION

1. Technical Field of the Invention

The present invention relates to a sound generation control apparatus.

2. Description of the Related Art

In a conventional music composition apparatus, a piece of music is composed by selecting desired data which specifies the content of music sound to be generated (hereinafter referred to as “sound generation data”) from a plurality of sound generation data and by arranging the selected sound generation data in chronological order for generation of music sound of the sound generation data. Japanese Patent Application Publication No. 2003-108127 describes a technology in which a piece of music is composed by selecting a rhythmic pattern of one measure (i.e., a combination of sound generation data of one measure) on a pattern select screen and by arranging the selected rhythmic pattern on a pattern sequencer screen. Each rhythmic pattern is previously composed on a pattern edit screen.

Some music plays in a loop. This type of music is referred to as “loop music”. A loop of music may be composed in the following manner. First, a plurality of music data, each including a plurality of sound generation data arranged in chronological order for generation of music sound of the sound generation data, are created. Then, the plurality of music data is edited (for example, the sound generation timings of the plurality of music data are changed) while repeatedly performing simultaneous sound generation of the plurality of music data, thereby composing the loop music. However, with the configuration of the music composition apparatus described in Japanese Patent Application Publication No. 2003-108127, it is difficult for a loop music composer to compose a desired loop of music while changing sound generation timings of a plurality of music data.

SUMMARY OF THE INVENTION

Therefore, it is an object of the invention to provide a sound generation control apparatus which allows the user to easily and visually identify relationships among a plurality of music data when repeatedly performing simultaneous sound generation of the plurality of music data.

To achieve the above object, the invention provides a sound generation control apparatus comprising: a display control unit that defines on a display device a loop region having an outer periphery surrounding a reference point and indicating progression of time in association with a length in a circumferential direction of the loop region, and that displays in the loop region a music data image corresponding to music data which specifies content of music sound to be generated as time progresses, wherein the music data image is displayed in the loop region such that progression of the music data corresponds to the length in the circumferential direction of the loop region; a time output unit that outputs, upon receiving an instruction to start generation of the music sound, time information indicating a time that progresses from a timing corresponding to the instruction; and a sound generation control unit that controls the content of the music sound to be generated by a sound generation device based on the music data corresponding to the music data image and according to a relationship between a position in the circumferential direction of the loop region determined by the time information outputted by the time output unit and a location of the music data image in the loop region, wherein the display control unit performs control operation for displaying a plurality of music data images in the loop region on the display device, and the sound generation control unit performs control operation for simultaneously generating a plurality of music sounds corresponding to the plurality of the music data images as the time progresses.

In the sound generation control apparatus, the display control unit may perform control operation for moving one or more of the plurality of the music data images in the circumferential direction of the loop region according to an instruction so as to change relative locations among the plurality of the music data images in the loop region.

The display control unit may include a zone specification unit that specifies a zone in the circumferential direction of the loop region, wherein the sound generation control unit changes the content of the music sound to be generated by the sound generation device when the position determined according to the time information is within the zone specified by the zone specification unit. Specifically,

In the sound generation control apparatus, the display control unit may define a plurality of loop regions, and may display a plurality of the music data images in at least two of the plurality of the loop regions. Specifically, the display control unit defines the plurality of the loop regions arranged concentric with each other around the reference point common to the plurality of the loop regions.

Alternatively, the display control unit may define a loop region common to the plurality of the music data images, and may display the plurality of the music data images in the common loop region by different manners such that the plurality of the music data images are visually discriminated from each other.

Preferably, the display control unit defines a loop region having an annular shape geometrically symmetric with respect to the reference point.

Preferably, the display control unit displays an indicator which indicates the position in the circumferential direction of the loop region determined by the time information, such that the indicator travels in the circumferential direction of the loop region as the time progresses, and the sound generation control unit performs the control operation for generating the plurality of the music sounds in looping manner as the indicator travels cyclically through the loop region.

The invention further provides a method of controlling generation of music sounds with aide of a display device, the method comprising the steps of: defining on the display device a loop region having an outer periphery surrounding a reference point and indicating progression of time in association with a length in a circumferential direction of the loop region; displaying in the loop region a music data image corresponding to music data which specifies content of music sound to be generated as time progresses, wherein the music data image is displayed in the loop region such that progression of the music data corresponds to the length in the circumferential direction of the loop region; outputting, upon receiving an instruction to start generation of the music sound, time information indicating a time that progresses from a timing corresponding to the instruction; and generating the music sound based on the music data corresponding to the music data image and according to a relationship between a position in the circumferential direction of the loop region determined by the time information and a location of the music data image in the loop region, wherein the step of displaying displays a plurality of music data images in the loop region, and the step of generating simultaneously generates a plurality of music sounds corresponding to the plurality of the music data images as the time progresses.

The invention further provides a machine readable storage medium for use in a computer having a processor and a display device, the medium containing program instructions executable by the processor for controlling generation of music sounds with aide of the display device by processes of: defining on the display device a loop region having an outer periphery surrounding a reference point and indicating progression of time in association with a length in a circumferential direction of the loop region; displaying in the loop region a music data image corresponding to music data which specifies content of music sound to be generated as time progresses, wherein the music data image is displayed in the loop region such that progression of the music data corresponds to the length in the circumferential direction of the loop region; outputting, upon receiving an instruction to start generation of the music sound, time information indicating a time that progresses from a timing corresponding to the instruction; and generating the music sound based on the music data corresponding to the music data image and according to a relationship between a position in the circumferential direction of the loop region determined by the time information and a location of the music data image in the loop region, wherein the process of displaying displays a plurality of music data images in the loop region, and the process of generating simultaneously generates a plurality of music sounds corresponding to the plurality of the music data images as the time progresses.

According to the invention, it is possible to provide a sound generation control apparatus which allows the user to easily and visually identify relationships among a plurality of music data when repeatedly performing simultaneous sound generation of the plurality of music data.

DETAILED DESCRIPTION OF THE INVENTION

Embodiments

FIG. 1is a block diagram illustrating a configuration of a sound generation control apparatus10according to an embodiment of the invention. A control device110includes an arithmetic unit such as a Central Processing Unit (CPU) and a memory means such as a Random Access Memory (RAM) or a Read Only Memory (ROM). The CPU loads a sound generation control program stored in the ROM into the RAM and executes the sound generation control program to control components of the sound generation control apparatus10through a bus to implement various functions. The RAM functions as a work area when the CPU performs processing or the like on each piece of data. The control device110has a timer function to measure the time that progresses from a specific time, and controls the operations of the components of the sound generation control apparatus10, which will be described later, according to the progressing time.

A storage device120is a storage means such as a nonvolatile memory and stores data (hereinafter referred to as “sound generation data”) that specifies the content of a unit sound to be generated and music data that specifies the content of unit sound to be generated as time elapses. In this example, the sound generation data represents a waveform signal of musical sound of a predetermined time length (for example, several hundred milliseconds). The music data associates sound generation data with the timing of generation of a unit sound represented by the sound generation data. The storage device120stores image data representing images to be displayed and setting data associated with display of the images or sound generation. Instead of the ROM, the storage device120may also store the control program. The storage device120may also be a storage means such as an external nonvolatile memory connected to the sound generation control apparatus10through a connection interface.

A manipulation device130is a manipulation means such as a mouse, a keyboard, or a touch sensor through which the user performs a variety of manipulations on the sound generation control apparatus10. The manipulation device130outputs information representing a manipulation performed through the manipulation device130to the control device110.

A display device140is a display means such as a liquid crystal display including a screen141for displaying an image under control of the control device110. A touch sensor is provided on a display portion of the screen141such that the screen141functions as a touch panel.

A sound generation device150is a sound generation means that includes a Digital Signal Processor (DSP), a speaker, and the like and performs sound generation under control of the control device110.

An interface160is, for example, a connection terminal that is connected to an external device by wire, a wireless connection means that is wirelessly connected to the external device, or a communication means that is connected to the external device through a base station, a network, or the like, and transmits and receives a variety of data to and from the connected external device.

[Configuration of Sound Generation Control Function]

Next, a sound generation control function that the control device110implements by executing the sound generation control program is described below with reference toFIG. 2. All or part of the components for implementing the sound generation control function described below may also be implemented by hardware.

FIG. 2is a block diagram illustrating a configuration of the sound generation control function. The control device110constructs a display control unit111, a time output unit112, and a sound generation control unit113by executing the sound generation control program to implement the sound generation control function.

Upon receiving an instruction to start operation output from the manipulation device130, the time output unit112generates time information representing a time that has elapsed from a time corresponding to the instruction. The time output unit112outputs the generated time information to the display control unit111. For example, the time output unit112immediately generates time information upon receiving the instruction. The time output unit112may also receive an instruction to start operation from each component other than the manipulation device130.

The display control unit111acquires image data of an image (hereinafter referred to as a “sequencer image”) representing a sequencer used to reproduce music data from the storage device120. The display control unit111acquires setting data of the position and direction of display of the sequencer image from the storage device120. The display control unit111controls the display device140to display the sequencer image on the screen141using the acquired image data and setting data. The display control unit111acquires image data of an image (hereinafter referred to as a “sound generation data image”) corresponding to sound generation data from the storage device120based on an instruction received from the manipulation device130. In this example, the sound generation data image is an image corresponding to the name, feature, and the like of the sound generation data. The display control unit111acquires setting data of the position and direction of display of the sound generation data image from the storage device120. The display control unit111controls the display device140to display the sound generation data image on the screen141using the acquired image data and setting data.

The display control unit111acquires image data of an image (hereinafter referred to as a “music data image”) corresponding to music data based on an instruction received from the manipulation device130. In this example, the music data image is an image corresponding to the content of music data. The display control unit111displays the music data image so as to superimpose on the sequencer image on the screen141based on the acquired image data and the setting data of the sequencer image. The display control unit111causes the screen141to display an image (hereinafter referred to as “sound generation indication image”) indicating the position of sound generation based on time information received from the time output unit112. The display control unit111outputs music data corresponding to the music data image and information of a position, at which sound generation of the music data starts, to the sound generation control unit113based on both the time information and a position at which the music data image is displayed. As a result, the display control unit111outputs information required for sound generation control to the sound generation control unit113according to a relationship between the positions at which the sound generation indication image and the music data image are displayed.

The sound generation control unit113acquires, from the storage device120, sound generation data represented by the information acquired from the display control unit111. The sound generation control unit113controls the sound generation device150to generate sound based on the acquired sound generation data.

[Configuration of Screen of Sound Generation Control Function]

FIG. 3illustrates exemplary display of the screen141provided on the sound generation control apparatus10. A circular sequencer image20, a rectangular sequencer image30, and a sound generation data image group40are displayed on the screen141. The sound generation data image group40is an image including a plurality of sound generation data images displayed such that the sound generation data images are arranged in a horizontal direction of the screen141. In this embodiment, the sound generation data image group40includes sound generation data images400A,400B,400C, . . . , and400P which will each be referred to as a “sound generation data image400” when a specific one is not indicated. The sound generation data images400A,400B,400C, . . . , and400P correspond to sound generation data A, B, C, . . . , and P, respectively.

The circular sequencer image20is one of the sequencer images described above. The circular sequencer image20includes a circular image210having an outer periphery surrounding a center point201. Here, the term “circular” indicates a form having an inner periphery and an outer periphery. The circular image210includes circular regions221,222, and223which will each be referred to as a “circular region220” when a specific one is not indicated. Each circular region220includes an inner periphery and an outer periphery surrounding the center point201. In this embodiment, each of the inner and the outer peripheries of the circular region220has a circumferential shape centered on the center point201.

The circular region220is divided into beat regions by beat lines202that extend radially from the center point201. Here, it is assumed that a length of the circular region220in a clockwise circumferential direction D1specifies elapsed time. The beat lines202are arranged at regular intervals and represent a meter that is a basic rhythm occurring at regular time intervals. The length of the beat region in the circumferential direction D1represents the beat length of the beat region. One circumference of the circular region220represents beats that are repeated at regular intervals. The number of the beat lines202and the number of the beat regions are not limited to the illustrated ones and may be changed according to settings.

Music data images411,412,413, each corresponding to music data representing a piece of music having a specific number of beats, are displayed in a superimposed manner on the circular regions220. The music data images411,412,413will each be referred to as a “music data image410” when a specific one is not indicated. Each of the music data images410is displayed such that an elapsed time of corresponding music data corresponds to the length of the corresponding circular region220in the circumferential direction D1. For ease of explanation, the music data images410are hatched inFIG. 3. The music data images411,412, and413correspond respectively to music data of 16 beats, music data of 6 beats, and music data of 8 beats. The music data images411,412, and413have start positions411S,412S, and413S, each representing the start of a corresponding piece of music, respectively. The start positions411S,412S, and413S will each be referred to as a “start position410S” when a specific one is not indicated. The music data images411,412, and413also have end positions411E,412E, and413E, each representing the end of a corresponding piece of music, respectively. The end positions411E,412E, and413E will each be referred to as an “end position410E” when a specific one is not indicated. The start position411S and the end position411E are displayed on the same beat line202, because the music data image411is displayed entirely in the corresponding circular or loop region221.

Sound generation display regions, each indicating both the contents of sounds to be generated in corresponding music data and the timing of generation of the sounds, are arranged in each of the music data images410. For example, sound generation display regions421A1,421B1, and421A2are arranged in the music data image411. The sound generation display regions421A1,421B1, and421A2will each be referred to as a “sound generation display region421” when a specific one is not indicated. Images corresponding to sound generation data images400A,400B, and400A are displayed in the sound generation display regions421A1,421B1, and421A2, respectively. Similar to the corresponding sound generation data images400A,400B, and400A, sound generation data A, B, and A correspond respectively to the sound generation display regions421A1,421B1, and421A2. In the music data image411, a location of each sound generation display region421with respect to the start position411S in the circumferential direction D1indicates the timing of sound generation of corresponding music data in the music data image411.

For example, in the music data image411, the sound generation display regions421A1,421B1, and421A2are located respectively in the 1st, 7th, and 10th beat regions relative to the start position411S. In this case, the sound generation display regions421A1,421B1, and421A2indicate that sounds represented by the sound generation data A, B, and A are generated in the 1st, 7th, and 10th beats relative to the start of the piece of music. The position or location of each of the sound generation display regions421in the circumferential direction D1in the corresponding beat region indicates the timing of generation of the corresponding sound within the beat. For example, the sound generation display region421A1is located at a front portion of the 1st beat region in the circumferential direction D1and thus indicates that the corresponding sound is generated at the start of the 1st beat. The sound generation display region421A2is located at the middle of the 10th beat region in the circumferential direction D1and thus indicates that the corresponding sound is generated at the middle of the 10th beat. The music data image410is not limited to an image representing the entire region of the music data, and may merely be an image representing the content of each sound to be generated and the sound generation timing of the sound. For example, the music data image410may consist only of a start position410S, an end position410E, and sound generation display regions which are fixed in position relative to each other.

A sound generation indication image230is a line image which is in contact with both the inner and outer peripheries of the circular image210and which has a longitudinal direction directed to the center point201. When the sound generation indication image230is displayed at another position of the circular image210, the sound generation indication image230is also displayed such that the longitudinal direction of the sound generation indication image230is directed to the center point201depending on the position. The sound generation indication image230is an indicator which indicates a position (hereinafter referred to as a “circumferential position”) in the circumferential direction D1of the circular image210. The sound generation indication image230is displayed while the circumferential position thereof is sequentially changed according to the time information output from the time output unit112. The user perceives the sound generation indication image230as moving since the sound generation indication image230is displayed while the circumferential position thereof is sequentially changed. The speed at which the sound generation indication image230moves is set according to both the tempo of the piece of music, whose sound is generated, and the number of beat regions included in the circular region220. For example, the sound generation indication image230moves at a speed of 120 beat regions per minute when the tempo is set to 120 Beat Per Minute (BPM).

The rectangular sequencer image30includes a rectangular image310and a manipulation button image group340. The rectangular image310has a rectangular shape elongated in the horizontal direction of the screen141. The rectangular image310corresponds to music data representing a piece of music having a specific number of beats. The rectangular image310has a configuration similar to the music data image410. A start position310S, an end position310E, and beat lines302in the rectangular image310correspond to the start position410S, the end position410E, and the beat lines202in the music data image410. The rectangular image310has beat regions and sound generation display regions, similar to the music data image410.

A length of the rectangular image310in a longitudinal direction D2indicates elapsed time. In the example ofFIG. 3, the rectangular image310corresponds to the same music data as that of the music data image411. The rectangular image310has sound generation display regions320A1,320B1, and320A2in 1st, 7th, and 10th beat regions, respectively. The number of the beat lines302and the number of the beat regions in the rectangular image310are not limited to the illustrated ones and may be changed according to manipulation. In addition, the number of the beat regions need not correspond to an integer number of beats and may be, for example, 8.5.

A sound generation indication image330is a line image that is in contact with both ends of the rectangular image310perpendicular to the longitudinal direction of the beat lines302of the rectangular image310. Thus, the sound generation indication image330is displayed such that the longitudinal direction of the sound generation indication image330is directed in the longitudinal direction of the beat lines302. The sound generation indication image330indicates a position in the longitudinal direction D2of the rectangular image310which will hereinafter be referred to as a “longitudinal position”. The sound generation indication image330is displayed while the longitudinal position thereof is sequentially changed according to the time information output from the time output unit112.

The manipulation button image group340includes a playback button image341, a stop button image342, a record button image343, a delete button image344, and a assign button image345. When one of these button images is selected according to manipulation (hereinafter simply referred to as “selected”), the display control unit111, the time output unit112, and the sound generation control unit113perform control operation according to the selected button image. When the playback button image341is selected, the time output unit112outputs generated time information. The display control unit111outputs information required for sound generation control to the sound generation control unit113based on the input time information. The sound generation control unit113causes the sound generation device150to generate sound based on input information. When the stop button image342is selected, the time output unit112stops outputting the time information. Accordingly, the display control unit111stops outputting information to the sound generation control unit113and the sound generation control unit113stops the sound generation operation. In this manner, the music data begins to be reproduced upon selection of the playback button image341and reproduction of the music data is stopped upon selection of the stop button image342.

When the record button image343is selected, the display control unit111displays the sound generation indication image330based on time information output from the time output unit112. If the user selects a sound generation data image400in this state, the display control unit111specifies a position at which the sound generation indication image330is displayed upon selection of the sound generation data image400. The display control unit111displays the rectangular image310in which a sound generation display region320corresponding to the selected sound generation data image400is allocated at the specified position. In this manner, the display control unit111generates music data whose sound generation timing and sound generation data are represented by the rectangular image310in which the sound generation display region320is arranged. This state is terminated as the stop button image342is selected.

When the delete button image344is selected and a sound generation display region320is subsequently selected, the display control unit111deletes sound generation data of a sound generation timing corresponding to the position of the sound generation display region320from the music data. As a result, the sound generation display region320is deleted from the rectangular image310. When the assign button image345is selected and a circular loop region220is subsequently selected, the display control unit111displays music data corresponding to the rectangular image310as a music data image410on the selected circular loop region220. As a result, music data corresponding to the rectangular image310is assigned to the circular region220. For example, inFIG. 3, music data corresponding to the rectangular image310is assigned to the circular loop region221.

As described above, the inventive sound generation control apparatus10is basically constructed by a display control unit111, a time output unit112and a sound generation control unit113. The display control unit111defines on a display device140a loop region220having an outer periphery surrounding a reference point201and indicating progression of time in association with a length in a circumferential direction D1of the loop region220, and displays in the loop region220a music data image410corresponding to music data which specifies content of music sound to be generated as time progresses, wherein the music data image410is displayed in the loop region220such that progression of the music data corresponds to the length in the circumferential direction D1of the loop region220. The time output unit112outputs, upon receiving an instruction to start generation of the music sound, time information indicating a time that progresses from a timing corresponding to the instruction. The sound generation control unit113controls the content of the music sound to be generated by a sound generation device150based on the music data corresponding to the music data image410and according to a relationship between a position in the circumferential direction D1of the loop region220determined by the time information (230) outputted by the time output unit112and a location of the music data image410in the loop region220. Characterizingly, the display control unit111performs control operation for displaying a plurality of music data images411,412and413in the loop region410on the display device140, and the sound generation control unit113performs control operation for simultaneously generating a plurality of music sounds corresponding to the plurality of the music data images411,412and413as the time progresses.

Expediently, the display control unit111defines a plurality of loop regions221,222and223, and displays a plurality of the music data images411,412and413in at least two of the plurality of the loop regions221,222and223. Specifically, the display control unit111defines the plurality of the loop regions221,222and223arranged concentric with each other around the reference point201common to the plurality of the loop regions221,222and223.

Expediently, the display control unit111displays an indicator230which indicates the position in the circumferential direction D1of the loop region220determined by the time information, such that the indicator230travels in the circumferential direction D1of the loop region220as the time progresses, and the sound generation control unit113performs the control operation for generating the plurality of the music sounds in looping manner as the indicator230travels cyclically through the loop region220.

The above is a description of the components for implementing the sound generation control function. The following is a description of examples of content displayed on the screen141under control of the display control unit111described above.

[Exemplary Display in Sound Generation Control Function]

FIGS. 4,5,6, and7illustrate first, second, third, and fourth exemplary display of the screen141in the sound generation control function. First, when the sound generation control function starts, the display control unit111displays content shown inFIG. 4on the screen141. Specifically, the display control unit111displays a circular sequencer image20, a rectangular sequencer image30, and a sound generation data image group40on the screen141. The display control unit111displays circular regions220, beat lines202, beat lines302, and sound generation data images400on the screen141. In the example ofFIG. 4, the display control unit111displays 3 circular regions220, 16 beat lines202, 15 beat lines302, and 16 sound generation data images400. When settings of the numbers of these images are changed, the display control unit111displays the changed numbers of the images.

When one music data image is assigned to a circular region in the display state ofFIG. 4, the display state is switched to a display state ofFIG. 5. The user selects one of the sound generation data images400through manipulation and then specifies a specific position on the rectangular image310. The display control unit111displays the rectangular image310in which a sound generation display region320corresponding to the selected sound generation data image400is arranged at the specified position. In the example ofFIG. 5, the display control unit111displays a rectangular image310including sound generation display regions320corresponding to sound generation data images400A and400B. In this state, the user selects the playback button image341through manipulation. This allows the display control unit111, the time output unit112, and the sound generation control unit113to reproduce music data corresponding to the rectangular image310. The user edits the music data by adding or deleting a sound generation display region320or changing the position of a sound generation display region320while listening to the reproduced sound of the music data.

After composing and editing the music data, the user selects the assign button image345through manipulation. The display control unit111displays a music data image346representing music data corresponding to the rectangular image310on the screen141. If the user selects the circular region221through manipulation in this state, the display control unit111displays a music data image411corresponding to the music data in the circular region221. Here, the user may freely select the position of the start position411S through manipulation. In the example ofFIG. 5, the start position411S is located at an upper portion of a beat line202that extends in a vertical direction of the screen141.

When two music data images are additionally assigned to the display state ofFIG. 5, the display state is switched to a display state ofFIG. 6. The display control unit111displays a music data image412corresponding to music data of 6 beats in the circular region222and displays a music data image413corresponding to music data of 8 beats in the circular region223. When the user instructs reproduction of music through manipulation, the display control unit111displays a sound generation indication image230at a position in the circumferential direction D1in the circular regions220, the position being determined from a specific position in the circular region220according to time information output from the time output unit112. This specific position is, for example, a position at which the sound generation indication image230is displayed last or a position that is predetermined through setting. The sound generation control unit113performs sound generation through the sound generation device150based on both a relationship between a position at which the sound generation indication image230is currently displayed and the location of the music data image410in the circular region and music data corresponding to the music data image410.

When the locations of the music data images are changed in the display state ofFIG. 6, the display state is switched to a display state ofFIG. 7. The display control unit111displays the music data images410in the circular regions220, respectively. In this state, the user manipulates the manipulation device130so as to move a music data image410in the circumferential direction D1. According to this manipulation, the display control unit111displays the music data image410at the position to which the music data image410has moved along the circumferential direction D1. In the example ofFIG. 7, the display control unit111displays the music data image411at a position to which the music data image411has moved by 4 beat regions from the position shown inFIG. 6along the circumferential direction D1. The display control unit111also displays the music data image412at a position to which the music data image412has moved by 14.5 beat regions from the position shown inFIG. 6along the circumferential direction D1, and the music data image413at a position to which the music data image413has moved by one beat region from the position shown inFIG. 6along the circumferential direction D1. The display control unit111operates in this manner to control display of a plurality of music data images so as to move each of the plurality of music data images along the circumferential direction D1according to an instruction received from the outside and to change a positional relationship between the music data images accordingly. Namely, the display control unit111performs control operation for moving one or more of the plurality of the music data images411,412and413in the circumferential direction D1of the loop region220according to an instruction so as to change relative locations among the plurality of the music data images411,412and413in the loop region220.

Through the above operations of the components of the sound generation control apparatus10, the user can edit each of a plurality of music data while changing reproduction timings of the plurality of music data. Here, it is also easy for the user to visually perceive the intervals between sound generation timings of sound generation data images400arranged in different circular regions220based on respective radial directions of the sound generation data images400with respect to the center point201. Therefore, the user can compose loop music while appropriately adjusting the intervals among sound generation timings of a plurality of music data even when repeatedly performing sound generation of the plurality of music data while changing the sound generation timings of the plurality of music data.

Although the embodiment of the invention has been described above, the invention may also be implemented in other forms.

Although the display control unit111displays one music data image410in one circular region220in the above embodiment, the invention is not limited to this example and a plurality of music data images410may be displayed on one circular region220. In this case, to allow the user to easily identify regions in which the music data images410are displayed, the display control unit111may display the music data images410and overlapping regions of the music data images410in different manners such as different colors or different hatchings.

FIG. 8illustrates a circular sequencer image20according to Modification 1. The display control unit111displays a music data image414representing a piece of music of 8 beats and a music data image415representing a piece of music of 6 beats in a circular region221. The music data image414includes a start position414S, an end position414E, and sound generation display regions424C1,424A1, and424C2. The music data image415includes a start position415S, an end position415E, and sound generation display regions425G1,425G2, and425B1. In the example ofFIG. 8, the display control unit111displays the music data image414and the music data image415such that 7th and 8th beat regions of the music data image414and 1st and 2nd beat regions of the music data image415overlap. The 1st to 6th beat regions of the music data image414, the 3rd to 6th beat regions of the music data image415, and the beat regions in which the two music data images414and415overlap are displayed as an image410B, an image410G, and an image410C, respectively, which are indicated by different hatchings. In this case, the display control unit111may display the image410B in blue, the image410G in green, and the image410C in cyan. These colors may be freely changed according to the settings. As described above, the display control unit111defines a loop region221common to the plurality of the music data images414and415, and displays the plurality of the music data images414and415in the common loop region221by different manners such that the plurality of the music data images414and415are visually discriminated from each other

Although the display control unit111displays the 3 circular regions221,222, and223in the above embodiment, the display control unit111may also display a different number of circular regions220according to the settings. The user may edit the music by changing the performance timings of the same number of music data images410as the number of the circular regions220while simultaneously performing sound generation of the music data images410. The display control unit111may also change the settings to display a different number of circular regions220after displaying a specific number of circular regions220.

Although the display control unit111displays the circular regions220, each of which is divided into the same number of beat regions in the above embodiment, the display control unit111may also display circular regions220which are divided into different numbers of beat regions. For example, the display control unit111may display a circular region221which is divided into 16 beat regions, a circular region222which is divided into 8 beat regions, and a circular region223which is divided into 24 beat regions. In this case, the display control unit111may display a sound generation indication image230so as to match the setting of the tempo of one of the circular regions221,222, and223.

FIG. 9illustrates a circular sequencer image20according to Modification 3. The display control unit111displays circular regions221,222, and223which are divided into 16 beat regions, 8 beat regions, and 24 beat regions by beat lines202a, beat lines202b, and beat lines202c, respectively. The number of beat regions into which each circular region220is divided may be freely changed according to the settings. For example, the number of beat regions of each circular region220may also be set according to the number of beats of corresponding music data composed on the rectangular sequencer image30when the music data is assigned. The number of beat regions of each circular region220may also be individually set for each circular region220selected through manipulation.

Although the display control unit111displays the circular regions220having the same widths in the radial direction from the center point201in the above embodiment, the display control unit111may also display circular regions220having different radial widths. The radial widths of the circular regions220may be freely changed according to the settings. The radial widths may be fixed according to the settings and may also be changed in real time. The sound generation control unit113may perform sound generation of each circular region220while changing the feature of generated sound according to the width of the circular region220. For example, the sound generation control unit113may perform sound generation of each circular region220such that the volume of generated sound of sound generation data corresponding to a sound generation data image400displayed in the circular region220increases as the radial width of the circular region220increases. The display control unit111may also display each circular region220while changing the radial width of each circular region220in real time according to the feature of assigned music data. For example, the display control unit111may display each circular region220such that the radial width of the circular region220increases as the number of sound generation data images400arranged in the circular region220increases.

FIG. 10illustrates a circular sequencer image20according to Modification 4. In the example ofFIG. 10, the display control unit111displays 2, 3, and 6 sound generation data images400in circular regions221,222, and223, respectively. The display control unit111displays each of the circular regions221,222, and223such that the width of the circular region increases as the number of sound generation data images400in the circular region increases.

Although the display control unit111displays the inner and outer peripheries of each circular region220in circular shapes in the above embodiment, the invention is not limited to the circular peripheries and the inner and outer peripheries of each circular region220may be displayed in other shapes. For example, the display control unit111may display the inner and outer peripheries of each ringed or annular region220in elliptical or rectangular shapes. In this case, the outer peripheries of the loop regions are in similar shapes. The display control unit111preferably displays the reference point201at the center of each loop region220. The display control unit111may display a loop region220closest to the center point201as a region having no inner periphery. Also in this case, the loop region220may have an outer periphery surrounding the center point201.

FIGS. 11(a) to11(c) illustrate sequencer images20according to Modification 5.FIG. 11(a) illustrates a sequencer image20including loop regions220having elliptical inner and outer peripheries.FIG. 11(b) illustrates a sequencer image20including loop regions220having inner and outer peripheries that are triangular with rounded corners.FIG. 11(c) illustrates a sequencer image20including circular regions220, among which a circular region220closest to the center point201has no inner periphery. In allFIGS. 11(a) to11(c), the display control unit111displays the concentrical loop regions220having similar shapes. InFIGS. 11(a) and11(b), the display control unit111displays beat regions having shapes that vary depending on positions thereof in circumferential directions D3and D4. Namely, the display control unit111defines a loop region220having an annular shape geometrically symmetric with respect to the reference point201.

Although sound generation data is waveform data representing a waveform signal of a musical sound having a predetermined time length in the above embodiment, the sound generation data may also be feature quantity data, which is a numerical value indicating the quantity of feature of sound, or control data of sound such as Musical Instrument Digital Interface (MIDI) data. In this case, the sound generation control unit113performs sound generation of the sound control data or feature quantity data through the sound generation device150after converting the sound control data or feature quantity data into sound waveform data. The sound generation control unit113may also perform sound generation of the feature quantity data through the sound generation device150after controlling an external device connected through the interface160to convert the feature quantity data into waveform data.

In the above embodiment, the display control unit111displays the circular regions220and the music data images410at fixed positions and in fixed directions and displays the sound generation indication image230while sequentially changing the position and direction of the sound generation indication image230. However, the invention is not limited to this mode, and the display control unit111may display the sound generation indication image230at a fixed position and in a fixed direction and display the circular regions220and the music data images410while sequentially changing the positions and directions of the circular regions220and the music data images410as the time progresses. In this case, the display control unit111displays the circular regions220and the music data images410while sequentially changing the directions of the circular regions220and the music data images410along the circumferential direction D1. In all these cases, positional relationships between the sound generation indication images230and the music data images410are sequentially changed along the circumferential direction D1as time elapses.

Although the display control unit111displays the circular sequencer image20and the rectangular sequencer image30in different regions of the screen141in the above embodiment, the display control unit111may also display the circular sequencer image20and the rectangular sequencer image30in the same region. For example, the display control unit111may switch between display of the circular sequencer image20and display of the rectangular sequencer image30through manipulation. The display control unit111may also display the circular sequencer image20and the rectangular sequencer image30in an overlapping manner. In this case, the display control unit111may display one of the sequencer images20and30that has been manipulated in a dark color and display the other that has not been manipulated in a light color in an overlapping manner. Displaying two sequencer images in this manner allows the user to easily identify which sequencer image is manipulated.

In the above embodiment, the display control unit111displays a music data image410on the circular sequencer image20by assigning corresponding music data composed and edited on the rectangular sequencer image30. However, the invention is not limited to this mode, and the display control unit111may also display a music data image410composed and edited on the circular sequencer image20. In this case, upon selection of the manipulation button image group340, the display control unit111, the time output unit112, and the sound generation control unit113may operate to perform reproduction of music, stop reproduction, and perform recording of the circular sequencer image20. The user may edit music data while composing the music data by selecting the record button image343and reproducing the music data by selecting the playback button image341.

Although the display control unit111displays only one sound generation indication image230for the entire circular image210in the above embodiment, the display control unit111may also display individual sound generation indication images for the respective circular regions220. The display control unit111and the time output unit112may display the sound generation indication images at different speeds and in different directions. In this case, the display control unit111displays the sound generation indication images based on the settings of the movement direction and tempo of each circular region220and the time information input to the display control unit111.

FIG. 12illustrates a circular sequencer image20according to Modification 10. The display control unit111displays sound generation indication images231,232, and233on circular regions221,222, and223, respectively. For example, the display control unit111may display the sound generation indication images231,232, and233such that the sound generation indication image232rotates twice and the sound generation indication image233rotates three times while the sound generation indication image231rotates once. In this case, positional relationships between the sound generation indication images231,232, and233are changed as time elapses.

The display control unit111outputs information regarding the position in the radial direction from the center point201(hereinafter referred to as a “radial position”) of a sound generation display region arranged in a music data image to the sound generation control unit113. The sound generation control unit113may perform sound generation while changing details of the sound depending on the received position information. For example, the sound generation control unit113may generate a smaller volume of sound for a sound generation display region as the radial position of the sound generation display region is closer to the center point201and generate a larger volume of sound for the sound generation display region as the radial position is farther from the center point201. The invention is not limited to this example, and the sound generation control unit113may also generate sound for each sound generation display region while changing the pitch, tone color, sound generation duration, or the like of the sound depending on the radial position of the sound generation display region.

When the sound generation indication image230is displayed within a specific zone in the circumferential direction D1within the circular image210, the specific zone being specified through manipulation, the display control unit111outputs a signal indicating this state to the sound generation control unit113. The sound generation control unit113may generate a changed sound upon receiving the signal. For example, upon receiving the signal, the sound generation control unit113may generate a reduced volume of sound (or a muted sound), a sound to which an effect has been imparted, or a sound whose pitch has been changed. This allows the user to easily visually identify a beat or measure at which sound is changed among the beats of music data when sounds of a plurality of pieces of music are simultaneously generated. The same is true when a plurality of sound generation indication images are displayed as described above in Modification 10.

FIG. 13illustrates a circular sequencer image20according to Modification 12. The display control unit111displays the same music data images410as shown inFIG. 3. For example, the user specifies a region440between 9th and 11th beat lines202, counted from a start position411S, in circular regions221,222, and223through manipulation of the manipulation device130. The manipulation device130outputs information regarding the position of the specified zone440to the display control unit111. The display control unit111displays the specified zone440in a color different from that of the circular regions220and music data images410. The display control unit111may also display the specified zone440in a different design, shape, brightness, or the like, provided that the specified zone440can be easily identified by the user. InFIG. 13, music data images410in the specified zone440are shown by a different hatching from other ranges for ease of explanation.

In the example ofFIG. 13, a sound generation display region421A2of the music data image411and a sound generation display region423E1of the music data image413are displayed in the specified zone440. In this case, the sound generation control unit113generates sounds corresponding to the sound generation display regions421A2and423E1, for example, in a small volume. The specified zone is not limited to a zone of beat regions and the display control unit111may also display a zone including only a part of a beat region as a specified zone. The display control unit111may also display a plurality of specified ranges and may also display a specified zone440while changing the position or area of the specified zone440according to manipulation. Namely, the display control unit111includes a zone specification unit that specifies a zone440in the circumferential direction D1of the loop region220. The sound generation control unit113changes the content of the music sound to be generated by the sound generation device150when the position determined according to the time information is within the zone440specified by the zone specification unit.

Although the sound generation control unit113performs sound generation based on music data which specifies the content of sound to be generated and the sound generation timing of the sound in the above embodiment, the sound generation control unit113may also perform sound generation based on music data including data representing an entire continuous waveform. In this case, each music data image410preferably has a design, color shadings, a picture, or the like representing a waveform corresponding to music data to allow the user to easily identify the content of the music data. Also in this case, the display control unit111outputs information required for sound generation control to the sound generation control unit113based on a position at which a sound generation indication image230is displayed and locations at which the music data images410are displayed. The sound generation control unit113performs sound generation through the sound generation device150based on the content of sound that has been instructed to be generated.

Although the sound generation indication image230is a line image in the above embodiment, the sound generation indication image230is not limited to the line image and the sound generation indication image230may be any image, provided that the image indicates the circumferential position as a visual indicator. For example, the sound generation indicator may be a figure such as an ellipse or triangle, a line segment shorter than the radial width of the circular regions220, a dashed line, a pattern, or the like. The display control unit111may also display the sound generation indication image230in a region other than the circular image210. For example, the display control unit111may display a line image extending from the center point201to the outer periphery of the circular image210as the sound generation indication image230. In this case, the user views that the linear sound generation indication image230, which extends in the radial direction from the circular image210, rotates about the center point201.

Although the display control unit111displays the sound generation indication image230according to user manipulation in the above embodiment, the display control unit111may also automatically display the sound generation indication image230at the same time as when a music data image410is displayed. The display control unit111may also automatically display the sound generation indication image230at the same time as when the circular image210is displayed. The display control unit111may also display the sound generation indication image230while moving the sound generation indication image230in a direction or at a speed set through user manipulation. For example, the user touches a touch sensor with their finger to select the sound generation indication image230and then moves the finger in a direction and speed in which they desire to rotate the sound generation indication image230. The manipulation device130outputs information of the direction and speed to the display control unit111. The display control unit111displays the sound generation indication image230while moving the sound generation indication image230according to the information.

The display control unit111may perform a quantization process when arranging a sound generation display region320. For example, when a position in the rectangular image310is specified through user manipulation, the display control unit111arranges the sound generation display region320at a front side, in the longitudinal direction D2, of a beat region including the specified position. In this case, the display control unit111outputs music data that allows a sound corresponding to the sound generation display region320to be generated at the start of a beat indicated by the beat region. The invention is not limited to this and the display control unit111may also output music data that allows the sound to be generated at a specific timing within the beat indicated by the beat region. As a result, in this case, the display control unit111displays the sound generation display region320such that the sound generation display region320is arranged at a position in the beat region corresponding to the specific timing. This specific timing is, for example, the start, middle, or end of the beat, or a timing at which the beat is equally divided. By operating in this manner, the display control unit111allows the user to easily arrange the sound generation display region320at a position indicating the specific timing in the music data image.

The display control unit111may display the sound generation display region320such that the sound generation display region320moves from a position specified through manipulation to a to-be-displayed position until the sound generation display region320reaches the to-be-displayed position after the position is specified through manipulation. By operating in this manner, the display control unit111allows the user to easily identify the displayed position of the sound generation display region320even when the displayed position is different from the specified position.

The sound generation control program in the above embodiment may be provided in a state stored in a machine readable storage medium such as a magnetic recording medium (for example, a magnetic tape or a magnetic disk), an optical recording medium (for example, an optical disc), a magneto-optical recording medium, or a semiconductor memory. The sound generation control apparatus10may also download the sound generation control program over a network.