Abstract:
A system and method for coordinated music composition and display among musicians is presented. The system and method enables a conductor, composer or band leader to interactively edit one or more score parts of a composition using a pen-based interface, mouse, alphanumeric keyboard, or a musical keyboard. Hand-written music editing, which is entered with the pen-based interface, may be flexibly converted to a digital music notation format. Connected to the composer station are one or more musician stations that may be arranged as an orchestra. The musical score parts may be selectively transmitted to one or more musician stations by the composer. Thus, an operator of the conductor station can flexibly write and edit music score parts and transmit the parts to musicians over the network. The system and method can also be used to conduct the orchestra in rehearsals or performances.

Description:
COPYRIGHT NOTICE 
     A portion of the disclosure of this patent document contains material which is subject to copyright protection. The copyright owner has no objection to the facsimile reproduction by anyone of the patent document or the patent disclosure, as it appears in the Patent and Trademark Office patent files or records, but otherwise reserves all copyright rights whatsoever. 
     BACKGROUND OF THE INVENTION 
     The invention disclosed herein relates to computerized systems for composing and displaying musical scores. In particular, the present invention is an improved user interface and system that allows a conductor or composer to interactively modify a musical score and to transmit the modifications to individual musicians or selected groups of musicians in an orchestra. 
     Traditionally, printed paper copies of sheet music have been required for any orchestral or band musician to read in order to perform a musical score. The use of such printed sheet music has resulted in certain disadvantages, such as the need to turn pages, the risk of losing pages, and the time consuming task of making edits or changes to musical scores, which may involve reprinting the score. In addition, the use of printed sheet music limits the ability of the conductor of the orchestra to make changes during a rehearsal, concert or performance, and also unduly restricts the composition process. 
     Several systems have been developed for allowing the composition and notation of music on a computer. Examples of such systems include the FINALE music composition and notation software available from Coda Music Technology, Inc. of Minnesota, the MUSIC WRITE PLUS software from Voyetra Technologies Inc. of New York, the CUBASE VST system available from Steinberg North America of California, and the SIBELIUS music software available from Sibelius Software, Ltd. of the United Kingdom. These systems generally allow for the composition and editing of a musical score through a mouse or keyboard using a note palette or template, or through a MIDI compatible keyboard. 
     U.S. Pat. No. 5,665,927, assigned to Casio Computer Co., Ltd., describes a hand-held device that uses a pen-based input device for music notation. A touch screen of the device displays a musical staff and provides a method for the user to enter musical notations directly onto the displayed staff using the pen-based input device. 
     These software and systems provide some basic tools for the computerized composition and editing of music. 
     The Music Object Oriented Distributed System, or MOODS, is an integrated system of computer-based lecterns or stands which can be used for cooperatively editing and viewing musical scores. The MOODS system, which is described in a document retrievable on the Internet at &lt;http://aguirre.dsi.unifi.it/˜moods&gt;, is designed for use by, among other things, orchestras during rehearsals and public performances. 
     The MOODS system is comprised of a set of lecterns for musicians for displaying musical scores; a lectern for conductors that is used to show, visualize or modify a score; a network for connecting these lecterns; and a database for storing and retrieving the musical scores. The musicians&#39; lecterns are organized according to a hierarchy within the orchestra, with first level musicians being qualified to perform changes on a score while other musicians can be active or passive. This hierarchical organization allows a first instrument such as a first violinist, to directly transmit changes in the score to the other sub-lecterns. 
     Similarly, PCT application No. PCT/US98/08658, published Nov. 12, 1998, describes a musical score display and editing system in which a band leader&#39;s device distributes display information to other devices. The leader may create modifications to a score using various music editing commands which are displayed on all devices displaying parts of the score to which they apply. The system also allows individual musicians to insert personal annotations into their own parts of the score, to be displayed on their own individual devices. 
     Despite this activity, to the inventor&#39;s knowledge there is no system which simplifies and facilitates the conductor&#39;s or composer&#39;s task of managing and coordinating score modification and dissemination. That is, none of these systems allow the conductor to work with a computerized device in the same fashion as if working with hard copy of sheet music and to fully control the extent to which others in an orchestra receive and view modifications to a score on an automatic, real-time basis. Furthermore, there is no fully integrated music display system that is self-contained, ergonomically designed, flexibly reconfigured, or easily transported. The present invention is directed to improvements that provide these advantages. 
     SUMMARY OF THE INVENTION 
     It is an object of the present invention to solve the problems described above associated with existing musical composition systems. 
     It is another object of the present invention to provide an intuitive user interface for a music editing system through which a conductor of an orchestra can change musical scores for all or some players in the orchestra. 
     It is another object of the present invention to integrate handwritten editing changes with a fully digital music composition and performance system. 
     It is another object of the present invention to provide an ergonomic and fully integrated system for multi-part musical composition and conducting. 
     The above and other objects are achieved by a method and system for facilitating multi-part score composition and conducting an orchestral performance, the method being implemented in a network of computerized devices each containing programming for displaying music on a display device, the computerized devices being used by each of a plurality of players in the orchestra under direction of the conductor. The method involves the step of registering an identity of an instrument in use by each player and the corresponding computerized device being used by the player. This allows the conductor to know which player and which instrument are using each device. 
     During a composition session or performance, the conductor enters at the conductor&#39;s computerized station one or more changes to a musical arrangement. These changes may be entered in a handwritten format, via an integrated piano keyboard, mouse, or keyboard. The conductor&#39;s computerized device contains a digitizer and touch screen for processing the input received from the conductor, and also contains means for converting the input changes from handwritten format to a digital music notation format. The means for handwriting conversion may be a music handwriting recognition program such as described above in relation to U.S. Pat. No. 5,665,927, which is hereby incorporated by reference into this application. 
     The conductor&#39;s station allows the conductor to select whether the input change is to be sent to all players in the orchestra or only to a selected group of one or more players who may be using an instrument impacted by the change. The conductor&#39;s station also allows the conductor to select whether the change should be converted to a digital music notation format before transmission to the players. If the conductor selects to send the change only to the player or players using an instrument impacted by the change, the conductor&#39;s station determines which instrument or instruments are impacted by the change and identifies the corresponding computerized device or devices registered for that instrument. The change is then transmitted over the network to the players in accordance with the conductor&#39;s selections. 
     One of the features of the system of the present invention that sets it apart from other computer-based score editors and related applications is the user interface. The conductor and other musicians are able to write directly onto the display screen, just as with any palm computing device, allowing for immediate note changes, edits, and other musical explorations. Thus, the musician will not have to edit using dialog boxes or keyboard commands, and simply takes an electronic pen and writes the desired changes directly onto the screen. For example, to replace a quarter note with a half note, all the musician would have to do is draw a half note on the staff, just as though it were on paper. The half note remains in a handwritten format until the musician explicitly decides to convert the handwritten representation to a digital music notation using a handwriting recognition application. 
     Because all of the computers in the band or orchestra are networked, the band leader or conductor can make a universal edit for all musicians at a rehearsal or performance from a central station and transmit the edited score to all of the other musicians simultaneously. The conductor could also make changes on an individual part as well. For example, if the conductor wanted the trumpet section to repeat four bars, the players would have the option to make the required changes individually or simply accept the changes made by the conductor. 
     The computer, display screen, operating system, and application are integrated into a single self-contained unit. Because everything is in one unit, external wiring and other clutter are eliminated reducing setup time, effort and possible errors. The unit housing the computerized device is large enough and provides sufficient display resolution to represent standard pages of printed music, while remaining compact and light enough to be portable. This allows for the musicians to comfortably travel to and from rehearsals, recordings and performances with the device. New musical scores and parts are distributed by discs, or other digital storage methods, which can be used directly by the computerized device. This eliminates the need for extraneous paper parts or bulky folders full of sheet music. Furthermore, any confusion about which is the most current or correct version of a musical score is eliminated. An entire music catalog can now be placed in a back pocket. 
    
    
     BRIEF DESCRIPTION OF THE DRAWINGS 
     The invention is illustrated in the figures of the accompanying drawings which are meant to be exemplary and not limiting, in which like references are intended to refer to like or corresponding parts, and in which: 
     FIG. 1 shows an exemplary network of computerized musical composition devices in accordance with one embodiment of the present invention; 
     FIG. 2 is a block diagram of an exemplary musical composition device in accordance with one embodiment of the present invention; 
     FIG. 3 a  is a perspective view of an exemplary musical composition device of FIG. 2; 
     FIG. 3 b  is a side view of the keyboard assembly of a first embodiment of the present invention with the keyboard in a closed position; 
     FIG. 3 c  is a side view of the keyboard assembly of a first embodiment of the present invention with the keyboard in an open position; 
     FIG. 3 d  is a top view of the keyboard assembly of a first embodiment of the present invention with the keyboard in a closed position; 
     FIG. 3 e  is a side view of the keyboard assembly of first embodiment of the present invention with the keyboard in an open position; 
     FIG. 3 f  is a side view of the keyboard assembly of a second embodiment of the present invention with the keyboard in a closed position; 
     FIG. 3 g  is a side view of the keyboard assembly of a second embodiment of the present invention with the keyboard in an open position; 
     FIG. 3 h  is a top view of the keyboard assembly of a second embodiment of the present invention with the keyboard in a closed position; 
     FIG. 3 i  is a top view of the keyboard assembly of a second embodiment of the present invention with the keyboard in a closed position; 
       15 FIG. 3 j  is a side view of the keyboard assembly of a third embodiment of the keyboard of the present invention with the keyboard in a closed position; 
     FIG. 3 k  is a side view of the keyboard assembly of the third embodiment of the keyboard of the present invention with the keyboard in an open position; 
     FIG. 3 l  is a top view of the keyboard assembly of the third embodiment of the keyboard of the present invention with the keyboard in a closed position; 
     FIG. 3 m  is a top view of the keyboard assembly of a third embodiment of the keyboard of the present invention with the keyboard in an open position; 
     FIG. 3 n  is a perspective view of the musical composition device of FIG. 3 a  mounted on a music stand; 
     FIG. 4 is a flow chart showing an exemplary process of leading an orchestra using the system shown in FIG. 1; 
     FIG. 5 is an exemplary screen display for the device of FIGS. 2 and 3 showing an exemplary set of active control buttons; and 
     FIGS. 6 a - 6   c  and  7   a - 7   b  represent exemplary sequences of screen displays generated during operation of one embodiment of the present invention. 
    
    
     DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
     Preferred embodiments of the present invention are now described with reference to the drawings in the Figures. 
     Referring to FIG. 1, a schematic diagram of an example orchestral configuration is presented with a single conductor station  102  and six musician stations,  104 ,  106 ,  108 ,  110 ,  112 , and  114 . The conductor station  102  is connected to the musician stations  104 - 114  by a computer network  120 , which may be based on one of a number of networking technologies such as the Internet, a proprietary networking protocol such as the Token Ring system, or a wireless networking technology. These stations may be located in relatively close proximity or may be located at any distance from each other. 
     Referring to FIG. 2, a block diagram of the conductor station is presented. The conductor station includes a general purpose central processing unit (CPU)  204  that is connected to a memory  202  and one or more input/output devices  206 . The CPU  204  is also connected to an integrated keyboard and MIDI interface  208  that provides input from an integrated alphanumeric keyboard and musical keyboard, described hereinbelow, or other musical device interface. Also connected to the CPU  204  is a network interface  212  used to access the other musician stations  104 - 114  on the network  120 , and enables the conductor to transmit and receive information from the other musician stations  104 - 114  using a communications interface  218 . Connected to the CPU  204  is a handwriting recognition system  210  that processes pen strokes to determine music edits, system commands, and other user input. 
     Executing on the CPU  204  are several software modules. The conducting module  216  provides program features for composing and conducting music and distributing the musical score to musicians on the network. Accessible to the conducting module is a general music score editing program  214  such as the FINALE system, described hereinabove. Underlying the system and connected to the conducting module and the music editor is a composition database  220  that may contain musical data such as musical compositions, scores, parts, and other information. 
     With reference to FIG. 3 a , a generalized exemplary music composition device is shown. The machine includes a display screen  312 , which is a touch screen capable of detecting handwritten input made by a stylus or digital pen  310 . The stylus  310  may be connected to the system  102  by a connecting wire or via a wireless system such as an infrared communication system. The display screen  312  shows musical score pages  314  as well as command icons  316  that activate various system functions. These buttons are context sensitive in that they change when the system is performing different functions or operating in different modes. Integrated into the device is a carrying handle  30 , a floppy diskette  304 , a removable media storage device such as a ZIP drive  306  or other magnetic or optical storage device. A mouse  308  or other pointing device is also provided that may be used to operate the system. 
     The device also includes an integrated keyboard assembly that integrates an alphanumeric keyboard  318 , such as typically used with a computer, with a musical keyboard  322 . In one embodiment of the present inventions, the alphanumeric keyboard  318  and musical keyboard  322  may be connected by a sliding track  320  that allows the musical keyboard to slide into the alphanumeric keyboard. Additional embodiments of the keyboard assembly are described hereinbelow. 
     With reference to FIGS. 3 b - 3   e , a first embodiment of a keyboard of the present invention is described. In FIG. 3 b  the keyboard is shown in the closed position with the musical keyboard  322  slid under or into the alphanumeric keyboard  318  along a guide or track  320 . FIG. 3 c  shows the keyboard in the open position with the musical keyboard  322  extended along the track  320  of the alphanumeric keyboard  318 , so that both keyboards are simultaneously accessible. FIG. 3 d  shows a top view of the keyboard with the musical keyboard  322  slid into the alphanumeric keyboard  318 ; and, FIG. 3 e  shows the same top view with the musical keyboard  322  extended from the alphanumeric keyboard  318 . 
     With reference to FIGS. 3 f - 3   g , a second embodiment of a keyboard of the present invention is described. In FIG. 3 f  the keyboard is shown in the closed position with the musical keyboard  322  folded over the alphanumeric keyboard  318  by a hinge or other attachment  324 . FIG. 3 g  shows the keyboard in the open position with the musical keyboard  322  attached to alphanumeric keyboard  318  by the hinge in the open position  320 , so that, once again, both keyboards are simultaneously accessible. FIG. 3 d  shows a top view of the keyboard with the musical keyboard  322  folded onto the alphanumeric keyboard  318 ; and, FIG. 3 e  shows the same top view with the musical keyboard  322  folded open from the alphanumeric keyboard  318 . 
     It is hereby noted that in the above descriptions, in which the musical keyboard  318  is the movable component, the order of coupling of the musical keyboard  318  and the alphanumeric keyboard  322  may be switched such that the alphanumeric keyboard  322  is the movable component. For example, with respect to FIGS. 3 b - 3   e  the alphanumeric keyboard  322  may slide into the musical keyboard  318 , and with respect to FIGS. 3 f - 3   i  the alphanumeric keyboard  322  may fold onto the musical keyboard  318 . 
     With reference to FIGS. 3 j - 3   m , a third embodiment of the musical portion of the keyboard assembly of the present invention is described. This configuration, called a ‘butterfly’, permits a musical keyboard  322  that is wider than the alphanumeric keyboard  318 . With reference to FIG. 3 j  the butterfly keyboard is shown in the closed position where the keyboard  322  is segmented into a center portion  328  and two side portions  330 , also called wings, that are joined by two hinges  326 . FIG. 3 k  shows the butterfly keyboard in the open position with the two wings  330  opened to be level with the center portion  328  to form a single wide keyboard  322 . FIG. 31 shows a top view of the butterfly keyboard  322  with hinges  326  in the closed position and the wings  330  folded onto the alphanumeric keyboard  318 ; and, FIG. 3 e  shows the same top view with the butterfly keyboard  322  folded open from the center portion of the keyboard  318 . 
     With reference to FIG. 3 n , the music display system  102  is described mounted by a joint, adapter, or threaded screw  334  on top of a music stand or lectern  332 . In one embodiment of the present invention the joint  334  enables the music display system  102  to tilt and swivel so that a comfortable viewing angle may be produced. 
     With reference to FIG. 4, a flow diagram describing the general operation of the system is presented. In step  402  the conductor selects a composition, or alternately creates a new composition. The composition will include one or more score parts, each score part corresponding to a musician and associated musician station in the orchestra. The conductor associates or registers the part with the corresponding musician or musician station in step  404 . Alternatively, the musicians preregister their identity and/or instrument and station ID, which data is sent to and stored in the conductor&#39;s station for use and access by the conductor in selecting musicians stations to receive changes, e.g., by selecting an option to send changes only to those instruments affected by the changes. The system then can store the association so that the conductor is not required to reenter the association information. The conductor then selects a part, step  406 , that corresponds to an individual musician or a group of musicians, in order to view, modify or transmit that score part. Once the score part is selected, the conductor can process the part using editing marks that are recognized by the handwriting system, step  408 . The conductor then chooses whether to convert the handwritten changes to digital music format, step  410 . If the conductor decides to finalize the handwritten edit changes, the system recognizes and converts the handwritten edit markings into digital music notation in step  412 . The conductor then chooses which musician stations will receive the changes, e.g., all stations or just stations associated with affected instruments, step  414 . The changes are then transmitted to the one or more selected musician stations on the network at step  416 . The resulting changes to the musical score can also be saved in step  416 . 
     With reference to FIG. 5, a detail view of the editing screen of the conductor system is shown. This screen display shows two pages of a musical score  314 , drawn schematically. Below the musical score display  314  are a set of icons or buttons  316  that provide system functionality. In the example, screen six buttons  336 - 346  are active, although a greater or smaller number may be present and the location of the buttons  316  may vary. The text or symbols on the buttons  316  change when the system is executing different processes or modules. The six buttons in the present view, described from left to right are: a button that transmits the score to all musicians  336 ; a button that sends the score to a selected group of musicians  338 , a button that sends the score to an individual musician  340 . The next button  342 , when selected, converts handwritten score changes into a digital music notation format. The next button  344  displays the previous score page, and the last button  346  displays the next score page. 
     With respect to FIGS. 6 a - 6   c , an example of a simple music edit is described. FIG. 6 a  shows the abstracted score  314  on the display  312  of the present invention with a music note  350  displayed. In FIG. 6 b , a handwritten music annotation  352 , in this case an annotation to delete note  350  of the score  314  on the display  312 , is shown. In FIG. 6 c , the handwritten annotation  352  has been converted to digital music notation and note  350  is deleted from the score  314  on the display  312 . 
     With respect to FIGS. 7 a - 7   b , an example of adding a musical note is shown. In FIG. 7 a , a hand drawn whole note  360  is drawn by the conductor on the score  314  on the display  312 . In FIG. 7 b , the whole note  350  is shown on the score  314  of the display  312  after it has been converted into a digital musical notation format. 
     While the invention has been described and illustrated in connection with preferred embodiments, many variations and modifications as will be evident to those skilled in this art may be made without departing from the spirit and scope of the invention, and the invention is thus not to be limited to the precise details of methodology or construction set forth above as such variations and modification are intended to be included within the scope of the invention.