Abstract:
The present invention is method and apparatus for music performance and composition. More specifically, the present invention is an interactive music apparatus comprising actuating a signal that is transmitted to a processing computer that transmits output signals to a speaker that emits sound and an output component that performs an action. Further, the present invention is also a method of music performance and composition. Additionally, the present invention is an interactive wireless music apparatus comprising actuating an event originating on a remote wireless device. The transmitted event received by a processing host computer implements the proper handling of the event.

Description:
CROSS-REFERENCE TO RELATED APPLICATION(S) 
       [0001]    This application is a continuation in part application of U.S. patent application Ser. No. 11/554,388, filed on Oct. 30, 2006, issued as U.S. Pat. No. 7,723,603, which is a continuation in part application of U.S. patent application Ser. No. 10/606,817, filed on Jun. 26, 2003, now U.S. Pat. No. 7,129,405, which claims priority to U.S. Provisional Application No. 60/391,838, filed on Jun. 26, 2002, and which is a continuation in part of U.S. patent application Ser. No. 11/174,900, filed on Jul. 5, 2005, which claims priority to U.S. Provisional Application No. 60/585,617, filed on Jul. 6, 2004, and further claims priority to U.S. Provisional Application No. 60/742,487, filed on Dec. 5, 2005 and U.S. Provisional Application No. 60/853,688, filed on Oct. 24, 2006, the contents of all of which are incorporated by reference. 
     
    
     TECHNICAL FIELD 
       [0002]    The present invention relates generally to the field of musical apparatus. More specifically, the present invention relates to a musical performance and composition apparatus incorporating a user interface that is adaptable for use by individuals with physical disabilities. Similarly, the present invention relates to a wireless electronic musical instrument, enabling musicians of all abilities to learn, perform, and create sound. 
       BACKGROUND OF THE INVENTION 
       [0003]    For many years as is common today, performing music is restricted to traditional instruments such as acoustic and electronic keyboards, stringed, woodwind, percussive and brass. In all of the instruments in each of these classifications, a high level of mental aptitude and motor skill is required to adequately operate the instrument. Coordination is necessary to control breathing, fingering combinations, and expression. Moreover, the cognitive ability to read the music, watch the conductor for cues, and listen to the other musicians to make adjustments necessary for ensemble play require high cognitive function. Most school band programs are limited to the use of these instruments and limit band participation to only those students with the physical and mental capacity to operate traditional instruments. 
         [0004]    For example, a student with normal mental and physical aptitude shows an interest in a particular traditional instrument, and the school and/or parents make an instrument available with options for instruction. The child practices and attends regular band rehearsals. Over time, the student becomes proficient at the instrument and playing with other musicians. This is a very common scenario for the average music student. 
         [0005]    However, this program assumes all children have adequate cognitive and motor function to proficiently operate a traditional instrument. It assumes that all children are capable of reading music, performing complex fingering, controlling dynamics, and making necessary adjustments for ensemble performance. The currently available musical instruments do not consider individuals with below normal physical and mental abilities. Hence, it prohibits the participation of these individuals. 
         [0006]    Teaching music performance and composition to individuals with physical and mental disabilities requires special adaptive equipment. Currently, these individuals have limited opportunities to learn to perform and compose their own music because of the unavailability of musical equipment that is adaptable for their use. Teaching music composition and performance to individuals with physical and mental disabilities requires instruments and teaching tools that are designed to compensate for disabled students&#39; limited physical and cognitive abilities. 
         [0007]    For example, students with physical and mental disabilities such as cerebral palsy often have extremely limited manual dexterity and thus are unable to play the typical keyboard instrument with a relatively large number of narrow keys. Similarly, a user with physical disabilities may have great difficulty grasping and manipulating drumsticks and thus would be unable to play the typical percussion device. Also, disabled users are unable to accurately control the movements of their hands, which, combined with an extremely limited range of motion, can also substantially limit their ability to play keyboard, percussion, or other instruments. Such users may, however, exhibit greater motor control using their head or legs. 
         [0008]    Furthermore, the currently available musical instruments are generally inflexible in regard to the configurations of their user interfaces. For example, keyboards typically have a fixed number that cannot be modified to adapt to the varying physical capabilities of different users. In addition, individuals with cognitive delays are easily distracted and can lose focus when presented with an overwhelming number of keys. Similarly, teaching individuals with mental and physical disabilities basic music theory requires a music tutorial device that has sufficient flexibility to adjust for a range of different cognitive abilities. 
         [0009]    Consequently, there is a need in the art for a music performance and composition apparatus with a user interface adaptable for use by individuals with physical and mental disabilities, such that these individuals can perform and compose music with minimal involvement by others. In addition, there is a need for an apparatus allowing disabled users to use the greater motor control available in their head or legs. Furthermore, there is a need in the art for a music composition and performance tutorial system incorporating this new apparatus that allows musicians with disabilities to learn to compose and perform their own music. 
         [0010]    Similarly, there is a need in the art for a universal adaptive musical instrument that enables people of all abilities to perform music alone, with other individuals of similar abilities, or with others in a traditional band setting. This solution could provide the necessary flexibility to assist individuals with their particular disability. 
       BRIEF SUMMARY OF THE INVENTION 
       [0011]    The present disclosure, in one embodiment, relates to an interactive music apparatus with a remote wireless device containing an accelerometer or a proximiter, an LCD for displaying performance information, a processor, and software. The remote wireless device is configured to transmit data to a processing host computer indicating wireless device location or proximity information obtained from the accelerometer or proximiter. The interactive music apparatus also contains a transmit/receive device enabling wireless transmission between the remote wireless device and the processing host computer. The device further includes a speaker and second output component, each configured to receive an output signal from the processing host computer and emit an output based on the output signal. The processing host computer is configured to receive the data transmitted from the remote wireless device and converts the data into a first and second output signal, transmit the first output signal to the speaker and the second output signal to the second output component, and further generates and sends the performance information to the LCD of the remote wireless device based upon the data received from the remote wireless device. 
         [0012]    The present disclosure, in one embodiment, relates to a method of music performance and composition including establishing a connection with one or more remote wireless devices, each wireless device controlled by a musical performer, assessing at least one of the cognitive or physical abilities of each user of the one or more remote wireless devices, assigning at least a portion of a music performance to each of the one or more remote wireless devices based on the respective performer&#39;s cognitive or physical abilities, transmitting a cue or series of cues to the one or more remote wireless devices, wherein the cue or series of cues transmitted to each remote wireless device is related to the respective portion of a music performance assigned to the remote wireless device, the cue or series of cues based on the respective performer&#39;s cognitive or physical abilities, receiving transmission of a remote wireless device event, wherein the remote wireless device event represents a motion-based response to the cue or series of cues, converting the device event at a processing computer into an output signal, and emitting sound at a speaker based on the output signal. 
         [0013]    While multiple embodiments are disclosed, still other embodiments of the present invention will become apparent to those skilled in the art from the following detailed description, which shows and describes illustrative embodiments of the invention. As will be realized, the invention is capable of modifications in various obvious aspects, all without departing from the spirit and scope of the present invention. Accordingly, the drawings and detailed description are to be regarded as illustrative in nature and not restrictive. 
     
    
     
       BRIEF DESCRIPTION OF THE DRAWINGS 
         [0014]      FIG. 1  is a schematic diagram of one embodiment of the present invention. 
           [0015]      FIG. 1A  is a schematic diagram of an alternative embodiment of the present invention. 
           [0016]      FIG. 1B  is a schematic diagram of another embodiment of the present invention. 
           [0017]      FIG. 1C  is a schematic diagram of yet another embodiment of the present invention. 
           [0018]      FIG. 1D  is a schematic diagram of yet another embodiment of the present invention. 
           [0019]      FIG. 1E  is a schematic diagram of yet another embodiment of the present invention. 
           [0020]      FIG. 2  is a flow chart showing the operation of the apparatus, according to one embodiment of the present invention. 
           [0021]      FIG. 2A  is a flow chart depicting the process of launching a web browser using the apparatus, according to one embodiment of the present invention. 
           [0022]      FIG. 2B  is a flow chart depicting the process of displaying a graphical keyboard using the apparatus, according to one embodiment of the present invention. 
           [0023]      FIG. 2C  is a flow chart depicting the process of displaying a music staff using the apparatus, according to one embodiment of the present invention. 
           [0024]      FIG. 2D  is a flow chart depicting the process of providing a display of light using the apparatus, according to one embodiment of the present invention. 
           [0025]      FIG. 3  is a schematic diagram of a voltage controller, according to one embodiment of the present invention. 
           [0026]      FIG. 4  is a perspective view of a user console and an optional support means, according to one embodiment of the present invention. 
           [0027]      FIG. 5  is a cross-section view of a user interface board according to one embodiment of the present invention. 
           [0028]      FIG. 6  is a sequence diagram showing standard operation of the apparatus, according to an embodiment of the present invention. 
           [0029]      FIG. 6A  is a sequence diagram showing standard operation of the apparatus, according to another embodiment of the present invention. 
           [0030]      FIG. 7  is a sequence diagram showing operation during ensemble mode of the apparatus, according to one embodiment of the present invention. 
           [0031]      FIG. 8  is a sequence diagram depicting the operational flow during assessment mode using the apparatus, according to one embodiment of the present invention. 
       
    
    
     DETAILED DESCRIPTION 
       [0032]      FIG. 1  shows a schematic diagram a music apparatus  10 , according to one embodiment of the present invention. As shown in  FIG. 1 , the music apparatus  10  may include a user console  20  having at least one actuator  30  with an actuator button  31 , a voltage converter  100 , a processing computer  150  having a processor  154 , software  152 , and an internal sound card  148 , a display monitor  180 , and a speaker  159 . In a further embodiment, the voltage converter  100  is an integral component of the user console  20 . The actuator  30  is connected to the voltage converter  100  with an actuator cable  35 . The voltage converter is connected to the processing computer  150  with a serial cable  145 . The processing computer  150  is connected to the display monitor  180  by a monitor cable  177 . The processing computer  150  is connected to the speaker  159  by a speaker line out cable  161 . 
         [0033]    In an alternative aspect of the present invention, the apparatus also has an external MIDI sound card  155  and a MIDI sound module  170 . According to this embodiment, the processing computer  150  is connected to the external MIDI sound card  155  by a USB cable  156 . The MIDI sound card  155  is connected to the MIDI sound module  170  via a MIDI cable  42 . The MIDI sound module  170  is connected to the internal sound card  148  via an audio cable  158 . 
         [0034]    In a further alternative embodiment, the apparatus has a lighting controller  160  controlling a set of lights  162 . The lighting controller  160  is connected to the processing computer  150 . The lighting controller  160  is also connected to each light of the set of lights  162 . The lighting controller  160  can be any known apparatus for controlling a light or lighting systems. The set of lights  162  can be one light. Alternatively, the set of lights  162  can be comprised of any number of lights. 
         [0035]    In one embodiment, the actuator  30  may be any known mechanical contact switch that is easy for a user with disabilities to operate. Alternatively, different types of actuators, for example, light sensors, may also be used. In one aspect of the present invention, the number of actuators  30  can vary according to factors such as the user&#39;s skill level and physical capabilities. While  FIG. 1  shows an embodiment having a single actuator  30  on the user console  20 , further embodiments may have a plurality of actuators  30 . 
         [0036]    According to one embodiment, the processing computer  150  may be any standard computer, including a personal computer running a standard Windows® based operating system, with standard attachments and components (e.g., a CPU, hard drive, disk and CD-ROM drives, a keyboard and a mouse). The processor  154  may be any standard processor such as a Pentium® processor or equivalent. 
         [0037]      FIG. 1A  depicts a schematic diagram of a music apparatus  11 , according to an alternative embodiment of the present invention. The apparatus  11  has a user console  20  with eight actuators  30  and a wireless transmitter  19 , a converter  100  with a wireless receiver  17 , and a processing computer  150 . The actuators  30  are connected to the wireless transmitter  19  with actuator cables  31 . In place of the electrical connection between the actuator  30  and the voltage converter  100  according to the embodiment depicted in  FIG. 1 , the wireless transmitter  19  shown in  FIG. 1A  can transmit wireless signals, which the wireless receiver  17  can receive. 
         [0038]      FIG. 2  is a flow diagram showing the operation of the apparatus  10 , according to one embodiment of the present invention. The user initiates operation by pressing the actuator button  31  (block  60 ). Upon engagement by the user, the actuator  30  transmits an actuator output signal to a voltage converter  100  through the actuator cable  35  (block  62 ). Alternatively, the actuator  30  transmits the output signal to the wireless transmitter  19 , which transmits the wireless signal to the wireless receiver  17  at the voltage converter. The voltage converter  100  receives the actuator output signal  36  and converts the actuator output signal  36  to a voltage converter output signal  146  (block  64 ). The voltage converter output signal  146  is in the form of a serial data stream which is transmitted to the processing computer  150  through a serial cable  145  (block  66 ). At the processing computer  150 , the serial data stream is processed by the software  152  and transmitted as an output signal to the speaker  159  to create sound (block  68 ). In accordance with one aspect of the invention, the serial data contains further information that is further processed and additional appropriate action is performed (block  70 ). That is, the additional action message information contained in the data stream is read by the software  152 , which then initiates additional action. According to one embodiment, the additional information is merely repeated actuator address and actuator state information based on repeated actuations of the actuator  30  by the user. The software  152  defines and maps one or more actions to be executed by the hardware and/or software upon receiving the information. For purposes of this application, the information received by the hardware and/or software will be referred to as an output signal. According to one embodiment, the information is a command. 
         [0039]    According to one embodiment, the step of processing the serial data stream, converting it into an output signal, and transmitting the signal to a speaker  159  to create sound (block  68 ) involves the use of a known communication standard called a musical instrument digital interface (“MIDI”). According to one embodiment, the software  152  contains a library of preset MIDI commands and maps serial data received from the voltage converter output signal  146  to one or more of the preset commands. As is understood in the art, each MIDI command is sent to the MIDI driver (not shown) of the processing computer  150 . The MIDI driver directs the sound to the internal sound card  148  for output to the speaker  159 . 
         [0040]    Alternatively, the MIDI command is transmitted by the MIDI sound card from the processing computer  150  to the MIDI sound module  170 . The MIDI sound module may be any commercially-available MIDI sound module containing a library of audio tones. The MIDI sound module  170  generates a MIDI sound output signal which is transmitted to the processing computer  150 . A signal is then transmitted to the speaker  159  to create the predetermined sound. 
         [0041]      FIG. 1B  shows a schematic diagram a music apparatus according to one embodiment of the present invention. As shown in  FIG. 1B , the music apparatus may include optional external speakers  201 , an external wireless transmitter  204 , and external MIDI sound generator  212 , a processing computer  213  having a processor  203 , software  239 , an internal/external sound card  202 , and a display monitor  205 . The processing computer  213  is connected to the display monitor  205  by a monitor cable  206 . The processing computer  213  is connected to the speaker  201  by a speaker line out cable  207 . The wireless transmitter  204  is connected to the processing computer  213  via a cable  208 . Likewise, the optional external MIDI device  212  is connected to the processing computer  213  via a MIDI cable  238 . A remote wireless device  211  contains a processor, touch-sensitive LCD display  244 , and software  240 . In an alternative embodiment of this remote wireless device  211 , a serial connector  242 , serial cable  209 , and actuator switch  210  are optional. 
         [0042]      FIG. 1C  presents an alternative aspect of the present invention. The processing computer  213  contains a touch-sensitive LCD  205 , thus eliminating the monitor display cable  6 . 
         [0043]      FIG. 1D  presents yet another embodiment of the present disclosure. In addition to, or in place of touch sensitive LCD  244 , the remote wireless device  311  can contain an accelerometer  344  or any other position sensitive device that can determine position and/or movement such as two dimensional or three dimensional position or movement, and generate data indicating the position and/or movement of the remote wireless device  311 . In order to determine position, in one embodiment, the wireless device  311  can be initialized by establishing a point of reference that can be the position of the remote wireless device at some initial time. Subsequent movements are tracked and thus a position can be maintained. 
         [0044]    The remote wireless device  311  can contain additional software  340  that can be capable of reading the accelerometer data and sending that data to the processing computer  213 . Either software  239  or  340  can translate the accelerometer data into a coordinate in a two-dimensional or three-dimensional coordinate space. The software  239  or  340  can define multiple regions in this space. These regions can relate to, for example the three dimensional space surrounding the performer and can include all or some of the space behind, in front of, to the left or right, and above and below a performer. The sizing, positioning, and number of regions can be related to the physical ability of the performer, as determined by the performer, the processing host computer  213 , or by another individual. The processing host computer  213  can then trigger music, lighting, or display events based on the position and/or motion of the remote wireless device  311  in the defined two, or three-dimensional mapping. Different events can be generated based on the region the remote wireless device is in, or was moved to, or based on the motion carried out in that region. For example, when the remote wireless device  311  is moved within one region, processing host computer  213  can trigger a particular sound to be played through external speaker  201 . Movement into, or in a different region may produce a different sound, or even a different type of event. 
         [0045]    In another embodiment, the type of motion may trigger a specific type of event. For example, a drumming motion may cause processing host computer  213  to play a drum sound through external speaker  201 , while a strumming motion may produce a guitar sound. Some embodiments can play certain sounds in certain regions based on the type of motion and generate completely different events in response to the same type of motions in a different region. 
         [0046]    Another embodiment may measure the speed of the motion to trigger events. This motion may for example, change the tempo of the events generated by the processing host computer  213 , change the events triggered, and/or change the volume or pitch of the sound produced, and/or otherwise change the character of the event. 
         [0047]    If a touch sensitive LCD  244  is included with the accelerometer, the LCD can be used as previously described, giving the performer the option of which method of playing to use. The LCD can also be used to display cues to the performer to produce motion or move to a certain region. The LCD can also be used with the motion. For example, a performer could press an area of the screen simultaneously with the motion. The function of the LCD screen can vary depending on the abilities of the user. For example, more sophisticated performers capable of more coordinated body motions can use the LCD screen and motion at the same time, whereas less coordinated performers can use one or the other depending on their desires and physical abilities. Alternatively, performers can be either cued to press the LCD screen or to move the remote wireless device. For example, one cue might direct the performer to move the wireless device and the next cue might be to touch a specific point on the LCD display. Such alternation can be in a predetermined pattern or frequency based on the abilities of the user, or may be random, or may be predetermined in advance. If an LCD display is not provided, the user can still be presented with cues through monitor  205 , LCD monitor  205  or through other audio and/or visual cues including lighting cues, sound cues, or cues may not be provided at all. 
         [0048]    The use of an accelerometer is not limited to the embodiment as described in  FIG. 1D  and may supplement any of the embodiments listed herein. 
         [0049]      FIG. 1E  presents a further alternative embodiment of the present disclosure. In addition to, or in place of touch sensitive LCD  244  and/or accelerometer  344 , remote wireless device  411  can contain a proximeter  444 , and additional software  440 . The proximeter is capable of measuring distances between the wireless device and objects near the device and translate that into position and movement coordinates such as two dimensional or three dimensional position or movement coordinates. In order to determine position, in one embodiment, the wireless device  411  can be initialized by establishing a point of reference that can be the position of the wireless device at some initial time. Subsequent movements of the wireless device or changes in proximity of objects around the wireless device are tracked and thus a position can be maintained. 
         [0050]    These position and movement coordinates are then sent to processing host computer  213 . The proximiter can be in the remote wireless device  411 , or attached to the remote wireless device  411  as an accessory. The proximeter  444  can detect distances between the proximeter and the remote wireless device  411  and/or nearby objects. The proximeter can be inductive, capacitive, capacitive displacement, eddy-current, magnetic, photocell (reflective), laser, sonar, radar, doppler based, passive thermal infrared, passive optical, or any other suitable device. The proximeter  444  can be stand alone, that is, exist solely in the wireless device  411  measuring distances, or can work in co-operation with an element on the measured object or surface to produce a measurement. 
         [0051]    The software  440  can read the data from the proximiter and can forward that data to the software  239 , or can process the data itself to determine a distance from an object. In one embodiment, the proximeter data can be translated by either software  239  or  440  into a coordinate in a two-dimensional or a three dimensional coordinate space. The software  239  or  440  can define multiple regions in this space. These regions can relate to, for example, the three dimensional space surrounding the performer or the measured surface and can include all or some of the space behind, in front of, to the left or right, and above and below a performer or measured surface. The sizing, positioning, and number of regions can be related to the physical ability of the performer, as determined by the performer, the processing host computer  213 , or by another individual. This data can then be used by the processing host computer  213  to trigger music, lighting, or display events based on a defined distance-to-event mapping, position, and/or motion of the remote wireless device  411  in the defined two or three-dimensional mapping. Different events can be generated based on the region the remote wireless device is in, or was moved to, or based on the motion carried out in that region. For example, when the remote wireless device  411  is moved within one region, processing host computer  213  triggers an event in the form of a particular sound to play through external speaker  201 . Motion or presence of wireless device  411  into or in a different region may produce a different sound, or even a different type of event. 
         [0052]    In another embodiment, the type of motion may trigger a specific type of event. For example, a drumming motion may trigger processing host computer  213  to cause a drum sound to be played through external speaker  201 , while a strumming motion may produce a guitar sound. Some embodiments can play certain sounds in certain regions based on the type of motion and generate completely different events in response to the same type of motions in a different region. 
         [0053]    Another embodiment may measure the speed of the motion to trigger events. This motion, for example, may change the tempo of the events generated by the processing host computer  213 , change the events triggered, and/or change the volume and/or pitch of the sound produced. 
         [0054]    If a touch sensitive LCD  244  is included with the proximeter, the LCD can be used as described previously, giving the performer the option of which method of playing to use. The LCD can also be used to display cues to the performer to produce motion to vary distances between objects, thereby triggering an event. The LCD can also be used with the motion, for example, a performer could press an area of the screen simultaneously with the motion. The function of the LCD screen can vary depending on the abilities of the user. For example, more sophisticated performers capable of more coordinated body motions can use the LCD screen and motion at the same time, whereas less coordinated performers can use one or the other depending on their desires and physical abilities. Alternatively, performers can be either cued to press the LCD screen or to move the remote wireless device. For example, one cue might direct the performer to move the wireless device and the next cue might be to touch a specific point on the LCD display. Such alternation can be in a predetermined pattern or frequency based on the abilities of the user, may be random, or may be predetermined in advance. If an LCD display is not provided, the user can still be presented with cues through monitor  205 , LCD monitor  205 , or through other audio and/or visual cues including lighting cues, sound cues, or cues may not be provided at all. 
         [0055]    The use of an proximeter is not limited to the embodiment as described in  FIG. 1E  and may supplement any of the embodiments listed herein. 
         [0056]    In one embodiment, as stated above, the actuator  210  may be any known mechanical contact switch that is easy for a user to operate. Alternatively, different types of actuators, for example, light sensors, may also be used. In one aspect of the present invention, the number of actuators  10  can vary according to factors such as the user&#39;s skill, physical capabilities and actuator implementation. 
         [0057]    According to one embodiment, as stated above, the processing computer  213  may be any standard computer, including a personal computer running a standard Windows® based operating system, with standard attachments and components (e.g., a CPU, hard drive, disk and CD-ROM drives, a keyboard and a mouse). The processor  203  may be any standard processor such as a Pentium® processor or equivalent. 
         [0058]      FIG. 6  depicts a sequence diagram of standard operational flow for one embodiment of the present disclosure. The remote wireless device  211  is switched on. The remote wireless device software  240  is started and establishes a wireless connection  243  with the host processing PC  213  via the wireless transmitter (router)  204 . Upon successful connection, the remote wireless device transmits a user log on or handshake message  217  to the host PC  213 . The host PC  213  returns an acknowledgement message  219 . Upon successful log on, the remote wireless device  211  notifies the host PC  213  of it&#39;s current device profile  220 . The device profile  220  contains data necessary for the host PC  213  to properly service future commands  223  received from the remote device  211 . Specifically, during host PC synchronization, a map of host PC  213  actions that correspond to specific remote device  211  x-y coordinates locations (or regions of x-y coordinates) on the remote device  211  LCD display  244  are created. With the mapping complete, both the host PC  213  and remote wireless device  211  are now synchronized. After successful synchronization, the host PC  213  and the remote wireless device  211  refresh their displays  205 ,  244  respectively. The user may press the LCD display  244  to send a command  223  to the host PC  213 . A remote device command  223  transmitted to the host PC  213  contains an identifier to the location the user pressed on the remote device LCD  244 . A remote device command  223  may optionally include meta data such as position change or pressure intensity. When the command  23  is received by the host PC  213 , the host PC  213  invokes the command processor  224  which executes the action mapped to the location identifier. This action, handled in the command processor  224  may include directing a MIDI command or series of commands to the host PC  213  MIDI output, sending a MIDI command or series of commands to an external MIDI sound generator  212 , playing a media file, or instructing the host PC  213  to change a configuration setting. It may also include a script that combines several disparate functions. The command processor  224  continues to service command messages until the remote device  211  logs off  227 . Upon transmission and receipt by the host PC  213  of a log off message  227  of a remote device  211 , the host PC  213  discontinues processing commands and destroys the action map. 
         [0059]      FIG. 6A  is a sequence diagram showing an alternative flow when an external switch, or actuator  210  is the source of the activation. The external switch actuator is connected to the remote wireless device  211  via serial communication cable  209 . The user initiates operation by pressing the actuator button  210 . Upon engagement by the user  248 , the actuator  210  changes a pin condition on the serial connection  209 . This event is recognized by the remote wireless device software  240 . The remote device software  240  references a map that indicates the location identifier  249  to be transmitted to the host PC  213 . The remote device  211  transmits the location identifier to the host PC  213 . 
         [0060]    According to one embodiment of this invention, the host PC  213  supports a multiple number of remote wireless devices  211  restricted only by the underlying limitations of the hardware and operating system (wireless transmitter  204 , processor  203 ). 
         [0061]    According to one embodiment, as stated above, the command processing of MIDI data involves the use of a known communication music computing standard called a Musical Instrument Digital Interface (“MIDI”). According to one embodiment, the operating system  250  provides a library of preset MIDI sounds. As is understood in the art, each MIDI command is sent to the MIDI driver (not shown part of the operating system  250 ) of the host PC  213 . The MIDI driver directs the sound to the sound card  202  for output to the speaker  201 . 
         [0062]    Alternatively, the MIDI command is redirected by the MIDI driver to an external MIDI sound module  212 . The MIDI sound module may be any commercially-available MIDI sound module containing a library of audio tones. The MIDI sound module  212  generates a MIDI sound output signal which may be directed to the speakers  201 . 
         [0063]      FIG. 7  is a sequence operational diagram depicting system operation in ensemble mode. In ensemble mode, the host PC  213  manages a real-time performance of one or more users. The music performed is defined in an external data file using the standard MIDI file format. The remote device  211  start up and log on sequence is identical to the sequence illustrated in  FIG. 6 . The change to ensemble mode takes place on the host PC  213 . A system administrator selects a MIDI file to perform  230 . The host PC  213  opens the MIDI file and reads in the data  231 . The MIDI file contains all of the information necessary to playback a piece of music. This operation  231  determines the number of needed performers and assigns music to each performer. Performers may be live (a logged on performer) or a substitute performer (computer). The music assigned to live performers considers the performers ability and assistance needs (assessment profile). The system administrator selects the tempo for the performance and starts the ensemble processing  235 . The host PC  213  and the remote wireless device  211  communicate during ensemble processing and offer functionality to enhance the performance of individuals that require assistance with the assigned part. These enhancements include visual cueing  234 , command filtering, command location correction, command assistance, and command quantization  251 . Visual cueing creates a visual cue on the remote device LCD  244  alerting the performer as to when and where to press the remote device LCD  244 . In one embodiment, the visual cue may be a reversal of the foreground and background colors of a particular region of the remote device LCD  244 . The visual cueing assists performers that have difficulty reading or hearing music. Using the MIDI file as a reference for the real-time performance, the command sequence expectation is known by the host PC  213  managing the performance. This enables the ensemble manager to provide features to enhance the performance. The command filter ignores out of sequence commands or commands that are not relevant at the time received within the performance. Command location correction adjusts the location identifier when the performer errantly presses the remote device LCD  244  at the incorrect x-y coordinate or region. Command assistance automatically creates commands for performers that do not respond within a timeout window. Command quantization corrects the timing of the received command in context to the performance. 
         [0064]      FIG. 8  is a sequence operational diagram depicting system operation in assessment mode. In assessment mode, the host PC  213  manages series of assessment scripts to determine the performers cognitive and physical abilities. This evaluation enhances ensemble assignment and processing to optimize real-time ensemble performance. The remote device  211  start up and log on sequence is identical to the sequence illustrated in  FIG. 6 . The change to assessment mode takes place on the host PC  213 . A system administrator selects an assessment script  236  and directs the assessment test to a particular remote device  211 . The user responds  252  to his/her ability. The script may contain routines to record response time, location accuracy (motor skill) and memory recall (cognitive) using sequence patterns. In the event that the remote device incorporates an accelerometer or proximeter, the assessment may also contain routines to assess three dimensional accuracy, how much force the performer is capable of generating, control, tempo, etc. 
         [0065]    In one embodiment of the invention, several default device templates are defined. These templates define quadrilateral regions within the remote device LCD display  244 . Each defined region has an identifier used in remote device  211  commands to the host PC  213 . The command processor on the host PC  213  determines the location on the remote device LCD  244  using this template region identifier. 
         [0066]    In one embodiment of the invention, a region may be designated as a free form location. A remote device region with this free form attribute includes additional information with the commands transmitted to the host PC  213 . This meta data includes relative movement on the remote device LCD  244 . The change in x and y coordinate values is included with the location identifier. Coordinate delta changes enable the command processor to extend the output of the command to include changes in dynamics, traverse a scale or series of notes, modify sustained notes or process and series of MIDI commands. 
         [0067]    In one embodiment of the invention, ensemble configurations may be defined on the host PC  213 . Ensemble configurations are pre-defined remote device configuration sets which detail regions definitions for known remote devices  211 . These ensemble configuration sets may be downloaded to the remote devices  211  via the host PC  213  simultaneously. 
         [0068]    In one embodiment of the invention, the mechanism of data transmission between the remote wireless device  211  and the host PC  213  may be TCP/IP, Bluetooth, 802.15, or other wireless technology. 
         [0069]      FIG. 2A  is a flow chart depicting the activation of the additional action of launching a web browser, according to one embodiment. The software  152 ,  239  processes the further information in the serial data stream relating to launching a web browser (block  72 ). A signal is then transmitted to the browser software  152 ,  239  indicating that the browser should be launched (block  74 ). The browser is launched and displayed on the monitor  180 ,  205  (block  76 ). According to one embodiment, the browser then displays images as required by the data stream (block  78 ). For example, photographs or pictures relating a story may be displayed. Alternatively, the browser displays sheet music coinciding with the music being played by the speaker  159 ,  201  (block  80 ). In a further alternative, the browser displays text (block  82 ). The browser may display any known graphics, text, or other browser-related images that may relate to the notes being played by the speaker  159 ,  201 . In an alternative aspect of the present invention, the browser is an embedded control within the software  152 ,  239  of the processing computer  150 ,  213 . 
         [0070]      FIG. 2B  is a flow chart depicting the activation of the additional action of displaying a graphical keyboard, according to one embodiment. The software  152 ,  239  processes the further information in the serial data stream relating to displaying a graphical keyboard (block  84 ). A signal is then transmitted to the appropriate software  152 ,  239  indicating that the keyboard should be displayed (block  86 ). The keyboard is displayed on the monitor  180 ,  205  (block  88 ). According to one embodiment, interaction is then provided between the sounds emitted by the speaker  159 ,  201  and the keyboard (block  90 ). According to one embodiment, the interaction involves the highlighting or otherwise indicating the appropriate key on the keyboard for the note currently being emitted by the speaker  159 ,  201 . Alternatively, any known interaction between the sound and the keyboard is displayed. 
         [0071]      FIG. 2C  is a flow chart depicting the activation of the additional required action of displaying a music staff, according to one embodiment. The software  152 ,  239  processes the further information in the serial data stream relating to displaying a music staff (block  92 ). A signal is then transmitted to the appropriate software  152 ,  239  indicating that the music staff should be displayed (block  94 ). The music staff is displayed on the monitor  180 ,  205  (block  96 ). According to one embodiment, interaction is then provided between the sounds emitted by the speaker  159 ,  201  and the music staff (block  98 ). According to one embodiment, the interaction involves the displaying the appropriate note in the appropriate place on the music staff corresponding to the note currently being emitted by the speaker  159 ,  201 . Alternatively, any known interaction between the sound and the music staff is displayed. 
         [0072]      FIG. 2D  is a flow chart depicting the activation of the additional action of displaying lights, according to one embodiment. The software  152 ,  239  processes the further information in the serial data stream relating to displaying lights (block  200 ). A signal is then transmitted to the lighting controller  160  indicating that certain lights should be displayed (block  202 ). Light is displayed at the set of lights  162  (block  204 ). According to one embodiment, interaction is then provided between the sounds emitted by the speaker  159 ,  201  and the lights (block  206 ). According to one embodiment, the interaction involves the flashing a light for each note emitted by the speaker  159 ,  201 . Alternatively, any known interaction between the sound and the lights is displayed. 
         [0073]      FIG. 3  depicts the structure of a voltage converter  100 , according to one embodiment of the present invention. The voltage converter  100  has a conversion section  102 , a microcontroller section  120 , a RS232 output  140 , and a power supply  101 . In operation, the conversion section  102  receives the actuator output signal  36  from a user console  20 . According to one embodiment, the conversion section  102  recognizes voltage change from the actuator  30 . The microcontroller section  120  polls for any change in voltage in the conversion section  102 . Upon a recognized voltage change, the microcontroller section  120  sends an output signal to the RS232 output  140 . According to one embodiment, the output signal is a byte representing an actuator identifier and state of the actuator. According to one embodiment, the state of the actuator information includes whether the actuator is on or off. The RS232 output  140  transmits the output signal to the processing computer  150  via 146. 
         [0074]      FIG. 4  depicts a perspective view of another embodiment of the present invention. Referring to  FIG. 4 , the present invention in one embodiment includes a user console  20 , mounted on an adjustable support  50 . In this embodiment, the user may adjust the height of the user interface table by raising or lowering the support. Alternatively, the music apparatus may utilize any other known support configuration. 
         [0075]      FIG. 5  shows a cross-section of a user console  20  according to one embodiment of the present invention. The console  20  has a console bottom portion  21  sized to store a plurality of actuators. In one embodiment, a console top portion  22  with cutout  28  is attached to the user console bottom portion  21 . Cutout  28  provides access to the interior  24  of the user console  20  through an opening  29  in the user console top portion  22 . At least one actuator  30  is attached to the user console top surface  34  by an attachment means  23  that holds the actuator  30  in place while the apparatus is played but allows the musician to remove or relocate the actuator  30  to different positions along the user console top surface  34  and thus accommodate musicians with varying physical and cognitive capabilities. In one embodiment, attachment means  23  may be a commercially-available hook-and-loop fastening system, for example Velcro®. In other embodiments, other attachment means  23  may be used, for example, magnetic strips. An actuator cable  35  is routed into the interior  24  of the user console  20  through the opening  29 . Alternatively, a plurality of actuators  30  can be used, and unused actuators can be stored in the user console interior  24  to avoid cluttering the user console top surface  34 . 
         [0076]    According to one embodiment in which the user console top portion  22  is rigidly attached to the user interface table bottom portion  21 , the user console  20  is attached to an upper support member  51  at the table support connection  26  located on the bottom surface  27  of the user console top portion  22 . 
         [0077]    Although the present invention has been described with reference to preferred embodiments, persons skilled in the art will recognize that changes may be made in form and detail without departing from the spirit and scope of the invention.