Abstract:
The present invention is method and apparatus for assistive music performance. More specifically, the present invention is an interactive wireless music apparatus comprising actuating an event originating on a remote wireless device. The transmitted event received by a processing host computer implements the proper handling of the event.

Description:
CROSS-REFERENCE TO RELATED APPLICATION(S) 
   This application claims priority to U.S. Provisional Patent Application No. 60/585,617 filed Jul. 6, 2004, which is incorporated herein by reference in its entirety. 

   TECHNICAL FIELD 
   The present invention relates generally to the field of music. More specifically, the present invention relates to a wireless electronic musical instrument; enabling musicians of all abilities to learn, perform, and create sound. 
   BACKGROUND OF THE INVENTION 
   For many years as is common today, performing music is restricted to traditional instruments such as acoustic and electronic keyboards, stringed, woodwind, percussive and brass. In all of the instruments in each of these classifications, a high level of mental aptitude and motor skill is required to adequately operate the instrument. Coordination is necessary to control breathing, fingering combinations and expression. Moreover, the cognitive ability to read the music, watch the conductor for cues and listen to the other musicians to make adjustments necessary for ensemble play require high cognitive function. Most school band programs are limited to the use of these instruments and limit band participation to only those students with the physical and mental capacity to operate traditional instruments. 
   For example, a students with normal mental and physical aptitude shows an interest in a particular traditional instrument and the school and/or parents make an instrument available with options for instruction. The child practices and attends regular band rehearsals. Over time the student becomes proficient at the instrument and playing with other musicians. This is a very common scenario for the average music student. 
   However, this program assumes all children have adequate cognitive and motor function to proficiently operate a traditional instrument. It assumes that all children are capable of reading music, performing complex fingering, controlling dynamics and making necessary adjustments for ensemble performance. The currently available musical instruments do not consider individuals with below normal physical and mental abilities. Hence, it prohibits the participation of these individuals. 
   Consequently, there is a need in the art for a universal adaptive musical instrument that enables people of all abilities to perform music alone, with other individuals of similar abilities or with others in a traditional band setting. This solution should provide the necessary flexibility to assist individuals with their particular disability. In essence, implement corrective technology to close the gap and enable them to fully participate in music. 
   BRIEF SUMMARY OF THE INVENTION 
   The present invention, in one embodiment, is a universal adaptive musical system. The system includes a host computing device, one or many remote wireless computing devices (actuator), a speaker configuration/output component and a wireless router. The actuator is configured to transmit a signal upon actuation and the voltage converter is configured to convert the signal from the actuator into a data stream. The processing computer is configured to convert the data stream into a first output signal and a second output signal. The speaker is configured to receive the first output signal and emit sound. The output component is configured to receive the second output signal and perform an action based on the second output signal. 
   According to a further embodiment, the present invention is a method of music performance. The method includes the wireless transmission of a events on a remote wireless device. The data transferred over a wireless network is processed by the processing host computer which creates the output. 
   While multiple embodiments are disclosed, still other embodiments of the present invention will become apparent to those skilled in the art from the following detailed description, which shows and describes illustrative embodiments of the invention. As will be realized, the invention is capable of modifications in various obvious aspects, all without departing from the spirit and scope of the present invention. Accordingly, the drawings and detailed description are to be regarded as illustrative in nature and not restrictive. 

   
     BRIEF DESCRIPTION OF THE DRAWINGS 
       FIG. 1  is a schematic diagram of one embodiment of the present invention. 
       FIG. 2  is a schematic diagram of an alternative embodiment of the present invention. 
       FIG. 3  is a sequence diagram showing standard operation of the apparatus, according to one embodiment of the present invention. 
       FIG. 4  is a sequence diagram showing operation during ensemble mode of the apparatus, according to one embodiment of the present invention. 
       FIG. 5  is a sequence diagram depicting the operational flow during assessment mode using the apparatus, according to one embodiment of the present invention. 
   

   DETAILED DESCRIPTION 
     FIG. 1  shows a schematic diagram a music apparatus  13 , according to one embodiment of the present invention. As shown in  FIG. 1 , the music apparatus  13  may include optional external speakers  1 , an external wireless transmitter  4 , and external MIDI (Musical Instrument Digital Interface) sound generator  13 , a processing computer  13  having a processor  3 , software  39 , and an internal/external sound card  2  and a display monitor  5 . The processing computer  13  is connected to the display monitor  5  by a monitor cable  6 . The processing computer  13  is connected to the speaker  1  by a speaker line out cable  7 . The wireless transmitter  4  is connected to the processing computer  13  via a cable  8 . Likewise, the optional external MIDI device  12  is connected to the processing computer  13  via a MIDI cable  38 . The remote wireless device  11  contains a processor  41 , touch-sensitive LDC display  44  and software  40 . In an alternative embodiment of this remote wireless device  11 , serial connector  41  attached to serial cable  9  and actuator switch  10  is optional. 
     FIG. 2  presents an alternative aspect of the present invention. The processing computer  13  contains a touch-sensitive liquid crystal display (LCD)  5 , thus eliminating the monitor display cable  6 . 
   In one embodiment, the actuator  10  may be any known mechanical contact switch that is easy for a user to operate. Alternatively, different types of actuators, for example, light sensors, may also be used. In one aspect of the present invention, the number of actuators  10  can vary according to factors such as the user&#39;s skill, physical capabilities and actuator implementation. 
   According to one embodiment, the processing computer  13 / 14  may be any standard computer, including a personal computer running a standard Windows® based operating system, with standard attachments and components (e.g., a CPU, hard drive, disk and CD-ROM drives, a keyboard and a mouse). The processor  3  may be any standard processor such as a Pentium® processor or equivalent. 
     FIG. 3  depicts a sequence diagram of standard operational flow. The remote wireless device  11  is switched on. The remote wireless device software  40  is started and establishes a wireless connection  43  with the host processing PC  13 / 14  via the wireless transmitter (router)  4 . Upon successful connection, the remote wireless device transmits a user log on or handshake message  17  to the host PC  13 / 14 . The host PC  13 / 14  returns an acknowledgement message  19 . Upon successful log on, the remote wireless device  11  notifies the host PC  13 / 14  of it&#39;s current device profile  20 . The device profile  20  contains data necessary for the host PC  13 / 14  to properly service future commands  23  received from the remote device  11 . Specifically, during host PC synchronization a map of host PC  13 / 14  actions that correspond to specific remote device  11  x-y coordinates locations (or regions of x-y coordinates) on the remote device  11  LCD display  44  are created. With the mapping complete, both the host PC  13 / 14  and remote wireless device  11  are now synchronized. After successful synchronization, the host PC  13 / 14  and the remote wireless device  11  refresh their displays  5 ,  44  respectively. The user may press the LCD display  44  to send a command  23  to the host PC  13 / 14 . A remote device command  23  transmitted to the host PC  13 / 14  contains an identifier to the location the user pressed on the remote device LCD  44 . A remote device command  23  may optionally include meta data such as position change or pressure intensity. When the command  23  is received by the host PC  13 / 14 , the host PC  13 / 14  invokes the command processor  24  which executes the action mapped to the location identifier. This action, handled in the command processor  24  may include directing a MIDI command or series of commands to the host PC  13 / 14  MIDI output, sending a MIDI command or series of commands to an external MIDI sound generator  12 , playing a media file or instructing the host PC  13 / 14  to change a configuration setting. It may also include a script that combines several disparate functions. The command processor  24  continues to service command messages until the remote device  11  logs off  27 . Upon transmission and receipt by the host PC  13 / 14  of a log off message  27  of a remote device  11 , the host PC  13 / 14  discontinues processing commands and destroys the action map. 
     FIG. 3A  is a sequence diagram showing an alternative flow when an external switch, or actuator  10  is the source of the activation. The external switch actuator is connected to the remote wireless device  11  via serial communication cable  9 . The user initiates operation by pressing the actuator button  10 . Upon engagement by the user  48 , the actuator  10  changes a pin condition on the serial connection  9 . This event is recognized by the remote wireless device software  40 . The remote device software  40  references a map that indicates the location identifier  49  to be transmitted to the host PC  13 / 14 . The remote device  11  transmit the location identifier to the host PC  13 / 14 . 
   According to one embodiment of this invention, the host PC  13 / 14  supports a multiple number of remote wireless devices  11  restricted only by the underlying limitations of the hardware and operating system (wireless transmitter  4 , processor  3 ). 
   According to one embodiment, the command processing of MIDI data involves the use of a known communication music computing standard called a Musical Instrument Digital Interface (“MIDI”). According to one embodiment, the operating system  50  provides a library of preset MIDI sounds. As is understood in the art, each MIDI command is sent to the MIDI driver (not shown part of the operating system  50 ) of the host PC  13 / 14 . The MIDI driver directs the sound to the sound card  2  for output to the speaker  1 . 
   Alternatively, the MIDI command is redirected by the MIDI driver to an external MIDI sound module  12 . The MIDI sound module may be any commercially-available MIDI sound module containing a library of audio tones. The MIDI sound module  12  generates a MIDI sound output signal which may be directed to the speakers  1 . 
     FIG. 4  is a sequence operational diagram depicting system operation in ensemble mode. In ensemble mode, the host PC  13 / 14  manages a real-time performance of one or many users. The music performed is defined in an external data file using the standard MIDI file format. The remote device  11  start up and log on sequence is identical to the sequence illustrated in  FIG. 3 . The change to ensemble mode takes place on the host PC  13 / 14 . A system administrator selects a MIDI file to perform  30 . The host PC  13 / 14  opens the MIDI file and reads in the data  31 . The MIDI file contains all of the information necessary to playback a piece of music. This operation  31  determines the number of needed performers and assigns music to each performer. Performers may be live (a logged on performer) or a substitute performer (computer). The music assigned to live performers considers the performers ability and assistance needs (assessment profile). The system administrator selects the tempo for the performance and starts the ensemble processing  35 . The host PC  13 / 14  and the remote wireless device  11  communicate during ensemble processing and offer functionality to enhance the performance of individuals that require assistance with the assigned part. These enhancements include visual cueing  34 , command filtering, command location correction, command assistance and command quantization  51 . Visual cueing creates a visual cue on the remote device  11  LCD  44  alerting the performer as to when and where to press the remote device LCD  44 . In one embodiment, the visual cue may be a reversal of the foreground and background colors of a particular region of the remote device LCD  44 . The visual cueing assists performers that have difficultly reading or hearing music. Using the MIDI file as a reference for the real-time performance, the command sequence expectation is known by the host PC  13 / 14  managing the performance. This enables the ensemble manager to provide features to enhance the performance. The command filter ignores out of sequence commands or commands that are not relevant at the time received within the performance. Command location correction adjusts the location identifier when the performer errantly presses the remote device LCD  44  at the incorrect x-y coordinate or region. Command assistance automatically creates commands for performers that do not respond within a timeout window. Command quantization corrects the timing of the received command in context to the performance. 
     FIG. 5  is a sequence operational diagram depicting system operation in assessment mode. In assessment mode, the host PC  13 / 14  manages series of assessment scripts to determine the performers cognitive and physical abilities. This evaluation enhances ensemble assignment and processing to optimize real-time ensemble performance. The remote device  11  start up and log on sequence is identical to the sequence illustrated in  FIG. 3 . The change to assessment mode takes place on the host PC  13 / 14 . A system administrator selects an assessment script  36  and directs the assessment test to a particular remote device  11 . The user responds  52  to his/her ability. The script may contain routines to record response time, location accuracy (motor skill) and memory recall (cognitive) using sequence patterns. 
   In one embodiment of the invention, several default device templates are defined. These templates define quadrilateral regions within the remote device  11  LCD display  44 . Each defined region has an identifier used in remote device  11  commands to the host PC  13 / 14 . The command processor on the host PC  13 / 14  determines the location on the remote device  11  LCD  44  using this template region identifier. 
   In one embodiment of the invention, a region may be designated as a free form location. A remote device  11  region with this free form attribute includes additional information with the commands transmitted to the host PC  13 / 14 . This meta data includes relative movement on the remote device  11  LCD  44 . The change in x and y coordinate values is included with the location identifier. Coordinate delta changes enable the command processor to extend the output of the command to include changes in dynamics, traverse a scale or series of notes, modify sustained notes or process and series of MIDI commands. 
   In one embodiment of the invention, ensemble configurations may be defined on the host PC  13 / 14 . Ensemble configurations are pre-defined remote device configuration sets which detail regions definitions for known remote devices  11 . These ensemble configuration sets may be downloaded to the remote devices  11  via the host PC  13 / 14  simultaneously. 
   In one embodiment of the invention, the mechanism of data transmission between the remote wireless device  11  and the host PC  13 / 14  may be TCP/IP, Bluetooth, 802.15 or other wireless technology.