Wearable electronic musical instrument

Disclosed is a wearable electronic music system including a plurality of first finger mountable implements, each having at least one surface engageable element operatively connected thereto. The system further includes a second finger mountable implement with a state altering element being disposable in a first state or a second state. A sound producing subsystem operatively communicates with the plurality of first finger mountable implements and the second finger mountable implement. In operation, when the state altering element is disposed in the first state, the sound producing subsystem causes a first output to be produced when at least one of said plurality of first finger mountable implements contacts the solid surface, and when the state altering element is disposed in the second state, the sound producing subsystem causes a second output to be produced as the at least one of said plurality of first finger mountable implements contacts the solid surface.

The present disclosure relates to electronic musical instruments and more particularly to a wearable electronic musical system in which input from specially designed finger mountable implements is used to produce selected musical sounds.

BACKGROUND AND SUMMARY

Keyboard instruments existed as early as the third century BC where the Ancient Greeks used a type of pipe organ known as the “hydraulis.” The piano, which began to gain widespread popularity as early as the 18thcentury, saw considerable improvement, in design, throughout the 19thcentury. While it was not uncommon, even in the 20thcentury, to have an upright piano, or even grand, piano, in a home, the popularity of the piano, due to its inherent bulkiness, has diminished in popularity (in terms of consumer demand).

Electric pianos, first developed in the early 20thcentury, used metal strings with a magnetic pickup, an amplifier and a loudspeaker. By the beginning of the 21stcentury, electric piano technology had evolved to hybrid variations such as the “electronic keyboard.” An electronic keyboard, typically including a keyboard used in conjunction with a synthesizer (including a power amplifier) and small loudspeakers, is capable of recreating a wide range of musical sounds.

The dynamic range of the electronic keyboard has been greatly increased through use of the musical instrument digital interface (MIDI)—a standard for digital code transmission and digital technology development. When the electronic keyboard is used as a MIDI controller, MIDI data (including, for instance, information about note pitch, as well as duration) can be used to trigger sounds from a sound module or synthesizer. Capability of the electronic keyboard, when used in the context of a MIDI controller, can be greatly enhanced by use with a computer executing one or more software applications.

A current trend in music composition includes adapting the electronic keyboard into a wearable musical instrument. Each of the following patents at least relates to a wearable musical apparatus usable with a pair of hands:

U.S. Pat. No. 5,029,508 discloses a musical-tone-control apparatus having finger sensors that detect the bending of each finger and produce on/off signals in response to the bending. One group of outputs of the finger sensors is converted into keycodes that control tone pitches by the use of converting rules, and the other group of the outputs thereof is also used for changing the ranges of the tone pitches. Hence, musical tones controlled by finger motions of a performer are generated. Moreover, the converting rules can be altered by a modification-control means so that keycode-conversion rules can be varied. Thus, conversion rules appropriate for generating tones which occur frequently and are easy to produce for an individual, can be set for each musical piece. Furthermore, grouping the outputs of finger sensors makes it possible for a performer to achieve a variety of control of musical tones.

U.S. Pat. No. 7,381,884 discloses a glove including a body that is positional about a user's hand. Speakers are embedded within the body and are coupled to an amplifier. Mechanisms are included for sensing external forces on each finger and for generating control signals when the external forces are detected. Each control signal includes an embedded digital data stream identifying an intensity and a time interval of the external forces. A mechanism is included for calculating a signal pattern corresponding to the control signal data streams. The signal pattern has the identical intensity and time interval characteristics of the external forces. LEDs are coupled to the signal pattern calculating mechanism. A mechanism is included for emitting musical sounds based upon the calculated signal pattern such that the audible musical sounds match the intensity and time interval of the signal pattern. The audible musical sound emitting mechanism includes an amp and a switch coupled thereto.

U.S. Pat. No. 7,674,969 discloses a finger musical instrument, including a first glove and a second glove, some performance keys distributed on a fingertip of each of the gloves, and a sound box positioned at each of the gloves. The finger musical instrument further includes a combination key positioned at palm heel of each of the gloves. Each of the sound boxes is connected with a controller. The performance key and the combination key on the same glove are all connected with the corresponding controller. Therein the performance key and the combination of the performance key and the combination key of one glove gives out one octave sound, while the performance key and the combination of the performance key and the combination key of the other glove gives out another octave sound. Each of the controllers is provided with a range regulation switch used for making a sound higher or lower by an octave on each of the gloves. With regulation of the range regulation switch, the finger musical instrument is able to give out a range of two octaves through the sound box.

U.S. Pat. No. 7,842,879 discloses a touch sensitive impact controlled signal transfer device used as a musical glove device that sends electrical signals to a sound module when areas of the glove containing piezoelectric discs are tapped or otherwise impacted on a surface. The force applied by impact to the piezoelectric disc or discs is interpreted by the sound module and the module produces a sound at a volume level directly related to the force of impact on the piezoelectric discs. Multiple piezoelectric disks are located in each glove allowing a plurality of sounds by tapping different areas of the glove, such as the palm, thumb and fingers.

U.S. Pat. No. 8,362,350, includes a comprehensive discussion of the prior art corresponding with wearable musical instruments, some of which include the use of sensors at the fingertips. The '350 Patent discloses a wearable trigger electronic music system that can simulate any kind of music, anywhere and at any time. For example, one can create all the benefits of the percussion instrument, such as a drum kit, without its cost and burden. The same also applies to string, wind, and other types of instruments of any nation, culture, motif, era, age, etc. The system includes constituent components, including sensors, transducers, electronics, music modules, pre-amps, and amplifiers, wired or wireless, with connections for intra- and inter-modules, including final enjoyment by wired or wireless headphones or speakers. Also delineated is the process of creating music for the DIY enthusiast.

JPH05150771 discloses an electronic musical instrument which can easily be played by providing a controller which generates an audio signal corresponding to the detection data of a depression sensor fitted on a fingertip. Referring more particularly to the bibliographic data for the subject patent, touch switches1a-1e, and2a-2eare stuck on the tips of left and right gloves1and2. A player wears the gloves1and2on the left and right hands and presses the top of a desk to play desired music. The kind of the pressed finger and the pressing time are sent to a microcomputer4through a reception part3, and data for sound source generation are generated there. The data are sent to a sound source part5and inputted to the base of the transistor of a VCA6as an input signal corresponding to the frequency of the sound corresponding to the finger tip and the pressing time. The output of the VCA6is amplified by a power amplifier8and outputted as a musical sound from a speaker.

The disclosures of the above-described patents are incorporated herein by reference.

Each of the following U.S. patents and U.S. patent application publication, the disclosures of which are incorporated herein by reference, may include at least one teaching relating the area of wearable musical technology: U.S. Pat. No. 5,581,484; U.S. Pat. No. 6,304,840; U.S. Pat. No. 6,587,090; U.S. Pat. No. 6,885,316; and U.S. Patent Application Publication No. 2006/0171758.

For example, the wearable musical glove of U.S. Pat. No. 7,674,969 discloses the use of range selection switch, in conjunction with combination and performance keys, to increase octave range. It should be appreciated, however, that this increase in octave or dynamic range comes at the expense of complexity in system usage since each combination key is positioned at a palm heel of a glove, while each range switch appears to be part of (or at least in close proximity to) a sound box at a wrist portion of the glove. Thus, multiple system elements, associated with various parts of a hand, other than the fingers, must be engaged in order to achieve the increased dynamic range. It would desirable to achieve increased dynamic range in the area of wearable electronic musical instrumentation by providing a system that possesses a simple, yet robust design, that is easy to access and use.

In accordance with a first aspect of the present specification, there is disclosed a wearable electronic music system including finger mountable implements for at least two fingers. In one example, a switch is mounted to each finger mountable implement and the finger mountable implements operatively communicate with a sound producing subsystem by way of an interface, such as an ASIC. By selectively changing states of the switch on the one finger element, one of several different outputs can be obtained when the other finger mountable implement is brought into contact with a solid surface. In another example, the switch for one or more finger implements (or alternatively a sensor) can assume one of various forms ranging from a multi-position switch to a switch using a movable member, such as a roller switch. In yet another example, one of the other finger mountable implements is configured to reflect note duration in response to how quickly that finger implement is brought into contact with the solid surface. In another example, the one finger mountable implement is secured to a thumb while the other finger mountable element is secured to a finger other than the thumb. In this way, an output selection for the finger other than the thumb can be made by, for instance, tapping the switch of the thumb prior to contacting the solid surface with the finger other than the thumb.

In accordance with the first aspect of the present specification, the finger mountable implements may be configured as a musical instrument digital interface (MIDI) controller, the MIDI controller operatively communicating with a synthesizer. In response to setting a switch operatively associated with one finger mountable implement and contacting a solid surface with another finger mountable implement, MIDI Messages are communicated to the synthesizer for generating musical output.

In accordance with a second aspect of the present specification, there is disclosed a wearable user input device for selectively producing a first musical output and a second musical output. In one example, at least three finger mountable implements are provided for three respective digits with the first implement being configured to selectively generate first and second signals. Responsive to generation of the first signal, the first musical output is produced when the second and third implements are brought into contact with a solid surface and, responsive to generation of the second signal, the second musical output is produced when the second and third implements are brought into contact with the solid surface

The various embodiments described herein are not intended to limit the disclosure to those embodiments described. On the contrary, the intent is to cover all alternatives, modifications, and equivalents as may be included within the spirit and scope of the various embodiments and equivalents set forth. For a general understanding, reference is made to the drawings. In the drawings, like references have been used throughout to designate identical or similar elements. It is also noted that the drawings may not have been drawn to scale and that certain regions may have been purposely drawn disproportionately so that the features and aspects could be properly depicted

DETAILED DESCRIPTION

Referring toFIG. 1, a wearable electronic musical system is designated with the numeral10. The system10includes a controller the controller being designated by the numeral11and, in one example, the controller11comprises a musical instrumental digital interface (“MIDI”) controller, communicating with a signal processing system66, the signal processing system66being described in detail below. The controller10comprises finger mountable subsystems12and14. In one embodiment, each subsystem12is configured for use with a fingertip and each subsystem14is configured for use with a thumb tip. It should be appreciated, however, that at least one of subsystems12could be used with a thumb, and at least one of subsystems14could be used with a finger without altering the purpose for which the presently disclosed wearable electronic musical system is intended.

Referring next toFIGS. 2 and 3, the respective structures of the subsystems12and14will be described. Referring first toFIG. 2, each finger based subsystem12includes an implement16upon which a first state changing device (“SCD1”)18and interface20are mounted. In one example, the implement16includes a semi-rigid material adapted to fit over a fingertip and be held reasonably firmly in place on the fingertip. In the exemplary implementation ofFIG. 2, the implement16is a hollow cylinder defined by a wall24having an opening26and a closed end28. The dimensions of the implement16are such that it can fit over and be held snugly on a fingertip or thumb-tip. An example of a finger mounted implement suitable for use as the implement16of the presently disclosed wearable electronic musical system is described in U.S. patent application Ser. No. 15/381,434 to Bonner, which was previously incorporated by reference in its entirety.

As will appear, the SCD118can assume a variety of forms and is shown inFIG. 2, for ease of viewing, as a black box. As will appear, the SCD118can be implemented with one or more types of switches (or, alternatively, two or more types of sensors), and can be mounted along wall implement24and/or along implement closed end28. As contemplated, SCD118could include a multi-position switch, a push-button switch, an encoder, a hall-effect encoder, a roller-switch, a rocker switch, a scroll wheel, a scroll ball, a trackball, or joystick. Although various types of sensors could be similarly employed for sensing motion or pressure applied to the implement fitting over a user's finger. For example various forms of contact-type sensors could include force sensors (including stress or strain sensors), a capacitive, resistive or other touch-pad type sensors, heat or vibration sensors, whereas non-contact type sensors that may be used may include an accelerometer, light, infrared or other photometric sensors. Accordingly, the disclosed embodiments may suitably employ any one or a combination of switches or sensors provided that the movement, and in one embodiment, tapping or contact of a fingertip mounted subsystem12or14, causes or results in the generation or change of a signal by the switch or sensor.

Electronic information, the significance of which will appear from the description below, is transmitted from SCD118to interface20over line(s)30. The interface20may include conventional firmware, such as a commercially available ASIC, with the ASIC including all of the logic and memory necessary to produce a suitable signal from the electronic information received by the interface20from either one of the subsystems12and14.

Referring next toFIG. 3, each thumb based subsystem14includes an implement16(including a hollow cylinder defined by a wall24having an opening26and a closed end28) with a second state changing device (“SCD2”)32mounted along wall24and/or at closed end28. Subsystem14also includes an interface20communicating with the SCD232by way of line(s)30. It will be appreciated by those skilled in the art that an interface20can be located at each finger implement and each thumb implement, or simply centralized by providing all of the necessary firmware for signal production with a single interface at each thumb.

Referring toFIGS. 2 and 4A-4F, various exemplary approaches for implementing the SCD118on the finger based subsystem12are described. InFIG. 4A, the implement16is shown as secured on a finger38(with knuckle40shown for reference) with one of switches42mounted on an underside44of the implement16, opposite the knuckle40. In the example ofFIG. 4A, the switch42is a binary push button switch (movable in the direction of arrow43) and can be engaged when the underside44of the finger38contacts a solid surface.

InFIG. 4B, the switch42is shown as being mounted on a tip46of the implement16. Accordingly, the switch42ofFIG. 4Bcan be engaged when the tip46of the finger38contacts the solid surface. InFIG. 4C, two of switches42(designated as switches42aand42b) are shown as being respectively mounted at implement underside44and implement tip46. In the exemplary approach ofFIG. 4C, engagement of the switches42can be achieved by tapping either the underside or tip of the finger38on the solid surface.

Referring toFIGS. 4D-4F, the implementations ofFIGS. 4A-4Care respectively employed, except that, in each implementation, the switch42is replaced with a roller ball switch50A,50B having a roller ball52movable in the direction of arrow53. As will appear from the description of operation below, variable electronic information (indicating, for instance, slight shifts in tonality) can be achieved with the roller ball switch50by simply rolling the roller ball along the solid surface.

Referring toFIGS. 3 and 5A-5E, various exemplary approaches for implementing several types of the SCD232on the thumb based subsystem14are described. The exemplary implementations ofFIGS. 5A and 5Bare structurally equivalent to the exemplary implementations ofFIGS. 4A and 4B, respectively, while the exemplary implementation ofFIG. 5Cis structurally equivalent to the exemplary implementation ofFIG. 4C. It will be appreciated that, for the thumb based subsystem14, the roller ball switch50could also be mounted at the implement tip46. Moreover, the present disclosure contemplates that the location for any one of the switches mounted on implement16could be varied to accommodate for the operational preferences of a given user.

Referring specifically toFIG. 5D, a variation of the roller ball switch50, designated by the numeral54, is shown as being mounted to implement16. The switch54employs a wheel actuator56, which actuator56can be moved clockwise or counterclockwise in the directions of arrow58. Variable states can be achieved by moving the wheel actuator56along a solid surface.

Referring specifically toFIG. 5E, a self-centering switch, designated by the numeral60, is shown as being mounted along the implement underside44. The switch60is shown inFIG. 5Eas including a toggle actuator62and, in one exemplary implementation, the switch60could assume the form of a toggle switch with a rockable actuator of the type shown U.S. Pat. No. 3,299,224, the disclosure of which is incorporated herein by reference. As will be appreciated, one or more of the disclosed switches or sensors42,50,60, may include a tactile feedback mechanism that, either through a mechanical member in the switch or via a tactile signaling mechanism, provides feedback to the user to indicate that the switch or sensor has been activated. For example, in the case of a rockable or movable actuator in switch60, the rocking motion or depression of the switch may trigger an internal mechanism that is sensed by the user's digit (e.g., thumb), in order to provide the user with feedback that the position of the switch was changed. In the case where there is no tactile feedback generated by a component of the switch, for example in the case of a pressure sensing mechanism used on the thumb, a haptic feedback device may be employed with the sensor to provide the user with an equivalent sensation upon the system sensing a trigger of the sensor or switch.

In another example, the switch60could comprise a paddle switch (“or “Whammy Bar”) of the type employed in a “Guitar Hero” guitar permitting a user to vary states by pushing the paddle one way or the other.

Referring toFIGS. 1 and 6, the signal processing system66for generating musical sounds, responsive to signals (e.g., “MIDI Messages”) produced by the subsystems12and14, is now described. In the exemplary approach ofFIG. 6, the controller11comprises a MIDI controller communicating with a computer68by way of a suitable MIDI to USB interface70. As further shown inFIG. 6, the computer68may be provided with device driver software72, on the front end, for permitting MIDI Messages to be communicated to a software implemented synthesizer74. In accordance with conventional technology, the software synthesizer generates tones, namely digital audio, corresponding with the MIDI Messages.

Although shown as a “wired” system, it is also contemplated that one or more the communication channels employed in system66may be a wireless channel as well (e.g., BlueTooth, WIFi, etc.). Furthermore, as depicted inFIG. 6, for example, the MIDI controller receives the signal(s) from subsystems12and/or14, and communicates to an interface. Also contemplated is an embodiment where an electronic device having the capability and features of the MIDI controller11or its equivalent, and possibly of the MIDI to USB interface70, is incorporated into one or more of the subsystems12or14. For example, the subsystem14, operatively attached to a user's thumb, could include both the switch(es) or sensor(s) associated with the thumb, along with the MIDI controller circuitry needed to receive signals from each of the subsystems12on the user's fingers as well. As will be appreciated, in such an embodiment the MIDI controller11would need a source of power, either from an associated power supply, which may be a wired connection (e.g., USB supplied power), or may be in the form of a battery or another portable supply for power.

In yet another variation of the embodiment depicted in the figures the functionality of the MIDI controller as well as other components of the disclosed processing system66may be implemented through the use of a computer or other processor in response to programmatic instructions. This software-driven system could create MIDI or other synthesizer inputs in response to signals from the subsystems12and14. As an example, the signals from subsystems12and14may be received through conventional input/output (I/O) ports of the computer68, transmitted via wired or wireless connections with the computer), and processed in a manner similar to that described to produce the MIDI or synthesizer information in response to the state changing device(s).

Referring toFIGS. 1-3, and 6, a manner in which a MIDI message may be generated can now be more fully understood. As the SCD118of at least one of subsystems12is brought into contact with a solid surface, selected electronic information or data (corresponding to, for instance, finger designation and/or note duration) is produced. As explained in further detail below, in one preferred example of operation, generation of data from subsystem12is constrained by a given state of the SCD232of subsystem14. In turn, the selected data from the subsystem12is communicated to the interface20, the interface20being preprogrammed to generate a MIDI Message. Each generated MIDI Message corresponds with one or more preselected digital audio outputs that are produced by the software synthesizer74in response to receiving the MIDI Message. Software tools for programming software synthesizers to correspond MIDI Messages with certain preselected outputs are available from the one of several software vendors. In response to the software synthesizer74producing digital audio output from the MIDI messages, a device driver software76permits consumable audio output to be delivered to an audio device78. The audio device, in one example, can be speakers included with or operatively connected to the computer68.

Referring now toFIG. 7, a process for generating MIDI Messages with MIDI controller11, and using the same, with the MIDI signal processing system66to produce corresponding musical sounds or outputs is described. As will be appreciated by those skilled in the art, the MIDI Messages are generated by collecting information or data from the subsystems12,14and creating appropriate signals for consumption with the MIDI signal processing system66. Moreover, the logic and short term memory necessary to generate the MIDI Messages is preferably obtained with the interface20.

Referring initially to inquiry82of the flow diagram inFIG. 7, a check is performed to determine if one or more fingers (each including a SCD118) has contacted a solid surface, (i.e., is at least one finger active?). If at least one finger is active (i.e., at least one SCD118has contacted a solid surface), then the process (as implemented with the interface20), determines, at step84, the current state setting of at least one of the SCD2s32of subsystems14(FIGS. 1 and 2). As follows from the above description ofFIGS. 5A-5E, the state of each SCD232can be set with one of the switches42,50,54and60. In one example, obtaining the state of subsystem14for a given thumb permits finger related data for an associated hand to be generated in the context of a first state or a second state (step86or88). To understand the significance of generating MIDI Messages in the context of one state or another, as well as the operation of the controller11, reference is made toFIGS. 1, 2, and 7along with the following example:

ForFIG. 1, fingers (F1-F8) may be respectively assigned to the following musical outputs: A B C D E F G A. Note that the term “output,” as used in the present disclosure, can refer to the output for a single musical note or the collective output a series of related notes, such as a musical scale (e.g., ABCD) or chord (e.g. AC). In the present example, when the SCD232of subsystem14, on thumbs T1-T2, is in a first state, the output may correspond to one of several octaves and, when SCD232is in a second state, the output may correspond with another of several octaves. As contemplated, all of the octaves for a given keyboard instrument can be selected and generated with a given type of SCD232, such as a roller switch. In particular, as follows fromFIG. 5D, the actuator56can be rolled along a solid surface to cause data from each subsystem12to be generated in the first state (starting at step86) or the second state (starting at step88). Alternatively, in one example, the switches42a/42bofFIG. 5Bcan be configured to move tonal output either upscale (by continuously pressing of switch42a), or downscale, (by continuously pressing switch42b). Selection or alteration of the scale may be done in alternative ways as well. For example, the user may use a switch or sensor on the left hand to cause, upon each contact of a designated SCD (e.g., left thumb), an increase in scale and conversely a switch or sensor on the right hand to cause, upon contact, a decrease in scale.

Also contemplated, particularly where one or more switches or sensors may be employed to switch or shift scale, is an associated display80(FIG. 6), whereby one or more windows or portions of the display80may be used to illustrate the selected scale at any particular time. The intent of such a feature is to provide to the user an indication of which scale(s) the system is currently operating in. Similar visual feedback could be provided to the user using signaling lights (e.g., LEDs) that output different colors in response to the selected scale, or provide output at different positions as the scale is changed. As will be appreciated, such a system may also employ one or more conventional input devices such as a computer (e.g., ASCII) keyboard, mouse, touch-pad, touch-screen, control console, synthesizer interface, etc. to supplement the inputs available using the finger mountable subsystems12and14. In summary a user's thumb or other digit may be used to manipulate (e.g., set or change) the key, octave setting, instrumentality (selected instrument(s)), as well as other settings that are provided in a conventional synthesizer interface (e.g., percussion beats, key shift, etc.). And, with a display80available, perhaps in the form of a touch-sensitive user interface such as found on a smartphone or tablet computer, the touch-sensitive input capability may also be employed for one or more of the noted selections, such as octave, key-settings, instrument(s) selection, etc. Such selections being immediately reflected via a corresponding display element. Moreover, as suggested above, such settings may be depicted in some manner on the display, including text, iconic representation and the like.

For the exemplary process ofFIG. 7, data, generated as a result of at least some or all of fingers F1-F8 (with corresponding SCD1s18) contacting a solid surface, is buffered with interface20. That is, data is sampled at preselected intervals with the interface20, and then buffered/processed at the same interface (step92). As will be appreciated by those skilled in the art, the sampling interval should be granular enough to capture data corresponding with musical notes of varying duration (including notes with only a fractional duration of a whole note). Moreover, the sampling period should be frequent enough to capture a significant amount of data without creating undesirable gaps or “dead space” in resulting MIDI output. With suitable sampling, smooth reproduction of virtually all musical combinations (including sequential combinations or chords) should be obtainable. Suitable sampling should also permit high quality replication of fractional musical notes (namely musical notes with a duration of less than a whole note).

Referring still toFIG. 7, based on an inquiry at step94, once data has been sampled and buffered over a preselected number of time intervals (i.e., a preselected sampling period), interface20, at step98, generates MIDI Messages for the buffered data. Note, the sub-process performed with steps100,102,104is equivalent to the sub-process performed with steps90,92and94, except that one sub-process is constrained by the first state, while the other sub-process is constrained by the second state. For either sub-process, MIDI Messages are generated from the buffered data and, per step106MIDI output is produced using the software synthesizer of computer68(step98). In one example of operation, the process ofFIG. 7can be used to conveniently create musical output in one state (possibly a scale in one octave)—by merely contacting a solid surface with SCD232and then any one(s) of SCD1s18)—and then in another state—by merely contacting the solid surface again with SCD232and any one(s) of SCD1s18.

It will be appreciated that, in accordance with the use of MIDI technology, many different types of outputs can be assigned to the subsystems12so that, for instance, the two hands ofFIG. 1could even be used to replicate multiple instruments. Moreover, the subsystem14can be used to expand and contract the dynamic range of output(s) generated with the subsystems12. In the above example, where the fingers are organized as a scale, the subsystems permit programmable tonal separation between a first scale and a second scale by simply tapping one of the SCD2s32on a solid surface a desired number of times. Other combinations using the subsystems12and14can be envisaged. For instance, in a first state, one hand might represent the notes of an instrument bass section while, in a second state, another hand might represent the notes of a treble section of another instrument.