Enhancing Exercise Through Augmented Reality

The disclosure relates to enhancing exercise through augmented reality. In particular, the disclosure describes monitoring a user's performance and generating a virtual representation of that user's performance to be displayed during a future exercise routine to motivate the user to improve performance during their next workout.

BACKGROUND

While most people appreciate the importance of physical fitness, many have difficulty finding the motivation required to maintain a regular exercise program or to continually improve their workouts during their exercise routines. In addition, some people find it particularly difficult to maintain an exercise regimen that involves continuously repetitive motions, such as running, walking and bicycling.

Moreover, individuals may view exercise as work or a chore and thus, separate it from enjoyable aspects of their daily lives. Often, this separation between athletic activity and other activities reduces the amount of motivation that an individual might have toward exercising. Further, athletic activity services and systems directed toward encouraging individuals to engage in athletic activities might also be too focused on one or more particular activities while an individual's interests are ignored. This may further decrease a user's interest in participating in athletic activities or using the athletic activity services and systems.

Therefore, improved systems and methods to address these and other shortcomings in the art are desired.

BRIEF SUMMARY

Aspects of this disclosure relate to motivating individuals to maintain or improve upon a threshold level of physical activity. Certain implementations may motivate individuals by informing users of their current progress against user defined and system defined goals. In one embodiment, feedback may facilitate individuals observing one or more benefits associated with physical activity. By realizing benefits associated with their activities, users may be encouraged to continue exercising or increase exercising intensity.

In an embodiment, a visual and audio system may motivate users to push their limits by extending workouts by a known quantifiable amount. The system may engage users by enabling them to explore new variations of their common workouts while eliminating worry or fear of the unknown by providing a trusted system to recommend safe modifications to their workout routines or exercise programs.

Example embodiments may relate to a system, method, apparatus, and computer readable media configured for monitoring a user's performance during an exercise routine. In an embodiment, the monitored performance may be used to generate a virtual representation of the user's performance to be displayed during a future exercise routine to motivate the user to improve performance during their next workout. In another embodiment, a virtual shadow may illustrate a proper form (or any specific form) of the exercise to assist the user with improving performance during their workout routine.

In an embodiment, an electronic device capable of communicating with a user may overlay information into a user's field of vision through use of eyewear or other personal wearable items. Such received information may include audio information received from speakers or other sound producing devices. In an embodiment, the overlay may include a virtual representation of a user's prior workout performance. In an embodiment, a user may compete against their prior workout performances or against a friends or athletes prior workout performance. In yet another embodiment, multiple workout performances may be represented by different avatars or visual representations displayed in a user's field of vision as the user completes his/her current workout.

These and other aspects of the embodiments are discussed in greater detail throughout this disclosure, including the accompanying drawings.

DETAILED DESCRIPTION

In the following description of the various embodiments, reference is made to the accompanying drawings, which form a part hereof, and in which is shown by way of illustration various embodiments in which the disclosure may be practiced. It is to be understood that other embodiments may be utilized and structural and functional modifications may be made without departing from the scope and spirit of the present disclosure. Further, headings within this disclosure should not be considered as limiting aspects of the disclosure. Those skilled in the art with the benefit of this disclosure will appreciate that the example embodiments are not limited to the example headings.

In an aspect of the disclosure, a user's performance is monitored and a virtual representation of that user's performance is generated to be displayed during a future exercise routine to motivate the user to improve performance during their next workout. In another embodiment, a virtual shadow may illustrate a proper form (or any specific form) of the exercise in real-time feedback to assist the user with improving performance during their workout routine. In an embodiment, an electronic device capable of communicating with a user may overlay information into a user's field of vision through use of eyewear or other personal wearable items during exercise. In an embodiment, a user may compete against their prior workout performances or against a friends or athletes prior workout performance. In yet another embodiment, multiple workout performances may be represented by different avatars or visual representations displayed in a user's field of vision as the user completes his/her current workout.

FIG. 1Aillustrates an example of a monitoring and feedback system100in accordance with example embodiments. Example system100may include one or more electronic devices, such as computer102. Computer102may comprise a mobile terminal, such as a telephone, music player, tablet, netbook or any portable device. In other embodiments, computer102may comprise a set-top box (STB), desktop computer, digital video recorder(s) (DVR), computer server(s), and/or any other desired computing device. In certain configurations, computer102may comprise a gaming console, such as for example, a Microsoft® XBOX, Sony® Playstation, and/or a Nintendo® Wii gaming consoles. Those skilled in the art will appreciate that these are merely example consoles for descriptive purposes and this disclosure is not limited to any console or device.

Turning briefly toFIG. 1B, computer102may include computing unit104, which may comprise at least one processing unit106. Processing unit106may be any type of processing device for executing software instructions, such as for example, a microprocessor device. Computer102may include a variety of non-transitory computer readable media, such as memory108. Memory108may include, but is not limited to, random access memory (RAM) such as RAM110, and/or read only memory (ROM), such as ROM112. Memory108may include any of: electronically erasable programmable read only memory (EEPROM), flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical disk storage, magnetic storage devices, or any other medium that can be used to store the desired information and that can be accessed by computer102.

The processing unit106and the system memory108may be connected, either directly or indirectly, through a bus114or alternate communication structure to one or more peripheral devices. For example, the processing unit106or the system memory108may be directly or indirectly connected to additional memory storage, such as a hard disk drive116, a removable magnetic disk drive, an optical disk drive118, and a flash memory card, as well as to input devices120, and output devices122. The processing unit106and the system memory108also may be directly or indirectly connected to one or more input devices120and one or more output devices122. The output devices122may include, for example, a monitor display, television, printer, stereo, or speakers. The input devices120may include, for example, a keyboard, touch screen, a remote control pad, a pointing device (such as a mouse, touchpad, stylus, trackball, or joystick), a scanner, a camera or a microphone. In this regard, input devices120may comprise one or more sensors configured to sense, detect, and/or measure athletic movement from a user, such as user124, shown inFIG. 1A.

Looking again toFIG. 1A, image-capturing device126and/or sensor128may be utilized in detecting and/or measuring athletic movements of user124. In one embodiment, data obtained image-capturing device126or sensor128may directly detect athletic movements, such that the data obtained from image-capturing device126or sensor128is directly correlated to a motion parameter. For example, and with reference toFIG. 4, image data from image-capturing device126may detect that the distance between sensor locations402gand402ihas decreased and therefore, image-capturing device126alone may be configured to detect that user's124right arm has moved. Yet, in other embodiments, data from image-capturing device126and/or sensor128may be utilized in combination, either with each other or with other sensors to detect and/or measure movements. Thus, certain measurements may be determined from combining data obtained from two or more devices. Image-capturing device126and/or sensor128may include or be operatively connected to one or more sensors, including but not limited to: an accelerometer, a gyroscope, a location-determining device (e.g., GPS), light sensor, temperature sensor (including ambient temperature and/or body temperature), heart rate monitor, image-capturing sensor, moisture sensor and/or combinations thereof. Example uses of illustrative sensors126,128are provided. Computer102may also use touch screens or image capturing device to determine where a user is pointing to make selections from a graphical user interface. One or more embodiments may utilize one or more wired and/or wireless technologies, alone or in combination, wherein examples of wireless technologies include Bluetooth® technologies, Bluetooth® low energy technologies, and/or ANT technologies.

Still further, computer102, computing unit104, and/or any other electronic devices may be directly or indirectly connected to one or more network interfaces, such as example interface130(shown inFIG. 1B) for communicating with a network, such as network132. In the example ofFIG. 1B, network interface130, may comprise a network adapter or network interface card (NIC) configured to translate data and control signals from the computing unit104into network messages according to one or more communication protocols, such as the Transmission Control Protocol (TCP), the Internet Protocol (IP), and the User Datagram Protocol (UDP). These protocols are well known in the art, and thus will not be discussed here in more detail. An interface130may employ any suitable connection agent for connecting to a network, including, for example, a wireless transceiver, a power line adapter, a modem, or an Ethernet connection. Network132, however, may be any one or more information distribution network(s), of any type(s) or topography(s), alone or in combination(s), such as internet(s), intranet(s), cloud(s), LAN(s). Network132may be any one or more of cable, fiber, satellite, telephone, cellular, wireless, etc. Networks are well known in the art, and thus will not be discussed here in more detail. Network132may be variously configured such as having one or more wired or wireless communication channels to connect one or more locations (e.g., schools, businesses, homes, consumer dwellings, network resources, etc.), to one or more remote servers134, or to other computers, such as similar or identical to computer102. Indeed, system100may include more than one instance of each component (e.g., more than one computer102, more than one display136, etc.).

Regardless of whether computer102or other electronic device within network132is portable or at a fixed location, it should be appreciated that, in addition to the input, output and storage peripheral devices specifically listed above, the computing device may be connected, such as either directly, or through network132to a variety of other peripheral devices, including some that may perform input, output and storage functions, or some combination thereof. In certain embodiments, a single device may integrate one or more components shown inFIG. 1A. For example, a single device may include computer102, image-capturing device126, sensor128, display136and/or additional components. In one embodiment, sensor device138may comprise a mobile terminal having a display136, image-capturing device126, and one or more sensors128. Yet, in another embodiment, image-capturing device126, and/or sensor128may be peripherals configured to be operatively connected to a media device, including for example, a gaming or media system. Thus, it goes from the foregoing that this disclosure is not limited to stationary systems and methods. Rather, certain embodiments may be carried out by a user124in almost any location.

Computer102and/or other devices may comprise one or more sensors126,128configured to detect and/or monitor at least one fitness parameter of a user124. Sensors126and/or128may include but not limited to: an accelerometer, a gyroscope, a location-determining device (e.g., GPS), light sensor, temperature sensor (including ambient temperature and/or body temperature), heart rate monitor, image-capturing sensor, moisture sensor and/or combinations thereof. Network132and/or computer102may be in communication with one or more electronic devices of system100, including for example, display136, an image capturing device126(e.g., one or more video cameras), and sensor128, which may be an infrared (IR) device. In one embodiment sensor128may comprise an IR transceiver. For example, sensors126, and/or128may transmit waveforms into the environment, including towards the direction of user124and receive a “reflection” or otherwise detect alterations of those released waveforms. In yet another embodiment, image-capturing device126and/or sensor128may be configured to transmit and/or receive other wireless signals, such as radar, sonar, and/or audible information. Those skilled in the art will readily appreciate that signals corresponding to a multitude of different data spectrums may be utilized in accordance with various embodiments. In this regard, sensors126and/or128may detect waveforms emitted from external sources (e.g., not system100). For example, sensors126and/or128may detect heat being emitted from user124and/or the surrounding environment. Thus, image-capturing device126and/or sensor128may comprise one or more thermal imaging devices. In one embodiment, image-capturing device126and/or sensor128may comprise an IR device configured to perform range phenomenology. As a non-limited example, image-capturing devices configured to perform range phenomenology are commercially available from Flir Systems, Inc. of Portland, Oreg. Although image capturing device126and sensor128and display136are shown in direct (wirelessly or wired) communication with computer102, those skilled in the art will appreciate that any may directly communicate (wirelessly or wired) with network132.

User124may possess, carry, and/or wear any number of electronic devices, including sensory devices138,140,142,144and/or182. In certain embodiments, one or more devices138,140,142,144,182may not be specially manufactured for fitness or athletic purposes. Indeed, aspects of this disclosure relate to utilizing data from a plurality of devices, some of which are not fitness devices, to collect, detect, and/or measure athletic data. In one embodiment, device138may comprise a portable electronic device, such as a telephone or digital music player, including an IPOD®, IPAD®, or iPhone®, brand devices available from Apple, Inc. of Cupertino, Calif. or Zune® or Microsoft® Windows devices available from Microsoft of Redmond, Wash. As known in the art, digital media players can serve as both an output device for a computer (e.g., outputting music from a sound file or pictures from an image file) and a storage device. In one embodiment, device138may be computer102, yet in other embodiments, computer102may be entirely distinct from device138. Regardless of whether device138is configured to provide certain output, it may serve as an input device for receiving sensory information. Devices138,140,142,144, and/or182may include one or more sensors, including but not limited to: an accelerometer, a gyroscope, a location-determining device (e.g., GPS), light sensor, temperature sensor (including ambient temperature and/or body temperature), heart rate monitor, image-capturing sensor, moisture sensor and/or combinations thereof. In certain embodiments, sensors may be passive, such as reflective materials that may be detected by image-capturing device126and/or sensor128(among others). In certain embodiments, sensors144may be integrated into apparel, such as athletic clothing. For instance, the user124may wear one or more on-body sensors144a-b. Sensors144may be incorporated into the clothing of user124and/or placed at any desired location of the body of user124. Sensors144may communicate (e.g., wirelessly) with computer102, sensors128,138,140, and142, and/or camera126. Examples of interactive gaming apparel are described in U.S. patent application Ser. No. 10/286,396, filed Oct. 30, 2002, and published as U.S. Pat. Pub, No. 2004/0087366, the contents of which are incorporated herein by reference in its entirety for any and all non-limiting purposes. In certain embodiments, passive sensing surfaces may reflect waveforms, such as infrared light, emitted by image-capturing device126and/or sensor128. In one embodiment, passive sensors located on user's124apparel may comprise generally spherical structures made of glass or other transparent or translucent surfaces which may reflect waveforms. Different classes of apparel may be utilized in which a given class of apparel has specific sensors configured to be located proximate to a specific portion of the user's124body when properly worn. For example, golf apparel may include one or more sensors positioned on the apparel in a first configuration and yet soccer apparel may include one or more sensors positioned on apparel in a second configuration. Devices138-144and182may communicate with each other, either directly or through a network, such as network132. Communication between one or more of devices138-144and182may communicate through computer102. For example, two or more of devices138-144and182may be peripherals operatively connected to bus114of computer102. In yet another embodiment, a first device, such as device138may communicate with a first computer, such as computer102as well as another device, such as device142, however, device142may not be configured to connect to computer102but may communicate with device138. Those skilled in the art will appreciate that other configurations are possible.

In one embodiment, device182may include glasses or eyewear182. Glasses182may be capable of communicating with a user by overlaying visual information onto the lenses of glasses182. The overlaid information may be placed in a particular region of users'124field of vision so as not to interfere or distract user124. In addition, glasses182may also be used to provide audio information to user124. In yet another embodiment, glasses182may also be used as an input device for receiving sensory information from user124.

Some implementations of the example embodiments may alternately or additionally employ computing devices that are intended to be capable of a wide variety of functions, such as a desktop or laptop personal computer. These computing devices may have any combination of peripheral devices or additional components as desired. Also, the components shown inFIG. 1Bmay be included in the server134, other computers, apparatuses, etc.

In certain embodiments, sensory devices138,140,142,144and/or182may be formed within or otherwise associated with user's124clothing or accessories, including a watch, sunglasses, eyeglasses, armband, wristband, necklace, shirt, shoe, or the like. Examples of shoe-mounted and wearable devices are described immediately below, however, these are merely example embodiments and this disclosure should not be limited to such.

In an embodiment, devices such as device138,140,142,144and/or182may include similar hardware such as the hardware discussed above with respect to computer102and in particular the hardware shown inFIG. 1B. For instance, devices138,140,142,144and/or182may include a processing unit, memory, a CD-ROM, digital versatile disks (DVD) or other optical disk storage, magnetic storage devices, or any other medium that can be used to store the desired information and that can be accessed by computer102. In addition, devices138,140,142,144and/or182may also include one or more input devices and one or more output devices. The output devices may include, for example, a monitor display, television, printer, stereo, or speakers. The input devices may include, for example, a keyboard, touch screen, a remote control pad, a pointing device (such as a mouse, touchpad, stylus, trackball, or joystick), a scanner, a camera or a microphone. In this regard, input devices may comprise one or more sensors configured to sense, detect, and/or measure athletic movement from a user, such as user124, shown inFIG. 1A.

In certain embodiments, sensory device140may comprise footwear which may include one or more sensors, including but not limited to: an accelerometer, location-sensing components, such as GPS, and/or a force sensor system.FIG. 2Aillustrates one exemplary embodiment of an example sensor system202. In certain embodiments, system202may include a sensor assembly204. Assembly204may comprise one or more sensors, such as for example, an accelerometer, location-determining components, and/or force sensors. In the illustrated embodiment, assembly204incorporates a plurality of sensors, which may include force-sensitive resistor (FSR) sensors206. In yet other embodiments, other sensor(s) may be utilized. Port208may be positioned within a sole structure209of a shoe. Port208may optionally be provided to be in communication with an electronic module210(which maybe in a housing211) and a plurality of leads212connecting the FSR sensors206to the port208. Module210may be contained within a well or cavity in a sole structure of a shoe. The port208and the module210include complementary interfaces214,216for connection and communication.

In certain embodiments, at least one force-sensitive resistor206shown inFIG. 2Amay contain first and second electrodes or electrical contacts218,220and a force-sensitive resistive material222and/or224disposed between the electrodes218,220to electrically connect the electrodes218,220together. When pressure is applied to the force-sensitive material222/224, the resistivity and/or conductivity of the force-sensitive material222/224changes, which changes the electrical potential between the electrodes218,220. The change in resistance can be detected by the sensor system202to detect the force applied on the sensor216. The force-sensitive resistive material222/224may change its resistance under pressure in a variety of ways. For example, the force-sensitive material222/224may have an internal resistance that decreases when the material is compressed, similar to the quantum tunneling composites described in greater detail below. Further compression of this material may further decrease the resistance, allowing quantitative measurements, as well as binary (on/off) measurements. In some circumstances, this type of force-sensitive resistive behavior may be described as “volume-based resistance,” and materials exhibiting this behavior may be referred to as “smart materials.” As another example, the material222/224may change the resistance by changing the degree of surface-to-surface contact. This can be achieved in several ways, such as by using microprojections on the surface that raise the surface resistance in an uncompressed condition, where the surface resistance decreases when the microprojections are compressed, or by using a flexible electrode that can be deformed to create increased surface-to-surface contact with another electrode. This surface resistance may be the resistance between the material222and the electrode218,220and/or the surface resistance between a conducting layer (e.g. carbon/graphite) and a force-sensitive layer (e.g. a semiconductor) of a multi-layer material222/224. The greater the compression, the greater the surface-to-surface contact, resulting in lower resistance and enabling quantitative measurement. In some circumstances, this type of force-sensitive resistive behavior may be described as “contact-based resistance.” It is understood that the force-sensitive resistive material222/224, as defined herein, may be or include a doped or non-doped semiconducting material.

The electrodes218,220of the FSR sensor206can be formed of any conductive material, including metals, carbon/graphite fibers or composites, other conductive composites, conductive polymers or polymers containing a conductive material, conductive ceramics, doped semiconductors, or any other conductive material. The leads212can be connected to the electrodes218,220by any suitable method, including welding, soldering, brazing, adhesively joining, fasteners, or any other integral or non-integral joining method. Alternately, the electrode218,220and associated lead(s)212may be formed of a single piece of the same material222/224. In further embodiments, material222is configured to have at least one electric property (e.g., conductivity, resistance, etc.) than material224. Examples of exemplary sensors are disclosed in U.S. patent application Ser. No. 12/483,824, filed on Jun. 12, 2009, the contents of which are incorporated herein in their entirety for any and all non-limiting purposes.

As shown inFIG. 2B, device226(which may be, or be a duplicative of or resemble sensory device142shown inFIG. 1A) may be configured to be worn by user124, such as around a wrist, arm, ankle or the like. Device226may monitor movements of a user, including, e.g., athletic movements or other activity of user124. For example, in one embodiment, device226may be activity monitor that measures, monitors, tracks or otherwise senses the user's activity (or inactivity) regardless of the user's proximity or interactions with computer102. Device226may detect athletic movement or other activity (or inactivity) during user's124interactions with computer102and/or operate independently of computer102. Device226may communicate directly or indirectly, wired or wirelessly, with network132and/or other devices, such as devices138and/or140. Athletic data obtained from device226may be utilized in determinations conducted by computer102, such as determinations relating to which exercise programs are presented to user124. As used herein, athletic data means data regarding or relating to a user's activity (or inactivity). In one embodiment, device226may wirelessly interact with a remote website such as a site dedicated to fitness or health related subject matter, either directly or indirectly (e.g., via a mobile device, such as device138associated with user124). In this or another embodiment, device226may interact with a mobile device, such as device138, as to an application dedicated to fitness or health related subject matter. In these or other embodiments, device226may interest with both a mobile device as to an application as above, such as device138, and a remote website, such as a site dedicated to fitness or health related subject matter, either directly or indirectly (e.g., via the mobile device, such as device138). In some embodiments, at some predetermined time(s), the user may wish to transfer data from the device226to another location. For example, a user may wish to upload data from a portable device with a relatively smaller memory to a larger device with a larger quantity of memory. Communication between device226and other devices may be done wirelessly and/or through wired mechanisms.

As shown inFIG. 2B, device226may include an input mechanism, such as a button228, to assist in operation of the device226. The button228may be a depressible input operably connected to a controller230and/or any other electronic components, such as one or more elements of the type(s) discussed in relation to computer102shown inFIG. 1B. Controller230may be embedded or otherwise part of housing232. Housing232may be formed of one or more materials, including elastomeric components and comprise one or more displays, such as display234. The display may be considered an illuminable portion of the device226. The display234may include a series of individual lighting elements or light members such as LED lights234in an exemplary embodiment. The LED lights may be formed in an array and operably connected to the controller230. Device226may include an indicator system236, which may also be considered a portion or component of the overall display234. It is understood that the indicator system236can operate and illuminate in conjunction with the display234(which may have pixel member235) or completely separate from the display234. The indicator system236may also include a plurality of additional lighting elements or light members238, which may also take the form of LED lights in an exemplary embodiment. In certain embodiments, indicator system236may provide a visual indication of goals, such as by illuminating a portion of lighting members238to represent accomplishment towards one or more goals.

A fastening mechanism240can be unlatched wherein the device226can be positioned around a wrist of the user124and the fastening mechanism240can be subsequently placed in a latched position. The user can wear the device226at all times if desired. In one embodiment, fastening mechanism240may comprise an interface, including but not limited to a USB port, for operative interaction with computer102and/or devices138,140, and/or recharging an internal power source.

In certain embodiments, device226may comprise a sensor assembly (not shown inFIG. 2B). The sensor assembly may comprise a plurality of different sensors. In an example embodiment, the sensor assembly may comprise or permit operative connection to an accelerometer (including in the form of a multi-axis accelerometer), a gyroscope, a location-determining device (e.g., GPS), light sensor, temperature sensor (including ambient temperature and/or body temperature), heart rate monitor, image-capturing sensor, moisture sensor and/or combinations thereof. Detected movements or parameters from device's142sensor(s), may include (or be used to form) a variety of different parameters, metrics or physiological characteristics including but not limited to speed, distance, steps taken, and energy expenditure such as calories, heart rate and sweat detection. Such parameters may also be expressed in terms of activity points or currency earned by the user based on the activity of the user. Examples of wrist-worn sensors that may be utilized in accordance with various embodiments are disclosed in U.S. Pat. App. Ser. No. 13/287.064, filed on Nov. 1, 2011, the contents of which are incorporated herein in their entirety for any and all non-limiting purposes.

As shown inFIG. 2C, device290(which may be, or be a duplicative of or resemble device182shown inFIG. 1A) may be configured to be in optical alignment with at least one of the user's eyes, such as being placed on the head of user124, in the form of glasses, sunglasses or protective eyewear. Device290may monitor movements of a user, including, e.g., athletic movements or other activity of user124. In another embodiment, device290may provide visual, tactile, and/or audio information to user124during a workout or training session. For example, in one embodiment, device290may be an activity monitor that measures, monitors, and tracks or otherwise senses the user's activity (or inactivity) regardless of the user's proximity or interactions with computer102. Device290may detect athletic movement or other activity (or inactivity) during user's124interactions with computer102and/or operate independently of computer102. Device290may communicate directly or indirectly, wired or wirelessly, with network132and/or other devices, such as devices138and/or140. Athletic data obtained from device290may be utilized in determinations conducted by computer102, such as determinations relating to which exercise programs are presented to user124. As used herein, athletic data means data regarding or relating to a user's activity (or inactivity). In one embodiment, device290may wirelessly interact with a remote website such as a site dedicated to fitness or health related subject matter, either directly or indirectly (e.g., via a mobile device, such as device138associated with user124). In this or another embodiment, device290may interact with a mobile device, such as device138, as to an application dedicated to fitness or health related subject matter. In these or other embodiments, device290may interest with both a mobile device as to an application as above, such as device138, and a remote website, such as a site dedicated to fitness or health related subject matter, either directly or indirectly (e.g., via the mobile device, such as device138). In some embodiments, at some predetermined time(s), the user may wish to transfer data from the device290to another location. For example, a user may wish to upload data from a portable device with a relatively smaller memory to a larger device with a larger quantity of memory. Communication between device290and other devices may be done wirelessly and/or through wired mechanisms.

In an embodiment, device290may display on lenses292and293information useful to user124during a workout or training session. Such information may include a top route such as top route294or other geographical information related to a run or cycling session. Such routing information may also display a user's progress on the top route as the user proceeds along the route. During the workout, device290may include alternative routes which may alter (e.g., increase or decrease) the intensity of the overall workout session. Such alternative routes may include grade or elevation changes to make the workout more difficult and assist user124in obtaining their workout goals for the workout session. In addition, device124may suggest alternative routes which user124has not taken before to motivate user124during the running session with new scenery to be viewed during the workout. Such alternative route determinations by device290may be based on a user's workout preferences, fitness needs, and implicit security requirements. In an embodiment, user124may be delighted to have route recommendations provided that indicate which of their friends or favorite athletes have run the route, sightseeing opportunities for the new route, as well as areas of interests for user124. User124may also be provided with information through device290that suites their fitness needs such as improved endurance or builds strength and speed. For instance, information such as information298may be shown on lens293during a workout. Such information may include heart rate monitoring, distance, pace, and energy expenditure points or score, along with other workout statistics. In addition, information related to other devices associated with user124may also optionally be displayed such as song information299as shown in lens293.

In an embodiment, device290may also provide and utilize real-time information based on construction, traffic reports, and safety events in areas (e.g. Police Actions) and provide detours or route alternatives when needed. In an embodiment, device290may also detect and alert user124to potential dangers such as a predicted impact with an oncoming car or pedestrian. In another embodiment, device290may at various points during a run such as at intersections display to user124alternative routes along with the benefits of taking the alternative route (i.e. longer/shorter distance, more energy expenditure points, elevation changes, scenic route etc.).

As shown inFIG. 2C, device290may include lenses292and293and speakers297. A controller288and associated memory289may be embedded or otherwise part of glasses290. In an embodiment, information on lenses292and293may be projected onto the lenses by a micro-projector. The micro-projector may display information or shapes into a user's field of vision. In another embodiment, lenses292and293may include a series of individual lighting elements or light members such as LED lights. The LED lights may be formed in an array and operably connected to the controller288. Device290may include an indicator system295, which may also be considered a portion or component of the overall display. It is understood that indicator system295can operate and illuminate in conjunction with the display shown on lenses292and293. The indicator system295may also include a plurality of additional lighting elements or light members, which may also take the form of LED lights in an exemplary embodiment. In certain embodiments, indicator system295may provide a visual indication of goals, such as by illuminating to represent accomplishment towards one or more goals. In an embodiment, the indicator system295may inform user124of their progress in achieving a goal by overlaying visual channel information with energy expenditure symbols that change color from red to green as user124gets closer to reaching their workout goal. In an embodiment, the size of the displayed symbol may be used to communicate information to user124such as an elevation increases during a run. In addition, milestones may be communicated, such as distance markers. In another embodiment, indicator system295may also be used to designate and ideal running route for user124during a workout.

In certain embodiments, device290may comprise a sensor assembly (not shown inFIG. 2C). The sensor assembly may comprise a plurality of different sensors. In an example embodiment, the sensor assembly may comprise or permit operative connection to an accelerometer (including in the form of a multi-axis accelerometer), a gyroscope, a location-determining device (e.g., GPS), light sensor, temperature sensor (including ambient temperature and/or body temperature), heart rate monitor, image-capturing sensor, moisture sensor and/or combinations thereof. Detected movements or parameters from device's sensor(s), may include (or be used to form) a variety of different parameters, metrics or physiological characteristics including but not limited to speed, distance, steps taken, and energy expenditure such as calories, heart rate and sweat detection. Such parameters may also be expressed in terms of activity points or currency earned by the user based on the activity of the user.

In an embodiment, system100may prompt a user to perform one or more exercises, monitor user movement while performing the exercises, and provide the user with feedback based on their performance. In one embodiment, computer102, image-capturing device126, sensor128, and display136may be implemented within the confines of a user's residence, although other locations, including schools, gyms and/or businesses are contemplated. Further, as discussed above, computer102may be a portable device, such as a cellular telephone, therefore, one or more aspects discussed herein may be conducted in almost any location.

While exercising, system100may use one or more techniques to monitor user movement. The method may be implemented by a computer, such as, for example, computer102, device138,140,142,144,182, and/or other apparatuses.

In an embodiment, system100may process sensory data to identify user movement data. In one embodiment, sensory locations may be identified. For example, images of recorded video, such as from image-capturing device126, may be utilized in an identification of user movement. For example, the user may stand a certain distance, which may or may not be predefined, from the image-capturing device126, and computer102may process the images to identify the user124within the video, for example, using disparity mapping techniques. In an example, the image capturing device126may be a stereo camera having two or more lenses that are spatially offset from one another and that simultaneously capture two or more images of the user. Computer102may process the two or more images taken at a same time instant to generate a disparity map for determining a location of certain parts of the user's body in each image (or at least some of the images) in the video using a coordinate system (e.g., Cartesian coordinates). The disparity map may indicate a difference between images taken by each of the offset lenses.

In a second example, one or more sensors may be located on or proximate to the user's124body at various locations or wear a suit having sensors situated at various locations. Yet, in other embodiments, sensor locations may be determined from other sensory devices, such as devices138,140,142,144and/or182. With reference toFIG. 4, sensors may be placed (or associated with, such as with image-capturing device126) body movement regions, such as joints (e.g., ankles, elbows, shoulders, etc.) or at other locations of interest on the user's124body. Example sensory locations are denoted inFIG. 4by locations402a-402o. In this regard, sensors may be physical sensors located on/in a user's clothing, yet in other embodiments, sensor locations402a-402omay be based upon identification of relationships between two moving body parts. For example, sensor location402amay be determined by identifying motions of user124with an image-capturing device, such as image-capturing device126. Thus, in certain embodiments, a sensor may not physically be located at a specific location (such as sensor locations402a-402o), but is configured to sense properties of that location, such as with image-capturing device126. In this regard, the overall shape or portion of a user's body may permit identification of certain body parts. Regardless of whether an image-capturing device, such as camera126, is utilized and/or a physical sensor located on the user124, such as sensors within or separate from one or more of device(s)138,140,142,144are utilized, the sensors may sense a current location of a body part and/or track movement of the body part. In one embodiment, location402mmay be utilized in a determination of the user's center of gravity (a.k.a, center of mass).

For example, relationships between location402aand location(s)402f/402lwith respect to one or more of location(s)402m-402omay be utilized to determine if a user's center of gravity has been elevated along the vertical axis (such as during a jump) or if a user is attempting to “fake” a jump by bending and flexing their knees. In one embodiment, sensor location402nmay be located at about the sternum of user124. Likewise, sensor location402omay be located approximate to the naval of user124. In certain embodiments, data from sensor locations402m-402omay be utilized (alone or in combination with other data) to determine the center of gravity for user124. In further embodiments, relationships between multiple several sensor locations, such as sensors402m-402o, may be utilized in determining orientation of the user124and/or rotational forces, such as twisting of user's124torso. Further, one or more locations, such as location(s), may be utilized to as a center of moment location. For example, in one embodiment, one or more of location(s)402m-402omay serve as a point for a center of moment location of user124. In another embodiment, one or more locations may serve as a center of moment of specific body parts or regions.

In certain embodiments, a time stamp to the data collected indicating a specific time when a body part was at a certain location. Sensor data may be received at computer102(or other device) via wireless or wired transmission. A computer, such as computer102and/or devices138,140,142,144,182may process the time stamps to determine the locations of the body parts using a coordinate system (e.g., Cartesian coordinates) within each (or at least some) of the images in the video. Data received from image-capturing device126may be corrected, modified, and/or combined with data received from one or more other devices138,140,142,144and182.

In a third example, computer102may use infrared pattern recognition to detect user movement and locations of body parts of the user124. For example, the sensor128may include an infrared transceiver, which may be part of image-capturing device126, or another device, that may emit an infrared signal to illuminate the user's124body using infrared signals. The infrared transceiver128may capture a reflection of the infrared signal from the body of user124. Based on the reflection, computer102may identify a location of certain parts of the user's body using a coordinate system (e.g., Cartesian coordinates) at particular instances in time. Which and how body parts are identified may be predetermined based on a type of exercise a user is requested to perform.

As part of a workout routine, computer102may make an initial postural assessment of the user124as part of the initial user assessment. Computer102may analyze front and side images of a user124to determine a location of one or more of a user's shoulders, upper back, lower back, hips, knees, and ankles. On-body sensors and/or infrared techniques may also be used, either alone or in conjunction with image-capturing device126, to determine the locations of various body parts for the postural assessment.

While performing an exercise, computer102may cause a display, such as display136or device182, to present a user representation with real-time feedback. While user124is performing movements, computer102may create a user representation for display by the display136or device182. The computer may create the user representation based on one or more of processing some or all images of video captured by image capturing device126, processing data received from the sensor128, and processing data received from sensors138,140,142,144, and182. The user representation may be, for example, video of the user, or a user avatar302(FIG. 3) created based on image and/or sensor data, including infrared data.

In an embodiment, a user's past workout performance may be stored as a virtual shadow for later playback. In an embodiment, numerous virtual shadows may be stored for a user, each virtual shadow representing a prior exercise performance. In an embodiment, displaying of multiple virtual shadows may allow a user, such as user124, to see changes in their workout performances.

In an embodiment, user avatar302may be generated and displayed with the appearance that a user, such as user124, is competing against themselves. For example, computer102(or any other electronic device such as device182) may generate and store performance information related to a user's completed workout (i.e. virtual shadow). Later, computer102may prompt the user if they would like to compete in real-time against their earlier performance of the exercise. In that case, system100may display user avatar302and stored virtual shadow304for the competition. User avatar302along with virtual shadow304may be displayed as part of a display508in glasses290as shown inFIG. 5.

In an embodiment, the generated user avatar302and virtual shadow304may permit a user to view workout improvements over time, including, as examples, the latest improvement or improvement over a (e.g., user-selected) time period or improvement from a beginning.

In another embodiment, a user may compare a past running performance on a particular running route that has numerous elevation changes to a current and different route with minimal elevation changes. The results may assist the user in gauging the user's pace and other metrics in different run settings. In an embodiment, during a run the system may recommend route changes or modifications based on a target goal such as energy expenditure or a rate of energy expenditure.

When competing against him or herself, computer102may display user avatar302as the user performs an exercise for simultaneous display along with the virtual shadow304(i.e. representing prior workout performance information). User avatar302may be displayed overtop of or directly behind the virtual shadow304, as seen inFIG. 3. Alternatively, the display136or device182may present virtual shadow304offset from user avatar302. Computer102may synchronize the start times such that user avatar302appears to be competing against virtual shadow304in real-time. When an exercise is complete, computer102may inform the user124of the winner, and provide side by side statistics of the current performance relative to the virtual shadow304

Display136or device182may also present one or more performance level indicators306to indicate a user's performance metrics, as depicted inFIG. 3. Performance level indicators may be displayed instead of a shadow. Yet, in other embodiments, indicators may be displayed in conjunction with a shadow. Example metrics may include speed, quickness, power, dimensions (e.g., distance stepped or dipped, height jumped, rotation of hips or shoulders), reaction time, agility, flexibility, acceleration, heart rate, temperature (e.g., overheating), blood oxygen content, or other physical or physiological metrics. A performance level indicator306may be depicted as, for example, a gauge, a speedometer, a bar-type indictor, percentage indicator, etc. In another embodiment, performance level indicators may also be displayed to a user in a separate portion of the display505as shown inFIG. 5on lens293.

In another embodiment, a virtual shadow304may be displayed with the appearance that a user, such as user124, is competing against another user. In one embodiment, user124may be located at a first physical location and a second user may be located at a second physical location. A location may include a place or a geographical position such as a gym, dwelling, school, or even exercising outside, such as running through a city. Despite being at different physical locations, users may still compete and/or collectively engage in athletic activities. In one embodiment, each of a plurality of users may engage in a competition in substantially real-time. Yet, in other embodiments, a first user may conduct a predefined series of activities or routines and data from that first user's performance may be utilized in a later conducted competition. In one embodiment, two or more users may engage in a “side-by-side” competition. For example, computer102(or any other electronic device) may display a user avatar302while a first user124performs an exercise. The same computer102and/or another computer, such as an electronic device that is in operative communication with network132, may generate and/or store a second avatar representing the second user. Both of these avatars may be displayed on a single display device, such as display136or device182at the location of user124(and/or at the location of the second user). Thus, user124may see both avatars.

In an embodiment, virtual shadows may be generated based upon past performances in one or more activities, such as the activity being performed in competition or upon an assessment of a person's respective capabilities (e.g., current fitness level).

In other embodiments, users may compete with another user's virtual shadow. For example, a first user, such as user124may have had a great workout and want to challenge a second user to see how they perform or stack up against the first user's past workout. A virtual shadow representing the first user's past workout may be transmitted to permit the second user to compete against the first user's performance. In one embodiment, a user avatar302of the second user may be displayed on display136. A virtual shadow304may be generated based upon the workout of the first user124. System100may synchronize the start times such that the user avatar302appears to be competing against the virtual shadow304. When an exercise is complete, computer102may inform either user of the winner. System100may also provide side by side statistics of the second user's current performance relative to the virtual shadow304of the first user124. Competing with other users' virtual shadow(s)304may be performed in a real-time environment as well as permitting virtual shadows304from previous athletic activities to be utilized.

In an embodiment, map data or topographical map data may be used as background to show the avatar's location on the route during a workout. During the work out, indicators showing the instantaneous values of various measured time, distance, physical, and/or physiological parameters associated with the athletic performance at locations along the route traveled by the virtual athlete may be displayed.

In an embodiment, a second indicator display region also may be provided to display instantaneous values of various measured time, distance, physical, and/or physiological parameters associated with the virtual athlete athletic performance at locations along the route. Of course, the data for the two athletic performances may be obtained from any source(s) without departing from the invention.

In an embodiment, system100may monitor a first user workout as illustrated in step602ofFIG. 6. In an example, computer102may prompt a user to perform one or more exercises during a workout session. A workout session may include a predetermined number of exercises or involve a single athletic activity (e.g., run 10 miles).

In an embodiment, a first user avatar may be generated for user124. As explained throughout this disclosure, multiple sensors may be utilized, either in combination or alone, to monitor data. In one embodiment, computer102may generate a user avatar of the user based on data captured by one or more of sensors128,138,140,142,144,182, and/or camera126

In step604, a first virtual shadow for a first user may be generated based on the workout performance monitored in step602. As part of a new workout session, user124may compete against their previous performance or another user. For example, computer102may display a first user avatar and a first virtual shadow, where the first user avatar corresponds to the user's current real-time performance, and the first virtual shadow corresponds to a previous performance of the workout session. In step606, a device such as device182may simultaneously display to user124a first user avatar and the first virtual shadow during a current real-time workout session.

In another example, a second user may complete a particular workout session where their computer monitors the second user's performance, and cause their computer to send a challenge to computer102challenging the first user to beat their performance. The challenge may include data of the second user performing the particular workout session.

In a further example, both users may perform a workout session at the same time, where respective computers102may monitor each user's performance, and exchange data with the other user's computer via network132so that each computer can cause display of the other's user avatar in a virtual competition.

In step608, the system100may analyze the first user avatar performance compared to the first virtual shadow. In step610, results may be generated and displayed.

Providing an activity environment having one or more of the features described herein may provide a user with an immersive experience that will encourage and motivate the user to engage in athletic activities and improve his or her fitness. Users may further communicate through social communities and challenge one another to reach various levels of fitness, and to view their fitness level and activity.

FIGS. 7-10illustrate another exemplary operating environment which may be used with various aspects of the disclosure. It is to be understood that other embodiments may be utilized and structural and functional modifications may be made without departing from the scope and spirit of the present disclosure. Further, headings within this disclosure should not be considered as limiting aspects of the disclosure and the example embodiments are not limited to the example headings.

I. Example Personal Training System

Aspects of this disclosure relate to systems and methods that may be utilized across a plurality of networks. In this regard, certain embodiments may be configured to adapt to dynamic network environments. Further embodiments may be operable in differing discrete network environments.FIG. 7illustrates an example of a personal training system1100in accordance with example embodiments. Example system1100may include one or more interconnected networks, such as the illustrative body area network (BAN)1102, local area network (LAN)1104, and wide area network (WAN)1106. As shown inFIG. 7(and described throughout this disclosure), one or more networks (e.g., BAN1102, LAN1104, and/or WAN1106), may overlap or otherwise be inclusive of each other. Those skilled in the art will appreciate that the illustrative networks1102-1106are logical networks that may each comprise one or more different communication protocols and/or network architectures and yet may be configured to have gateways to each other or other networks. For example, each of BAN1102, LAN1104and/or WAN1106may be operatively connected to the same physical network architecture, such as cellular network architecture1108and/or WAN architecture1110. For example, portable electronic device1112, which may be considered a component of both BAN1102and LAN1104, may comprise a network adapter or network interface card (NIC) configured to translate data and control signals into and from network messages according to one or more communication protocols, such as the Transmission Control Protocol (TCP), the Internet Protocol (IP), and the User Datagram Protocol (UDP) through one or more of architectures1108and/or1110. These protocols are well known in the art, and thus will not be discussed here in more detail.

Network architectures1108and1110may include one or more information distribution network(s), of any type(s) or topology(s), alone or in combination(s), such as for example, cable, fiber, satellite, telephone, cellular, wireless, etc. and as such, may be variously configured such as having one or more wired or wireless communication channels (including but not limited to: WiFi®, Bluetooth®, Near-Field Communication (NFC) and/or ANT technologies). Thus, any device within a network ofFIG. 7, (such as portable electronic device1112or any other device described herein) may be considered inclusive to one or more of the different logical networks1102-1106. With the foregoing in mind, example components of an illustrative BAN and LAN (which may be coupled to WAN1106) will be described.

1. Example Local Area Network

LAN1104may include one or more electronic devices, such as for example, computer device1114. Computer device1114, or any other component of system1100, may comprise a mobile terminal, such as a telephone, music player, tablet, netbook or any portable device. In other embodiments, computer device1114may comprise a media player or recorder, desktop computer, server(s), a gaming console, such as for example, a Microsoft® XBOX, Sony® Playstation, and/or a Nintendo® Wii gaming consoles. Those skilled in the art will appreciate that these are merely example devices for descriptive purposes and this disclosure is not limited to any console or computing device.

Those skilled in the art will appreciate that the design and structure of computer device1114may vary depending on several factors, such as its intended purpose. One example implementation of computer device1114is provided inFIG. 8, which illustrates a block diagram of computing device1200. Those skilled in the art will appreciate that the disclosure ofFIG. 8may be applicable to any device disclosed herein. Device1200may include one or more processors, such as processor1202-1and1202-2(generally referred to herein as “processors1202” or “processor1202”). Processors1202may communicate with each other or other components via an interconnection network or bus1204. Processor1202may include one or more processing cores, such as cores1206-1and1206-2(referred to herein as “cores1206” or more generally as “core1206”), which may be implemented on a single integrated circuit (IC) chip.

Cores1206may comprise a shared cache1208and/or a private cache (e.g., caches1210-1and1210-2, respectively). One or more caches1208/1210may locally cache data stored in a system memory, such as memory1212, for faster access by components of the processor1202. Memory1212may be in communication with the processors1202via a chipset1216. Cache1208may be part of system memory1212in certain embodiments. Memory1212may include, but is not limited to, random access memory (RAM), read only memory (ROM), and include one or more of solid-state memory, optical or magnetic storage, and/or any other medium that can be used to store electronic information. Yet other embodiments may omit system memory1212.

System1200may include one or more I/O devices (e.g., I/O devices1214-1through12143, each generally referred to as I/O device1214). I/O data from one or more I/O devices1214may be stored at one or more caches1208,1210and/or system memory1212. Each of I/O devices1214may be permanently or temporarily configured to be in operative communication with a component of system1100using any physical or wireless communication protocol.

Returning toFIG. 7, four example I/O devices (shown as elements1116-1122) are shown as being in communication with computer device1114. Those skilled in the art will appreciate that one or more of devices1116-1122may be stand-alone devices or may be associated with another device besides computer device1114. For example, one or more I/O devices may be associated with or interact with a component of BAN1102and/or WAN1106. I/O devices1116-1122may include, but are not limited to athletic data acquisition units, such as for example, sensors. One or more I/O devices may be configured to sense, detect, and/or measure an athletic parameter from a user, such as user1124. Examples include, but are not limited to: an accelerometer, a gyroscope, a location-determining device (e.g., GPS), light (including non-visible light) sensor, temperature sensor (including ambient temperature and/or body temperature), sleep pattern sensors, heart rate monitor, image-capturing sensor, moisture sensor, force sensor, compass, angular rate sensor, and/or combinations thereof among others.

In further embodiments, I/O devices1116-1122may be used to provide an output (e.g., audible, visual, or tactile cue) and/or receive an input, such as a user input from athlete1124. Example uses for these illustrative I/O devices are provided below, however, those skilled in the art will appreciate that such discussions are merely descriptive of some of the many options within the scope of this disclosure. Further, reference to any data acquisition unit, I/O device, or sensor is to be interpreted disclosing an embodiment that may have one or more I/O device, data acquisition unit, and/or sensor disclosed herein or known in the art (either individually or in combination).

Information from one or more devices (across one or more networks) may be used to provide (or be utilized in the formation of) a variety of different parameters, metrics or physiological characteristics including but not limited to: motion parameters, such as speed, acceleration, distance, steps taken, direction, relative movement of certain body portions or objects to others, or other motion parameters which may be expressed as angular rates, rectilinear rates or combinations thereof, physiological parameters, such as calories, heart rate, sweat detection, effort, oxygen consumed, oxygen kinetics, and other metrics which may fall within one or more categories, such as: pressure, impact forces, information regarding the athlete, such as height, weight, age, demographic information and combinations thereof.

System1100may be configured to transmit and/or receive athletic data, including the parameters, metrics, or physiological characteristics collected within system1100or otherwise provided to system1100. As one example, WAN1106may comprise server1111. Server1111may have one or more components of system1200ofFIG. 8. In one embodiment, server1111comprises at least a processor and a memory, such as processor1206and memory1212. Server1111may be configured to store computer-executable instructions on a non-transitory computer-readable medium. The instructions may comprise athletic data, such as raw or processed data collected within system1100. System1100may be configured to transmit data, such as energy expenditure points, to a social networking website or host such a site. Server1111may be utilized to permit one or more users to access and/or compare athletic data. As such, server1111may be configured to transmit and/or receive notifications based upon athletic data or other information.

Returning to LAN1104, computer device1114is shown in operative communication with a display device1116, an image-capturing device1118, sensor1120and exercise device1122, which are discussed in turn below with reference to example embodiments. In one embodiment, display device1116may provide audio-visual cues to athlete1124to perform a specific athletic movement. The audio-visual cues may be provided in response to computer-executable instruction executed on computer device1114or any other device, including a device of BAN1102and/or WAN. Display device1116may be a touchscreen device or otherwise configured to receive a user-input.

In one embodiment, data may be obtained from image-capturing device1118and/or other sensors, such as sensor1120, which may be used to detect (and/or measure) athletic parameters, either alone or in combination with other devices, or stored information. Image-capturing device1118and/or sensor1120may comprise a transceiver device. In one embodiment sensor1128may comprise an infrared (IR), electromagnetic (EM) or acoustic transceiver. For example, image-capturing device1118, and/or sensor1120may transmit waveforms into the environment, including towards the direction of athlete1124and receive a “reflection” or otherwise detect alterations of those released waveforms. Those skilled in the art will readily appreciate that signals corresponding to a multitude of different data spectrums may be utilized in accordance with various embodiments. In this regard, devices1118and/or1120may detect waveforms emitted from external sources (e.g., not system100). For example, devices1118and/or1120may detect heat being emitted from user1124and/or the surrounding environment. Thus, image-capturing device1126and/or sensor1128may comprise one or more thermal imaging devices. In one embodiment, image-capturing device1126and/or sensor1128may comprise an IR device configured to perform range phenomenology.

In one embodiment, exercise device1122may be any device configurable to permit or facilitate the athlete1124performing a physical movement, such as for example a treadmill, step machine, etc. There is no requirement that the device be stationary. In this regard, wireless technologies permit portable devices to be utilized, thus a bicycle or other mobile exercising device may be utilized in accordance with certain embodiments. Those skilled in the art will appreciate that equipment1122may be or comprise an interface for receiving an electronic device containing athletic data performed remotely from computer device1114. For example, a user may use a sporting device (described below in relation to BAN1102) and upon returning home or the location of equipment1122, download athletic data into element1122or any other device of system1100. Any I/O device disclosed herein may be configured to receive activity data.

2. Body Area Network

BAN1102may include two or more devices configured to receive, transmit, or otherwise facilitate the collection of athletic data (including passive devices). Exemplary devices may include one or more data acquisition units, sensors, or devices known in the art or disclosed herein, including but not limited to I/O devices1116-1122. Two or more components of BAN1102may communicate directly, yet in other embodiments, communication may be conducted via a third device, which may be part of BAN1102, LAN1104, and/or WAN1106. One or more components of LAN1104or WAN1106may form part of BAN1102. In certain implementations, whether a device, such as portable device1112, is part of BAN1102, LAN1104, and/or WAN1106, may depend on the athlete's proximity to an access point to permit communication with mobile cellular network architecture108and/or WAN architecture1110. User activity and/or preference may also influence whether one or more components are utilized as part of BAN1102. Example embodiments are provided below.

User1124may be associated with (e.g., possess, carry, wear, and/or interact with) any number of devices, such as portable device1112, shoe-mounted device1126, wrist-worn device1128and/or a sensing location, such as sensing location1130, which may comprise a physical device or a location that is used to collect information. One or more devices1112,1126,1128, and/or1130may not be specially designed for fitness or athletic purposes. Indeed, aspects of this disclosure relate to utilizing data from a plurality of devices, some of which are not fitness devices, to collect, detect, and/or measure athletic data. In certain embodiments, one or more devices of BAN1102(or any other network) may comprise a fitness or sporting device that is specifically designed for a particular sporting use. As used herein, the term “sporting device” includes any physical object that may be used or implicated during a specific sport or fitness activity. Exemplary sporting devices may include, but are not limited to: golf balls, basketballs, baseballs, soccer balls, footballs, powerballs, hockey pucks, weights, bats, clubs, sticks, paddles, mats, and combinations thereof. In further embodiments, exemplary fitness devices may include objects within a sporting environment where a specific sport occurs, including the environment itself, such as a goal net, hoop, backboard, portions of a field, such as a midline, outer boundary marker, base, and combinations thereof.

In this regard, those skilled in the art will appreciate that one or more sporting devices may also be part of (or form) a structure and vice-versa, a structure may comprise one or more sporting devices or be configured to interact with a sporting device. For example, a first structure may comprise a basketball hoop and a backboard, which may be removable and replaced with a goal post. In this regard, one or more sporting devices may comprise one or more sensors, such as one or more of the sensors discussed above in relation toFIGS. 7-9, that may provide information utilized, either independently or in conjunction with other sensors, such as one or more sensors associated with one or more structures. For example, a backboard may comprise a first sensor configured to measure a force and a direction of the force by a basketball upon the backboard and the hoop may comprise a second sensor to detect a force. Similarly, a golf club may comprise a first sensor configured to detect grip attributes on the shaft and a second sensor configured to measure impact with a golf ball.

Looking to the illustrative portable device1112, it may be a multi-purpose electronic device, that for example, includes a telephone or digital music player, including an IPOD®, IPAD®, or iPhone®, brand devices available from Apple, Inc. of Cupertino, Calif. or Zune® or Microsoft® Windows devices available from Microsoft of Redmond, Wash. As known in the art, digital media players can serve as an output device, input device, and/or storage device for a computer. Device1112may be configured as an input device for receiving raw or processed data collected from one or more devices in BAN1102, LAN1104, or WAN1106. In one or more embodiments, portable device1112may comprise one or more components of computer device1114. For example, portable device1112may be include a display1116, image-capturing device1118, and/or one or more data acquisition devices, such as any of the I/O devices11161122discussed above, with or without additional components, so as to comprise a mobile terminal.

In certain embodiments, I/O devices may be formed within or otherwise associated with user's1124clothing or accessories, including a watch, armband, wristband, necklace, shirt, shoe, or the like. These devices may be configured to monitor athletic movements of a user. It is to be understood that they may detect athletic movement during user's1124interactions with computer device1114and/or operate independently of computer device1114(or any other device disclosed herein). For example, one or more devices in BAN1102may be configured to function as an all-day activity monitor that measures activity regardless of the user's proximity or interactions with computer device1114. It is to be further understood that the sensory system1302shown inFIG. 9and the device assembly1400shown inFIG. 10, each of which are described in the following paragraphs, are merely illustrative examples.

In certain embodiments, device126shown inFIG. 7, may comprise footwear which may include one or more sensors, including but not limited to those disclosed herein and/or known in the art.FIG. 9illustrates one example embodiment of a sensor system1302providing one or more sensor assemblies1304. Assembly1304may comprise one or more sensors, such as for example, an accelerometer, gyroscope, location-determining components, force sensors and/or or any other sensor disclosed herein or known in the art. In the illustrated embodiment, assembly1304incorporates a plurality of sensors, which may include force-sensitive resistor (FSR) sensors1306; however, other sensor(s) may be utilized. Port1308may be positioned within a sole structure1309of a shoe, and is generally configured for communication with one or more electronic devices. Port1308may optionally be provided to be in communication with an electronic module1310, and the sole structure1309may optionally include a housing1311or other structure to receive the module1310. The sensor system1302may also include a plurality of leads1312connecting the FSR sensors1306to the port1308, to enable communication with the module1310and/or another electronic device through the port1308. Module1310may be contained within a well or cavity in a sole structure of a shoe, and the housing1311may be positioned within the well or cavity. In one embodiment, at least one gyroscope and at least one accelerometer are provided within a single housing, such as module1310and/or housing1311. In at least a further embodiment, one or more sensors are provided that, when operational, are configured to provide directional information and angular rate data. The port1308and the module310include complementary interfaces1314,1316for connection and communication.

In certain embodiments, at least one force-sensitive resistor306shown inFIG. 9may contain first and second electrodes or electrical contacts1318,1320and a force-sensitive resistive material1322disposed between the electrodes1318,1320to electrically connect the electrodes1318,1320together. When pressure is applied to the force-sensitive material1322, the resistivity and/or conductivity of the force-sensitive material1322changes, which changes the electrical potential between the electrodes1318,1320. The change in resistance can be detected by the sensor system1302to detect the force applied on the sensor1316. The force-sensitive resistive material1322may change its resistance under pressure in a variety of ways. For example, the force-sensitive material1322may have an internal resistance that decreases when the material is compressed. Further embodiments may utilize “volume-based resistance”, which may be implemented through “smart materials.” As another example, the material1322may change the resistance by changing the degree of surface-to-surface contact, such as between two pieces of the force sensitive material1322or between the force sensitive material1322and one or both electrodes1318,1320. In some circumstances, this type of force-sensitive resistive behavior may be described as “contact-based resistance.”

As shown inFIG. 10, device1400(which may resemble or comprise sensory device1128shown inFIG. 7), may be configured to be worn by user1124, such as around a wrist, arm, ankle, neck or the like. Device1400may include an input mechanism, such as a depressible input button1402configured to be used during operation of the device1400. The input button1402may be operably connected to a controller1404and/or any other electronic components, such as one or more of the elements discussed in relation to computer device1114shown inFIG. 7. Controller1404may be embedded or otherwise part of housing1406. Housing1406may be formed of one or more materials, including elastomeric components and comprise one or more displays, such as display1408. The display may be considered an illuminable portion of the device1400. The display1408may include a series of individual lighting elements or light members such as LED lights1410. The lights may be formed in an array and operably connected to the controller1404. Device1400may include an indicator system1412, which may also be considered a portion or component of the overall display1408. Indicator system1412can operate and illuminate in conjunction with the display1408(which may have pixel member1414) or completely separate from the display1408. The indicator system1412may also include a plurality of additional lighting elements or light members, which may also take the form of LED lights in an exemplary embodiment. In certain embodiments, indicator system may provide a visual indication of goals, such as by illuminating a portion of lighting members of indicator system1412to represent accomplishment towards one or more goals. Device1400may be configured to display data expressed in terms of activity points or currency earned by the user based on the activity of the user, either through display1408and/or indicator system1412.

A fastening mechanism1416can be disengaged wherein the device1400can be positioned around a wrist or portion of the user1124and the fastening mechanism1416can be subsequently placed in an engaged position. In one embodiment, fastening mechanism1416may comprise an interface, including but not limited to a USB port, for operative interaction with computer device1114and/or devices, such as devices1120and/or1112. In certain embodiments, fastening member may comprise one or more magnets. In one embodiment, fastening member may be devoid of moving parts and rely entirely on magnetic forces.

In certain embodiments, device1400may comprise a sensor assembly (not shown inFIG. 10). The sensor assembly may comprise a plurality of different sensors, including those disclosed herein and/or known in the art. In an example embodiment, the sensor assembly may comprise or permit operative connection to any sensor disclosed herein or known in the art. Device1400and or its sensor assembly may be configured to receive data obtained from one or more external sensors.

iii. Apparel and/or Body Location Sensing

Element1130ofFIG. 7shows an example sensory location which may be associated with a physical apparatus, such as a sensor, data acquisition unit, or other device. Yet in other embodiments, it may be a specific location of a body portion or region that is monitored, such as via an image capturing device (e.g., image capturing device1118). In certain embodiments, element1130may comprise a sensor, such that elements1130aand1130bmay be sensors integrated into apparel, such as athletic clothing. Such sensors may be placed at any desired location of the body of user1124. Sensors1130a/bmay communicate (e.g., wirelessly) with one or more devices (including other sensors) of BAN1102, LAN1104, and/or WAN1106. In certain embodiments, passive sensing surfaces may reflect waveforms, such as infrared light, emitted by image-capturing device1118and/or sensor1120. In one embodiment, passive sensors located on user's1124apparel may comprise generally spherical structures made of glass or other transparent or translucent surfaces which may reflect waveforms. Different classes of apparel may be utilized in which a given class of apparel has specific sensors configured to be located proximate to a specific portion of the user's1124body when properly worn. For example, golf apparel may include one or more sensors positioned on the apparel in a first configuration and yet soccer apparel may include one or more sensors positioned on apparel in a second configuration.

FIG. 11shows illustrative locations for sensory input (see, e.g., sensory locations1130a-1130o). In this regard, sensors may be physical sensors located on/in a user's clothing, yet in other embodiments, sensor locations1130a-1130omay be based upon identification of relationships between two moving body parts. For example, sensor location1130amay be determined by identifying motions of user1124with an image-capturing device, such as image-capturing device1118. Thus, in certain embodiments, a sensor may not physically be located at a specific location (such as one or more of sensor locations1130a-1130o), but is configured to sense properties of that location, such as with image-capturing device1118or other sensor data gathered from other locations. In this regard, the overall shape or portion of a user's body may permit identification of certain body parts. Regardless of whether an image-capturing device is utilized and/or a physical sensor located on the user1124, and/or using data from other devices, (such as sensory system1302), device assembly1400and/or any other device or sensor disclosed herein or known in the art is utilized, the sensors may sense a current location of a body part and/or track movement of the body part. In one embodiment, sensory data relating to location1130mmay be utilized in a determination of the user's center of gravity (a.k.a, center of mass). For example, relationships between location1130aand location(s)1130f/1130lwith respect to one or more of location(s)1130m-1130omay be utilized to determine if a user's center of gravity has been elevated along the vertical axis (such as during a jump) or if a user is attempting to “fake” a jump by bending and flexing their knees. In one embodiment, sensor location11306nmay be located at about the sternum of user1124. Likewise, sensor location1130omay be located approximate to the naval of user1124. In certain embodiments, data from sensor locations1130m-1130omay be utilized (alone or in combination with other data) to determine the center of gravity for user1124. In further embodiments, relationships between multiple sensor locations, such as sensors1130m-1130o, may be utilized in determining orientation of the user1124and/or rotational forces, such as twisting of user's1124torso. Further, one or more locations, such as location(s), may be utilized as (or approximate) a center of moment location. For example, in one embodiment, one or more of location(s)1130m-1130omay serve as a point for a center of moment location of user1124. In another embodiment, one or more locations may serve as a center of moment of specific body parts or regions.