Patent Description:
In recent years, there has been a virtual explosion in the popularity of exercise and physical fitness. There are many popular forms of physical exercise including, for example, running, bicycling, and weight training. The growing interest in weight training is reflected by the growing number of gyms found in both public and private settings.

One important aspect of any type of exercise program is the ability to track personal performance and progress. For example, people engaged in endurance or distance forms of exercise (e.g., running, swimming, bicycling, etc.) often track the distance and/or time associated with a particular run, swim, ride, etc. Similarly, people using cardiovascular exercise machines (e.g., treadmills, stair-steppers, stationary bicycles, etc.) are often interested in knowing how long they exercise or how many calories they burn during a particular session. For weightlifting exercises, both weight and repetition are important features to log.

There is a strong digitization trend in the gym industry. Various systems have been suggested for monitoring exercise activity in a gym environment. Several vendors are building machines with inbuilt reps and weight measurement. Such exercise machines are generally expensive, with built-in displays, and require AC power.

One way of accomplishing tracking of an exercise is to adapt a tool used in the exercise, such as a weight machine, with a tracking system. One example of such a system was disclosed in <CIT>. That disclosure describes a monitoring system for monitoring exercise machines comprising a lifting mechanism for selectively engaging one or more of the weights. The exercise machines comprise a plurality of stacked weights, and a monitoring system comprises, for each of the exercise machines, a repetition detector and an exercise machine identifier. The monitoring system further comprises an observer and a user device.

A drawback with this type of systems is that they are not appropriate for tracking an exercise activity that is not carried out using a specific tool or machine. Accordingly, there still exists a need for improvement in the art of systems and methods for monitoring activity in a gym environment.

<CIT> discloses a system which includes a movement processing system for capturing a first three-dimensional movement of a user and capturing at least another three-dimensional movement of the user, wherein the three-dimensional movement is determined using at the at least one image capture device aimed at the body of the user.

<CIT> discloses an exercise tracker, which includes a force sensor programmed to output a force signal representing a force applied to a cable associated with a piece of exercise equipment. The exercise tracker further includes a processing device programmed to receive the force signal and determine, from the force signal, exercise data including an amount of weight lifted.

<CIT> discloses a device for logging exercise data. The device includes a body for engaging with an exercise machine; an electrical system with a power source incorporated into the body and to record data; an image sensor incorporated into the body and to capture an image; a motion sensor incorporated into the body and to detect movement; the image sensor determines a weight load associated with the exercise machine; the motion sensor detects and records a number of repetitions of movement; and the device creates an exercise log associated with a user's workout.

It is an objective to at least partly overcome one or more limitations of the prior art. Specifically, it is an object to provide a solution for tracking exercise data appropriately linked to an electronic device, which may be associated with a person or an account.

One or more of these objectives, as well as further objectives that may appear from the description below, are at least partly achieved by a system and a method according to the independent claims, embodiments thereof being defined by the dependent claims.

According to one aspect, the proposed solution relates to a system for monitoring activity in a gym environment, according to independent claim <NUM>. Further embodiments of the system are provided in dependent claims <NUM>-<NUM>.

According to a second aspect, a method is provided for monitoring activity in a gym environment, according to independent claim <NUM>. Further embodiments of the method are provided in dependent claims <NUM>-<NUM>.

Embodiments will now be described in more detail with reference to the accompanying schematic drawings.

Embodiments will now be described more fully hereinafter with reference to the accompanying drawings, in which some, but not all, embodiments are shown. Indeed, the subject of the present disclosure may be embodied in many different forms and should not be construed as limited to the embodiments set forth herein; rather, these embodiments are provided so that this disclosure may satisfy applicable legal requirements.

Also, it will be understood that, where possible, any of the advantages, features, functions, devices, and/or operational aspects of any of the embodiments described and/or contemplated herein may be included in any of the other embodiments described and/or contemplated herein, and/or vice versa. In addition, where possible, any terms expressed in the singular form herein are meant to also include the plural form and/or vice versa, unless explicitly stated otherwise. As used herein, "at least one" shall mean "one or more" and these phrases are intended to be interchangeable. Accordingly, the terms "a" and/or "an" shall mean "at least one" or "one or more", even though the phrase "one or more" or "at least one" is also used herein. As used herein, the terms "multiple", "plural" and "plurality" are intended to imply provision of two or more items, whereas the term a "set" of items is intended to imply a provision of one or more items. As used herein, except where the context requires otherwise owing to express language or necessary implication, the word "comprise" or variations such as "comprises" or "comprising" is used in an inclusive sense, that is, to specify the presence of the stated features but not to preclude the presence or addition of further features in various embodiments. The term "compute", and derivatives thereof, is used in its conventional meaning and may be seen to involve performing a calculation involving one or more mathematical operations to produce a result, for example by use of a computer.

It will furthermore be understood that, although the terms first, second, etc. may be used herein to describe various elements, these elements should not be limited by these terms. For example, a first element could be termed a second element, and, similarly, a second element could be termed a first element, without departing the scope of the present disclosure.

<FIG> schematically illustrates a context of the proposed solution, and various features and elements forming part of a system <NUM> configured to operate in accordance with the proposed solution.

The proposed solution is based on the concept of employing a monitoring system <NUM> to monitor a gym environment <NUM>, and to identify human representations in the gym environment and track movement of the human representations. The gym environment <NUM> may be a room, a series of rooms, a part of a room, or an outdoor area.

In the drawing, a person <NUM> is present in the gym environment <NUM>. The monitoring system <NUM> is configured to detect presence of objects in the gym environment <NUM>, and to identify an object as a human. As will be described in further detail below, the monitoring system <NUM> may comprise one or more imaging devices, such as video cameras, arranged to capture image data of one or more views of the gym environment <NUM>. By image detection and processing of the captured image data, various key points L of detected objects may be identified. Based on e.g. shape, size, correlated movement of key points, and other recognizable patterns, a detected object may be characterized as a human person. The combined key points of an object detected and characterized as a human person is referred to herein as a human representation O1.

The system comprises a control system <NUM>, identified in the drawing as a single element for the sake of simplicity. It should be noted, though, that the control system <NUM> may completely or partly share resources with the monitoring system <NUM>. Alternatively, or additionally, the control system <NUM> may employed shared logic in a cloud arrangement.

The system further comprises a transceiver unit <NUM> for receiving communication signals <NUM> within the gym environment <NUM>, and optionally for transmitting <NUM> communication signals. The transceiver unit <NUM> may be configured to operate according to a protocol capable of receiving radio signals within the entire gym environment <NUM>. The transceiver unit <NUM> may e.g. be configured to operate as a cellular base station or as a wireless local area hotspot, e.g. a Wi-Fi hotspot under an IEEE <NUM> protocol, or by Bluetooth, or by any other wireless communication technology, either standardized or proprietary. The transceiver unit <NUM> may inter alia receive communication signals <NUM> from electronic device present in the gym environment <NUM>, such as portable or wearable electronic devices. An example of such an electronic device is the portable electronic device <NUM>, associated with and carried by the person <NUM>. The transceiver unit <NUM> is communicatively connected to the control system <NUM>.

The system further comprises a waypoint transmitter <NUM>, arranged at a predetermined location <NUM> in the gym environment <NUM> and configured to transmit a near field wireless signal <NUM>. The waypoint transmitter <NUM> may be configured such that the near field wireless signal <NUM>, configured in accordance with a near field communication protocol, is only detectable at said predetermined location <NUM>. The waypoint transmitter <NUM> may thus be configured for proximity communication, using e.g. RFID (Radio-frequency identification), NFC (Nearfield Communication), BLE (Bluetooth Low Energy) or other. The range of successful reception of a nearfield wireless signal <NUM> transmitted from the waypoint transmitter <NUM> may be less than a certain distance, such as <NUM>, <NUM>, <NUM>, <NUM>, <NUM> or less. In some embodiments the waypoint transmitter <NUM> is communicatively separated from the control system <NUM>, the transceiver unit <NUM>, and the monitoring system <NUM>. In such embodiments, the waypoint transmitter <NUM> is configured to transmit its nearfield wireless signal <NUM> without being triggered from the control system <NUM>. In some embodiments, the character, or conveyed content, of the nearfield wireless signal <NUM> may vary over time, in a pattern known to the control system <NUM>. The simple implementation and operation of the waypoint transmitter <NUM> ensures that it may be embodied as a low complexity device with low energy consumption, which makes it suitable to be realized as a battery-charged nearfield wireless signal transmitter.

In some embodiments, the dimension of the predetermined location <NUM> correlates with the communication range of the waypoint transmitter <NUM>. The predetermined location is detectable by the monitoring system <NUM>, and may be configured to conveniently fit one person at a time. in various embodiments predetermined location <NUM> may be defined by a floor or ground area, or a 3D space, at the waypoint transmitter <NUM>. In some embodiments, the location area <NUM> may be configured as a gated area, so as to conveniently only fit one person at a time. In some embodiments, the predetermined location area comprises a turnstile or a door, e.g. arranged for entering the gym environment <NUM>.

The control system <NUM> is configured to assign a specific human representation to the electronic device <NUM>, responsive to the monitoring system <NUM> detecting presence of the specific human representation O1 at the predetermined location <NUM> at a point in time associated with reception in the electronic device <NUM> of a near field wireless signal <NUM> from the waypoint transmitter <NUM>.

In some embodiments, the near field wireless signal triggers the electronic device <NUM> to transmit a communication signal <NUM> to the transceiver unit <NUM>, indicating reception in the electronic device <NUM> of the near field wireless signal <NUM>. In some embodiments, an application client in the electronic device <NUM> may control the electronic device <NUM> to carry out said transmission <NUM> responsive to detecting the nearfield wireless signal <NUM>. The application client may be in such an embodiment operate in conjunction with an application host in the control system <NUM>.

In some embodiments, said point in time may be a time stamp associated with the transmission from the electronic device <NUM>, or the reception in the transceiver unit <NUM>, of the wireless communication signal <NUM>. In other embodiments, said point in time may be a time stamp indicating the time of reception of the nearfield wireless signal <NUM> in the electronic device <NUM>.

By means of the proposed solution, a detected human representation O1 may be linked to an electronic device <NUM>, to ensure that exercise activity based on movement of the human representation O1, as tracked by the monitoring system <NUM> in the gym environment <NUM>, can be appropriately associated with a person linked with the electronic device <NUM>. The system design assures that persons not desiring to have their activity logged in the gym environment are not identified, which provides integrity to the system. Moreover, synchronization with the system <NUM> need only be executed once in the gym environment <NUM>, without requiring that the person continues to wear or carry the electronic device during various forms of exercise activity in the gym environment <NUM>. This assures user flexibility.

Before proceeding with description of additional features and functions of the system <NUM>, a general presentation of the elements associated with the system <NUM> will be discussed.

The monitoring system <NUM> operates to recover 3D position and 3D pose of objects from images, such as iterative still images or a video stream. One solution known in the art is to use multiple cameras with overlapping fields of view <NUM>, where the position and orientation of the cameras is known with reasonable accuracy, for example by measurement during installation. In operation, 3D positioning and pose determination typically comprises two stages: processing of individual video streams from the multiple cameras for detection of objects and key points of the respective object, and processing the detections to identify correspondence between detections of the same object in different views and calculating the position and/or pose of the respective object based on the correspondence between detections, and optionally temporal information. There are several established techniques for performing the first stage with good performance, for example by use of convolutional neural networks.

As used herein, "key point" has its conventional meaning in the field of computer vision and is also known as an interest point. A key point is a spatial location or point in an image that define what is interesting or what stand out in the image and may be defined to be invariant to image rotation, shrinkage, translation, distortion, etc. More generally, a key point may be denoted a "reference point" on an object to be detected in the image, with the reference point having a predefined placement on the object. Key points may be defined for a specific type of object, for example a human body, a part of the human body, or an inanimate object with a known structure or configuration. In the example of a human body, key points may identify one or more joints and/or extremities. Key points may be detected by use of any existing feature detection algorithm(s), for example image processing techniques that are operable to detect one or more of edges, corners, blobs, ridges, etc. in digital images. Non-limiting examples of feature detection algorithms comprise SIFT (Scale-Invariant Feature Transform), SURF (Speeded Up Robust Feature), FAST (Features from Accelerated Segment Test), SUSAN (Smallest Univalue Segment Assimilating Nucleus), Harris affine region detector, and ORB (Oriented FAST and Rotated BRIEF). Further information about conventional key point detectors is found in the article "<NPL>). Further examples of feature detection algorithms are found in the articles "<NPL>, and "<NPL>. Correspondingly, objects may be detected in images by use of any existing object detection algorithm(s). Non-limiting examples include various machine learning-based approaches or deep learning-based approaches, such as Viola-Jones object detection framework, SIFT, HOG (Histogram of Oriented Gradients), Region Proposals (RCNN, Fast-RCNN, Faster-RCNN), SSD (Single Shot MultiBox Detector), You Only Look Once (YOLO, YOLO9000, YOLOv3), and RefineDet (Single-Shot Refinement Neural Network for Object Detection).

<FIG> are enclosed to show one way of operating the monitoring system <NUM>, usable in the proposed solution. The monitoring system <NUM> is configured for determining positioning of one or more objects in a scene based on a plurality of views of the scene, also known as a "multiview". The positioning may be 3D object positioning, which involves determining a single 3D position of a key point of the respective object in the scene, or 3D pose determination, which involves determining 3D positions of a plurality of key points of the respective object in the scene. The views may be digital images and may be produced by a fixed or non-fixed arrangement of imaging devices. The views represent different viewpoints onto the scene, or parts thereof, and the respective object is reproduced as a two-dimensional object in the respective view.

<FIG> shows an example arrangement of the monitoring system <NUM> in accordance with an embodiment. The monitoring system <NUM> is arranged to monitor a scene <NUM> of the gym environment <NUM>. In the illustrated example, three individuals <NUM> are in the gym environment <NUM>. The monitoring system <NUM> comprises a plurality of imaging devices <NUM>, for example digital cameras, which are oriented with their respective field of view <NUM> towards the scene <NUM>. The scene <NUM> is associated with a fixed 3D coordinate system <NUM> ("scene coordinate system"). The imaging devices <NUM> may be fixed or moveable, and their relative positions and orientations are known for each image taken. The imaging devices <NUM> may be synchronized to capture a respective image at approximately the same time, or at least with a maximum time difference which depends on the expected maximum speed of movement of the objects <NUM>. In one example, a maximum time difference of <NUM>-<NUM> seconds may provide sufficient accuracy for normal human motion.

The images captured by the imaging devices <NUM> are received by a detection device <NUM>, which is configured to determine one or more key points of one or more objects in the respective image. The detection device <NUM> may implement any conventional object detection technique for identifying objects of a generic or specific type in the respective image and may implement any conventional feature detection technique for identifying one or more key points of the respective object, for example any of the feature and object detection techniques mentioned hereinabove. The detection device may also pre-process the incoming images, for example for noise reduction, contrast enhancement, etc. In an alternative configuration, the monitoring system <NUM> comprises a plurality of detection devices <NUM>, for example one for each imaging device <NUM>, where the detection devices <NUM> may be co-located or integrated with the imaging devices <NUM>.

The detection device <NUM> produces object detection data, which identifies one or more key points of one or more objects detected in the respective image. The object detection data is denoted ODD in the following. An example of the ODD is shown in <FIG>. Although <FIG> illustrates a table, the ODD may be given in any format. In the illustrated example, the ODD represents each image (view) by a respective view identifier (<NUM>-<NUM> in <FIG>) and each object by a respective object identifier (<NUM>-<NUM> in <FIG>), and comprises a key point position for each key point detected for the respective object (L1-L14 in <FIG>). In the following, for clarity of presentation, object identifiers will be designated O1, O2, O3, etc., and view identifiers will be designated V1, V2, V3, etc. An example of key points K1-K14, forming a human representation O1 for a human individual <NUM>, is shown in <FIG>. However, any number of key points may be detected depending on implementation. One or more of the key points may be designated as a main key point. The main key point may be identifiable with greater accuracy than other key points and/or may have a specific location within the object, for example close to its center. In the schematic example of <FIG>, the main key point K1 is indicated by an open circle and corresponds to the neck of the respective individual.

The detection device <NUM> is configured to detect a predefined number of key points of the respective object. If a key point is not detected, the detection device <NUM> may enter a predefined value (for example, a null value) into the ODD. The detection device <NUM> may also include a confidence score for each object and/or key point in the ODD, the confidence score representing a level of certainty for the respective detection. 1D shows an example view V1 captured by one of the imaging devices <NUM> in FIG. 1A and represents three detected objects O1, O2 and O3 with associated key points. The detected position of the respective key point is given by 2D coordinates in a local and fixed coordinate system <NUM> of the view V1.

The system <NUM> further comprises a positioning device <NUM>, which is configured to operate on the ODD to compute, and possibly track over time, one or more 3D positions of one or more objects in the scene <NUM>. It may be noted that positioning device <NUM> may comprise a plurality of units, which may be co-located with respective detection devices, wherein calculating 3D positioning is distributed. For example, a first positioning device 4A and detection device 3A are co-located and configured to track a human representation O1, whilst a second positioning device 4B and detection device 3B are co-located and configured to track a human representation O2.

Based on the above, the monitoring system <NUM> thus operates logic configured to process video streams from the plurality of cameras <NUM> for detection of key points L of an object, and to associate said key points L to positions on a human body. The logic may be shared by the detection device <NUM> and the positioning device <NUM>.

<FIG> schematically illustrates an example of the control system <NUM> for use in the system <NUM> as presented herein, and for carrying out the method steps as outlined.

The control system <NUM> comprises logic <NUM> configured to control the system <NUM>, including to communicate with other elements of the system <NUM>.

The logic <NUM> may include a processing device <NUM>, including one or multiple processors, microprocessors, data processors, co-processors, and/or some other type of component that interprets and/or executes instructions and/or data. The processing device <NUM> may be implemented as hardware (e.g., a microprocessor, etc.) or a combination of hardware and software (e.g., a system-on-chip (SoC), an application-specific integrated circuit (ASIC), etc.). The processing device <NUM> may be configured to perform one or multiple operations based on an operating system and/or various applications or programs.

The logic <NUM> may further include memory storage <NUM>, which may include one or multiple memories and/or one or multiple other types of storage mediums. For example, the memory storage <NUM> may include a random access memory (RAM), a dynamic random access memory (DRAM), a cache, a read only memory (ROM), a programmable read only memory (PROM), flash memory, and/or some other type of memory. The memory storage <NUM> may include a hard disk (e.g., a magnetic disk, an optical disk, a magneto-optic disk, a solid state disk, etc.).

The memory storage <NUM> is configured for holding computer program code, which may be executed by the processing device <NUM>, wherein the logic <NUM> is configured to control the control system <NUM> to carry out any of the method steps as provided herein. Software defined by said computer program code may include an application or a program that provides a function and/or a process. The software may include device firmware, an operating system (OS), or a variety of applications that may execute in the logic <NUM>.

The logic may be configured to hold and run an application host <NUM> of a software application for communicating with one or more application clients stored in electronic device. The application of the application host may be unique to the gym environment <NUM>, or be associated with an operator of various gyms or other facilities. The application host <NUM> may further be used for securely communicating exercise data, as determined based on tracked movement, with the electronic device <NUM> or with an external server <NUM>, holding a database or an account linked to the electronic device <NUM> or to a user associated with the electronic device.

The control system may optionally comprise data storage <NUM>, for storing user account data and/or exercise data.

The control system <NUM> further comprises a communication interface <NUM>, for communication with other elements of the system <NUM> or associated therewith. The communication interface may comprise a connection to the monitoring system <NUM>, which may be wired or wireless. As noted, various elements of the monitoring system <NUM> may share resources with the control system <NUM>, such as logic and/or memory. Further, the control system <NUM> is connected to the transceiver unit <NUM>, for communication of wireless communication signals with inter alia electronic devices present in the gym environment. Further, the control system may comprise an interface for communicating with a remote server <NUM>, as described.

It may be noted that detection and recognition of movement, and correlation of the detected movement with a certain exercise activity, is not outlined in detail herein as these are not features on which the proposed solution relies. However, it may be noted that based on detected key points and association thereof with various body parts or joints of a human representation, any movement of those key points may be mapped to one of a plurality of detectable motions, stored in the system <NUM>. The detection and recognition of exercise activity, based on the movement detected by the monitoring system <NUM>, may be carried out in the monitoring system <NUM> or in the control system <NUM>, or remotely in the server <NUM>.

<FIG> schematically illustrates an embodiment of the electronic device <NUM>. The electronic device <NUM> may be a radio communication terminal, such as a cellular device configured to operate in a wireless cellular network, e.g. a <NUM> New Radio network. Alternatively, the electronic device is only configured for non-cellular communication, e.g. wi-fi. As mentioned, the electronic device may optionally be a wearable device, such as a clip-on or a bracelet.

The electronic device <NUM> comprises logic <NUM> configured to control communication of data, via a transceiver <NUM>. The logic <NUM> may include a processing device <NUM>, including one or multiple processors, microprocessors, data processors, co-processors, and/or some other type of component that interprets and/or executes instructions and/or data. The processing device <NUM> may be implemented as hardware (e.g., a microprocessor, etc.) or a combination of hardware and software (e.g., a system-on-chip (SoC), an application-specific integrated circuit (ASIC), etc.). The processing device <NUM> may be configured to perform one or multiple operations based on an operating system and/or various applications or programs.

The logic <NUM> may further include memory storage <NUM>, which may include one or multiple memories and/or one or multiple other types of storage media. For example, the memory storage <NUM> may include a random access memory (RAM), a dynamic random access memory (DRAM), a cache, a read only memory (ROM), a programmable read only memory (PROM), flash memory, and/or some other type of memory. The memory storage <NUM> may include a hard disk (e.g., a magnetic disk, an optical disk, a magneto-optic disk, a solid state disk, etc.).

The memory storage <NUM> is configured for holding computer program code, which may be executed by the processing device <NUM>, wherein the logic <NUM> is configured to control the electronic device <NUM> to carry out any of the method steps as provided herein. Software defined by said computer program code may include an application or a program that provides a function and/or a process. The software may include device firmware, an operating system (OS), or a variety of applications that may execute in the logic <NUM>.

The electronic device <NUM> further comprises a transceiver <NUM>, which may comprise a plurality of different signal transceivers, such as radio transceivers, for communicating with various entities of the system <NUM> and possibly with a radio communication network. The transceiver <NUM> may thus include a radio receiver and transmitter for communicating through at least an air interface. As an example, the electronic device <NUM> may comprise one or more of a transceiver <NUM> for receiving a nearfield wireless signal, e.g. using NFC, BLE, RFID or similar. The nearfield transceiver <NUM> is configured for receiving a nearfield wireless signal from waypoint transmitters <NUM> of the system <NUM>. The transceiver <NUM> may further comprise a wireless local area network (WLAN) transceiver <NUM>, for communication with the transceiver unit <NUM> of the system <NUM>. The transceiver may further comprise a wide area network (WAN) transceiver <NUM>, e.g. for communication in a cellular network.

The logic <NUM> may be configured to hold and run an application client <NUM> of a software application for communicating with the application host <NUM> stored in control system <NUM>. The application client <NUM> may inter alia be configured to control the electronic device <NUM> to transmit a wireless communication signal, using transceiver <NUM> or <NUM>, to the transceiver unit <NUM> of the system <NUM>, responsive to detecting a nearfield wireless signal from a waypoint transmitter <NUM>. The application host may also be configured to convey an identification of the electronic device, in communication with the system <NUM>.

The electronic device <NUM> may further comprise a user interface, such as a display and/or an audio output, for allowing a person <NUM> using the electronic device to properly operate the device in accordance various embodiments of the proposed solution.

The electronic device <NUM> may e.g. be a mobile communication device such as a mobile phone, a wearable device such as a bracelet or a clip-on device, or even a device embedded into a garment or shoe of the human <NUM>. The electronic device may further comprise distributed elements, which are communicatively linked. The electronic device <NUM> may thus comprise a first member comprising a nearfield receiver <NUM>, configured to receive a nearfield wireless signal from the waypoint transmitter <NUM>, and a second member comprising a wireless transceiver <NUM> and/or <NUM> capable of transmitting communication signals to the transceiver unit <NUM>. In this context, the first and second members may communicate with each other by wired or wireless communication.

Successful operation of the proposed method relies on the notion that interaction between the system <NUM> and the electronic device <NUM> is only possible if the person carrying the electronic device <NUM> has physically moved to the waypoint transmitter <NUM>. In that scenario, the system <NUM> can detect the closest human representation, such as the human representation detected in the predetermined location area <NUM> of the waypoint transmitter <NUM>, and with high certainty assign the human representation to the user associated with the electronic device <NUM>, such as by a user account associated with the system <NUM>. The signal <NUM> transmitted to the system <NUM> operates a request for tracking, and for storing exercise data connected to the user account of the electronic device <NUM>. Upon transmission <NUM> of that request, and successful detection of a human representation O1 at the predetermined location area <NUM>, the application host in the control system <NUM> may be configured to provide feedback to the person <NUM> carrying the electronic device <NUM>, e.g. in the form of visuals and/or vibrations, verifying the user of the electronic device <NUM> that the connection has been made and the tracking is ongoing. This may be carried out by transmitting a feedback signal <NUM> to the electronic device <NUM>, for output using the user interface <NUM> of the electronic device <NUM>, under control of the application client <NUM>. Alternatively, the feedback may be provided by an output interface of the system <NUM>, e.g. arranged at the predetermined location <NUM> (not shown).

In some embodiments, the control system <NUM> is configured to store exercise activity data associated with said electronic device, based on movement detected by the monitoring system <NUM> of the assigned specific human representation O1. Storing may be executed by transmitting the exercise activity data to a server <NUM> associated with a user account linked to the electronic device <NUM>, either arranged locally in the control system <NUM> or remotely connected through a communications network, such as the Internet. The server <NUM> may be accessed by the person <NUM> by means of user verification according to state of the art procedures. Alternatively, the control system <NUM> may be configured to store the exercise data temporarily in a local memory <NUM>, and transmitting the exercise data to the electronic device <NUM>, e.g. by the transceiver unit <NUM>.

In some embodiments, a limit may be defined for how close to the waypoint transmitter <NUM> a human representation needs to be located in order for a request for tracking to be successful. This limit may in some embodiments define the predetermined location area, and may e.g. be a certain distance counted from the waypoint transmitter <NUM>. In case a request for tracking is transmitted from an electronic device <NUM> but the person whose human representation is nearest the waypoint transmitter moves away quickly, or there is more than one human representation detected by the monitoring system <NUM> at the predetermined location <NUM>, the request is rejected. This, too, may be indicated by a feedback signal, similar to what was outlined for a successful connection. A new attempt to trigger a request for tracking may then be carried out by the person <NUM>, by again approaching the waypoint transmitter <NUM> with the electronic device <NUM>, and thereby triggering a new request for tracking <NUM>.

In some embodiments, the system <NUM> is configured with a mechanism for ensuring proper linking of a human representation O1 to an electronic device <NUM>, and in extension to link tracked exercise activity of a human representation O1 to an account or database associated with the electronic device <NUM>, or a user of the electronic device <NUM>. This mechanism entails that the system <NUM> is configured to output a message indicating a test motion, wherein the control system <NUM> is configured to assign the specific human representation O1 to the electronic device <NUM>, e.g. the electronic device <NUM> from which the request for tracking <NUM> was received, based on the monitoring system <NUM> detecting a movement of the specific human representation O1 corresponding to said test motion.

The test motion is typically a movement which is easily identifiable by the monitoring system <NUM>. Examples of such a test motion may comprise a movement in a certain direction or with a certain indicated body part, e.g. a wave or stretch of a hand or arm, a squat, a bend of the body, or any other motion that the monitoring system <NUM> can detect.

In one embodiment, the control system <NUM> is configured to control the transceiver unit <NUM> to transmit said message to the electronic device <NUM>, for output on the user interface <NUM> on the electronic device <NUM>, under control of the application client. This may e.g. comprise a video clip or animation of the test motion, or an audible description. In an alternative embodiment, the control system <NUM> is configured to output said message on an interface arranged at said location (not shown).

In some embodiments, the control system <NUM> is configured to request a test motion to be carried out based on a rejected request for tracking <NUM>. Alternatively, the test motion is mandatory for successfully obtaining tracking. The control system <NUM> may nevertheless be configured to assign a specific human representation O1 to the electronic device <NUM> based on the monitoring system <NUM> detecting the movement corresponding to said test motion within a predetermined time period, such as within <NUM> <NUM> or <NUM> from transmitting or outputting the message conveying test motion.

In some embodiments, the test motion is randomly selected from a group of test motions. This way, if a number of human representations are detected one after another at the predetermined location <NUM>, such as at an entry to the gym environment <NUM>, proper connection of an electronic device to the person carrying it, by distinguishing between different motions.

In some embodiments, the system <NUM> is further aided in the proper association of a human representation to an electronic device <NUM> by being configured to determine a physical characteristic of the specific human representation, such as height or build, and to assign the human characteristic to said electronic device <NUM> based on the determined physical characteristic matching prestored characteristic data associated with said electronic device. The determination of a physical characteristic may be carried out based on image data collected by the monitoring system <NUM>, and may further comprise image analysis based on markers at the location area, e.g. indicating levels of height.

When a request for tracking <NUM> is successfully processed in the control system <NUM>, thereby assigning a human representation O1 to the electronic device <NUM>, the control system <NUM> may be configured to control the transceiver unit <NUM> to transmit an acknowledgment signal to the electronic device <NUM>, in which the acknowledgment may e.g. be output audibly and/or by vibration.

<FIG> shows a flow chart of various steps included in different embodiments of a method carried out in accordance with the proposed solution.

In step <NUM>, at least one human representation O1 is identified in the gym environment <NUM>. After identification of an object as the human representation O1, the monitoring system <NUM> is configured to track movement of the human representation. It may be noted that the proposed solution is adapted to operate also when a plurality of human representations O1, O2, O3 are identified and tracked in the gym environment <NUM>.

In step <NUM>, an indication is obtained in the system <NUM>, identifying reception in an electronic device <NUM> of a near field wireless signal <NUM> transmitted from a waypoint transmitter <NUM> arranged at a predetermined location <NUM> in the gym environment.

It may be noted that steps <NUM> and <NUM> may be carried out in any order. In other words, the system <NUM> may be configured to start identification and tracking of a human representation after, and even in response to, receiving the indication of reception of a near field wireless signal 41in the electronic device <NUM>.

In various embodiments, the indication of reception of a near field wireless signal <NUM> in the electronic device <NUM> is a message received in the system <NUM>, such as by the transceiver <NUM>, from the electronic device <NUM>. Said message may thus constitute a request to assign a human representation to the electronic device <NUM>, for tracking of exercise data to a person or account associated with the electronic device <NUM>.

In step <NUM>, which may be included in some embodiments, the system <NUM> outputs a message indicating a test motion, for the person carrying the electronic device <NUM> to carry out.

In step <NUM>, which may be included if step <NUM> is included, the system <NUM> is configured to detect, using the monitoring system <NUM>, whether a movement of the identified human representation corresponding to said test motion is carried out.

In step <NUM>, it is determined whether there is a human representation present at the waypoint transmitter <NUM> at time point associated with reception of indication. If this is the case, and potentially also the validation using a test motion is affirmed, it be determined whether successful or failed assignment of the identified human representation O1 to said electronic device <NUM> is obtained.

In step <NUM>, responsive to detecting presence of the identified human representation at the location <NUM> at a point in time associated with the reception in the electronic device of the near field wireless signal <NUM>, the identified human representation O1 is assigned to said electronic device <NUM>. Thereby, the system <NUM> has appropriately established a linked connection between the electronic device <NUM> and the identified human representation O1 such that, going forward, exercise activity determined to be carried out based on detected movement of the human representation O1 in the gym environment is stored or otherwise associated with the electronic device <NUM>.

Where the additional steps <NUM> and <NUM> are carried out, the assigning of the identified human representation O1 to the electronic device <NUM> is carried out responsive to positive detection of movement of the identified human representation O1 corresponding to said test motion.

In step <NUM>, if the connection fails, i.e. the system <NUM> fails to clearly establish that a human representation was present at the waypoint transmitter upon the electronic device <NUM> receiving the nearfield signal <NUM>, the system <NUM> may output a signal or message indicating rejection. The process may then be routed back to wait for a new indication of the nearfield signal <NUM> being received in the electronic device <NUM>, i.e. after a new attempt to tap or approach the waypoint transmitter <NUM> made by the person carrying the electronic device <NUM>. Alternatively, the process will route to the step <NUM> of outputting a message indicating a test motion. Where step <NUM> has already been carried out at least once, a different test motion may be indicated the second time step <NUM> is carried out. In some embodiments, steps <NUM> and <NUM> are only implemented after failed connection at step <NUM>, i.e. not automatically after step <NUM>.

In step <NUM>, upon successful association of the human representation O1 and the electronic device <NUM>, an acknowledgment message or signal is output by the system for detection by the person carrying the electronic device <NUM>. As noted, this may be provided through the electronic device <NUM>, or by a separate output interface at the waypoint transmitter <NUM>.

In step <NUM>, the system <NUM> proceeds to store exercise activity data such that it is associated with said electronic device <NUM>, based on movement detected by the monitoring system <NUM> of the assigned identified human representation O1.

The method described with reference to <FIG> may terminate once the identified human representation O1 exits the gym environment <NUM>, or by the receiving a termination signal from the electronic device <NUM>.

Claim 1:
A system (<NUM>) for monitoring activity in a gym environment (<NUM>), wherein the system comprises:
a monitoring system (<NUM>) configured to identify human representations in the gym environment and track movement of the human representations;
a transceiver unit (<NUM>) for receiving communication signals within the gym environment;
a waypoint transmitter (<NUM>), communicatively separated from the transceiver unit (<NUM>), arranged at a predetermined location (<NUM>) in the gym environment and configured to transmit a near field wireless signal (<NUM>);
wherein the transceiver unit (<NUM>) is configured to receive a communication signal from an electronic device (<NUM>) associated with a user, comprising an indication of reception in the electronic device of the near field wireless signal transmitted from the waypoint transmitter (<NUM>); and
a control system (<NUM>) configured to assign a specific human representation (O1) to the electronic device (<NUM>) associated with the user, responsive to the monitoring system detecting presence of the specific human representation at said location at a point in time associated with reception in the electronic device of the near field wireless signal, which point in time is obtained by the transceiver unit (<NUM>) in the communication signal from the electronic device (<NUM>).