INTERACTIVE PERFORMANCE FEEDBACK FOR EXERCISE EQUIPMENT
A method and device for providing performance feedback to a user during a session of using exercise equipment including measuring user input during the session using at least one sensor to gather sensor data, and transmitting the sensor data to a processing device. The sensor data is evaluated to determine at least one of a force metric, a frequency metric, and an accuracy metric. The at least one of the force metric, the frequency metric and the accuracy metric are compared to at least one predetermined performance goal. Audio feedback is provided to the user based on the comparison of the at least one of the force metric, the frequency metric, and the accuracy metric with the at least one predetermined performance goal, wherein the audio feedback includes varying a musical playback in at least one of speed, volume, and pitch.
This application claims the benefit of U.S. Provisional Application No. 62/143,417 filed on Apr. 6, 2015, entitled, “INTERACTIVE PERFORMANCE FEEDBACK FOR EXERCISE EQUIPMENT,” the entire contents of which are incorporated herein by reference.
FIELD OF THE INVENTIONThe present disclosure relates to a system and method for providing interactive performance feedback to a user of exercise equipment.
BACKGROUND OF THE INVENTIONImmediate feedback on athletic performance can be helpful to allow users to determine whether their athletic performance is improving or being maintained at a desired level, and can provide safety benefits such as warning a user when equipment is being used incorrectly. The ability to provide immediate feedback on physical activities also allows for researchers or trainers to study the effectiveness of feedback, including immediate or real-time feedback, on athletic performance, allowing researchers or trainers to determine more effective feedback for users to improve athletic performance.
SUMMARY OF THE INVENTIONOne aspect of the present disclosure is a method of providing interactive performance feedback for a user during a session of using exercise equipment including measuring user input during the session using at least one sensor to gather sensor data and transmitting the sensor data to a processing device. The sensor data is evaluated to determine at least one of a force metric, a frequency metric, and an accuracy metric. The at least one of the force metric, the frequency metric and the accuracy metric are compared to at least one predetermined performance goal. At least one of audio and visual feedback is provided to the user during the session based on the comparison of the at least one of the force metric, the frequency metric, and the accuracy metric with the at least one predetermined performance goal.
Another aspect of the present disclosure is a system for providing interactive performance feedback including a unit of exercise equipment and at least one sensor operably attached to the unit of exercise equipment to gather sensor data regarding user input. The exercise equipment includes at least one transmitter to transmit the sensor data to a processing device. The processing device evaluates the sensor data to determine at least one of a force metric, a frequency metric and an accuracy metric and then compares the at least one of the force metric, the frequency metric and the accuracy metric to a predetermined performance goal. The processing device directs at least one of an audio feedback and a visual feedback to the user based on the user's attainment of the at least one predetermined performance goal.
Yet another aspect of the present invention includes an interactive performance feedback system for a punching bag, including a plurality of accelerometers affixed to the punching bag and operably coupled to at least one transmitter to provide measurements to the at least one transmitter regarding the motion of the punching bag. A processing device is operably coupled to the at least one transmitter to receive measurements from the accelerometers. The processing device evaluates the measurements from the accelerometers to determine at least one of a force metric, a frequency metric, and an accuracy metric and compares the at least one of the force metric, the frequency metric, and the accuracy metric to at least one predetermined performance goal. An audio feedback output is controlled by the processing device to provide audio feedback which varies in at least one of speed, volume, and pitch based on the comparison of the at least one of the force metric, the frequency metric, and the accuracy metric to the at least one predetermined performance goal.
These and other features, advantages, and objects of the present device will be further understood and appreciated by those skilled in the art upon studying the following specification, claims, and appended drawings.
For purposes of description herein the terms “upper,” “lower,” “right,” “left,” “rear,” “front,” “vertical,” “horizontal,” and derivatives thereof shall relate to the system, device and components as shown in
As shown in the embodiment depicted by the schematic in
The processing device 26 further directs a user performance feedback system 28, which can give the user positive feedback or negative feedback (depending upon whether the at least one predetermined performance goal is being met). The user feedback system 28 preferably provides feedback to the user while the equipment 20 is in use, including optional audio feedback and visual feedback. The user feedback system 28 also optionally provides additional feedback to the user at the end of the round or session including more detailed or statistical information regarding the completed round. Various examples of the types of exercise equipment 20 for use according to the present disclosure include, without limitation, a punching bag, free weights, a stationary bike, a treadmill, a rowing machine, a stair stepper machine, and an elliptical machine. In certain preferred embodiments, the sensors 22 on the exercise equipment 20 can be used in conjunction with another type of sensor, such as a hear rate monitor, which can also be used to send signals to the processing device 26.
In a preferred embodiment, sensor data 24 is transmitted to the processing device 26, where it is used to calculate at least one of the force metric, the frequency metric, and the accuracy metric. The at least one of the force metric, the frequency metric, and the accuracy metric are then compared by the processing device 26 to the at least one predetermined performance goal to determine whether the at least one predetermined performance goal has been met. Typically, a user will complete a session using the exercise equipment 20, which may or may not be broken into further sub-units, such as sets, repetitions, or rounds. The session may be a defined length of time, a distance traveled, the duration that the user is able to continue the activity, or other exercise metric. Where the use is divided into sub-units, performance goals can be set per session or per sub-unit, or can be cumulative, relating to each. The predetermined performance goals can be generic, i.e., can be pre-established without reference to the user's past performance. However, the predetermined performance goals are preferably based on a baseline performance evaluation of the user as further described below and intervening sessions completed by the same user. Additionally, the performance goals preferably incorporate improvement over time, or in repeated sessions, to encourage the user to increase strength, endurance, and skills through continued use of the exercise equipment 20. In certain embodiments, the processing device 26 is used to determine relative force, rather than a calibrated actual force, where the goal is to determine the overall improvement. The processing device 26, after determining whether the predetermined performance goals have been met, directs feedback to the user through the user feedback system 28. The feedback is preferably in real time, throughout the session that the user is engaged in, as further described below.
In one embodiment, the audio and visual feedback are determined based on the average performance (e.g., average, force, average frequency, average accuracy) of the user over a time period. To keep the feedback current, or in “real time” over the course of the user's session, the time period for determination of the average for feedback is less than the total time of the session. For example, in a session that is 3 minutes long, the average value of the relevant measurement over the most recent 5 second time period can be used. The processing device can continue to perform this calculation to determine a moving average and continue to update the feedback to the user.
In one embodiment, the user receives auditory feedback during each round or session.
In a preferred embodiment, the user selects music to be played during the session (or the genre of music, or a musical station). During operation, at least one of the volume, frequency (tempo), or pitch of the music are adjusted to provide auditory feedback based on the user's attainment of at least one predetermined performance goals during the round or session. For example, if the user is below the predetermined performance goal for frequency, the tempo of the music is slowed. In another example, if the user is below the predetermined performance goal for force the volume of the music is lowered. In yet another example, if the user is below the predetermined performance goal for accuracy, the pitch of the music can be altered. Alternative combinations and configurations, e.g., altering the volume based on the frequency, can also be employed. However, it is preferable for each predetermined performance goal to be used to control a separate aspect of the audio feedback to allow the user to know in real time which aspect of the athletic performance is meeting the predetermined performance goal. The variation of the frequency (tempo), volume, and pitch of the music can be based on a linear relationship with the attainment of performance goals, or any other function, and a lower or upper limit can be placed, e.g., so the music does not fall below 90% of the tempo, volume, or pitch of the original.
In one preferred embodiment, a user or administrator creates an individual user profile prior to the user using the exercise equipment 20 as described herein. The user profile may contain information, for example, a user name, the user's age, the user's weight, the user's height, the user's fitness or experience level, or the user's musical preferences for auditory feedback. In addition to the general user profile, in the preferred embodiment predetermined force, frequency and accuracy performance goals are set for each user, as well as optional predetermined goals such as optimal heart rate. To set these predetermined performance goals, a baseline session can be used to determine the user's current fitness and skill level. In certain embodiments, the user's initial baseline fitness and skill level can be used to classify the user as a beginner, intermediate, or advanced user (or any other categories, such as level 1-5 users). An improved performance over that demonstrated by the user in the baseline session can be targeted with the predetermined performance goals with the percentage increase over the baseline session optionally influenced by the classification of the user's initial baseline fitness and skill level.
As shown in the embodiment depicted by the schematic in
In one embodiment, the predetermined performance goals are designed to target certain incremental percentage increases in force, frequency or accuracy metrics. As described herein, in a preferred embodiment, the incremental increase is predetermined based on the user's baseline fitness level. For example, a beginner user could have a given incremental increase for the predetermined performance goal, while an intermediate or advanced user has a different incremental increase for the predetermined performance goal. In an alternate embodiment, the user is able to select or enter a desired incremental increase. In yet another alternate embodiment, a trainer, fitness professional, or researcher could prepare a protocol to set the desired incremental increase in predetermined performance goals.
In the particular embodiment depicted by the schematic in
In one non-limiting example, where the exercise equipment 20 is a punching bag, based on the average force of the user's strikes against the punching bag sensed by the sensors 22, the user is classified as a beginner, intermediate or expert level user. Based on the user's level, the goal for increases in force can be varied, e.g., 105% increase for beginners, 110% increase for intermediates, and 117% increase for experts. Additionally, or alternatively, the user can be classified as a beginner, intermediate, or expert level user based on the strike frequency or upon the user strike accuracy.
Alternatively, the user or an administrator could enter a predetermined set of criteria, e.g., if the exercise equipment 20 will be used for a fitness test with minimum requirements, those requirements could be set as the predetermined performance goals. These types of predetermined performance goals could be set with or without the use of a baseline session to evaluate the user.
With continued use of the exercise equipment 20, predetermined performance goals are updated to account for the user's continued improvement. As shown in the embodiment depicted in
In certain embodiments, the predetermined performance goals can be decreased, can be increased, or can remain unchanged based on whether the user meets the at least one predetermined performance goal, or how far the user's performance varies from the at least one predetermined performance goal in the previous session. For example, if a user's performance is significantly better than the at least one predetermined performance goal in the previous session, the at least one predetermined performance goal for the next session may be increased more than if the user's performance barely exceeds the at least one predetermined performance goal in the previous session. Similarly, in certain embodiments if the user fails to meet the at least one predetermined performance goal, the at least one predetermined performance goal for the next session may remain the same. If the user fails to meet the at least one predetermined performance goal in one or more consecutive sessions, the at least one predetermined performance goal may be lowered for future sessions. The at least one predetermined performance goal can be varied using different increments for each of the attributes being measured, e.g., a different incremental increase in the predetermined performance goal for force (5%) versus the incremental increase in the predetermined performance goal for frequency (10%).
In various embodiments the predetermined performance goals can be added in a stepwise fashion. As one non-limiting example, the predetermined performance goals can begin with a goal only for force. As the user improves his or her force metric, the predetermined performance goals can be modified to also include a goal for frequency. As both of these factors improve, the predetermined performance goals can be modified to include an accuracy goal. This allows a user to focus on a certain aspect of performance until a desired level is reached, and stepwise incorporation of predetermined performance goals may be useful with certain types of exercise equipment 20 where endurance or strength must be built or a specific aspect of the skill must be mastered.
In one embodiment, the user receives visual feedback from the user feedback system 28 including a display of the at least one force metric, frequency metric, or accuracy metric. The display can indicate the at least one force metric, frequency metric, or accuracy metric of the most recent strike, or can indicate the measurement for the moving average calculation during the session. In addition to or in place of this visual feedback, the display can include information regarding the elapsed time of the session or sub-unit, the time remaining in the session or sub-unit, the total number of strikes, steps, or repetitions in the session or sub-unit, the overall frequency or rate of strikes, steps or repetitions, the average accuracy metric, the average force metric, the minimum force metric, the maximum force metric, or other detailed data. The display can also optionally be used to display other detailed data regarding the user's previous session or sub-unit upon completion of the session or sub-unit.
The color of the writing, the background, or any other portion of the visual display can also be altered to indicate whether the predetermined performance goals (or at least one of the predetermined performance goals) are being met. For example, if the predetermined performance goals are being met, the background for the visual display may be a green color, while if the user's performance falls below 95% of the predetermined performance goal the display or a portion thereof changes to yellow and if the user's performance falls below 90% of the predetermined performance goal the display or a portion thereof changes to red. Alternative arrangements or cutoff points could also be used, such as switching to a warning color when the user's performance falls below at least one of the predetermined performance goals or when the user falls to a specified percentage above the at least one predetermined performance goal, or omitting the use of a warning color.
One embodiment of a system 30 for providing interactive performance feedback using a punching bag 32 is depicted in
In the embodiment depicted in
Where accelerometers are used as the sensors 34, each accelerometer measures acceleration in three dimensions, allowing the data from the plurality of accelerometers to be used to calculate the force, the frequency, and the accuracy of the user's strikes. In one preferred embodiment, as shown in
Where accelerometers are chosen as the sensors 34, to choose appropriate accelerometers for a given application and set of exercise equipment 20, testing can be undertaken to find out the force that will be applied by the user input to the exercise equipment 20, whether used with the punching bag 32 or another type of exercise equipment 20. The accelerometers are preferably calibrated individually, and then refined once positioned in the exercise equipment 20 through the use of methods such as using a motion capture system and comparing a motion capture database to sensor data 36 to develop an accurate tracking of motion of the punching bag 32 or other exercise equipment 20 using the accelerometer sensor data 36. Various accelerometers have different sensitivities and limits on their ability to detect acceleration. The accelerometers are optionally powered by a wired electrical connection. With a wired connection, a capacitor can be added between the ground and power of the accelerometer to reduce electronic noise. Where a wired connection is used, the SCLK, MOSI, and MISO pins of each accelerometer are electrically connected, with the individual chip select pins connected to GPIO pins on the microcontroller.
The accelerometers are calibrated to establish force readings generated by the user's strike by measuring the acceleration of the punching bag 32. The sensor data 36 regarding the acceleration of the punching bag 32 is transmitted to the processing device 44, and the processing device 44 can then use the sensor data 36 to calculate or determine the overall force of the strike on the punching bag 32. In one embodiment, the magnitude of the initial impulse is multiplied by the mass of the punching bag 32 to determine the force of the strike. In another embodiment the maximum force that occurs over the time of the strike is used to calculate the force of the strike. In many cases, the initial impulse will correspond with the largest spike in the accelerometer's output. In certain embodiments, relative force measurements (or calculations) can be reliably used, e.g., to allow the predetermined performance goals to target a percentage improvement in relative force over time.
Additionally, the frequency of the strikes can be calculated based upon the time measured between detected strikes in the sensor data 36. In order to detect the frequency of strikes on the punching bag 32, during the calibration of the accelerometers, a threshold acceleration can be incorporated such that sensor data 36 below the threshold acceleration is filtered from the sensor data 36, thereby allowing the sensor data 36 from the accelerometers to distinguish between a tap or push on the punching bag 32 and a full strike of the punching bag 32 as well as to filter out the effect of accelerometer noise. In one particular embodiment, to be considered a strike on the punching bag 32 a number of consecutive readings over a threshold value must be detected, with a predefined gap between one set of values above the threshold value and the next set of values above the threshold value to detect the next strike (to correspond to the maximum speed that humans are capable of striking the punching bag 32).
In addition to detecting the level of force and the frequency of the strikes, the location of the strike on the punching bag can also be determined based on the sensor data 36 from the accelerometer and the relative accelerations of the accelerometers. Accuracy is calculated through the comparison of acceleration magnitudes of accelerometers in different positions on the punching bag 32. The magnitude of the accelerometer reading will vary greatly between sensors 34 located near the bottom of the punching bag 32 and sensors 34 located near the top of the punching bag 32 based on the location of the strike. Through testing, a formula can be created to determine the location of a given strike based on these differences in sensor data 36 between the accelerometers. The processing device 44 can then compare the distance between the strike and predetermined points on the punching bag 32 to determine the accuracy of the strike (e.g., whether the strike is in a target zone).
In the embodiment depicted in
Also as shown in the embodiment depicted in
In one embodiment, the sensor data 36 is sent from the microcontroller 38 through the wireless communication transmitter 40 to a wireless communication receiver 42 which is operably connected to the processing device 44. In alternate embodiments, the microcontroller 38 and the processing device 44 can communicate through alternative wired or wireless connections, such as using Bluetooth, WiFi, or other communication protocols.
In one particular embodiment of a punching bag 32 according to the present disclosure, the accelerometers selected for use with the punching bag 32 are able to withstand forces of 24 g (g=9.80665 m/s2). One example of a suitable accelerometer for use on this punching bag 32 embodiment is an LIS331HH accelerometer, as shown in
Also, as generally shown in the embodiment illustrated in
The processing device 44 used with the embodiment depicted in
A typical set of sensor data 36 for the user's round on the punching bag 32 depicted in
In various alternative embodiments force measurements, frequency measurements, and accuracy measurements can be used to evaluate a user's performance on many different types of exercise equipment 20, including without limitation free weights, a stationary bike, a treadmill, a rowing machine, a stair stepper, and an elliptical trainer. Examples of the types of force, frequency, and accuracy measurements and sensors 22 for each of these types of equipment 20 are described in Table 2 below.
It is also important to note that the construction and arrangement of the elements of the exercise equipment 20 and system 30 for providing performance feedback as shown and described in the exemplary embodiments is illustrative only. Although only a few embodiments of the present innovations have been described in detail in this disclosure, those skilled in the art who review this disclosure will readily appreciate that many modifications are possible (e.g., variations in sizes, dimensions, structures, shapes and proportions of the various elements, values of parameters, mounting arrangements, use of materials, colors, orientations, etc.) without materially departing from the novel teachings and advantages of the subject matter recited. For example, elements shown as integrally formed may be constructed of multiple parts or elements shown as multiple parts may be integrally formed, the operation of the interfaces may be reversed or otherwise varied, the length or width of the structures and/or members or connector or other elements of the system may be varied, the nature or number of adjustment positions provided between the elements may be varied. It should be noted that the elements and/or assemblies of the system may be constructed from any of a wide variety of materials that provide sufficient strength or durability, in any of a wide variety of colors, textures, and combinations. Accordingly, all such modifications are intended to be included within the scope of the present innovations. Other substitutions, modifications, changes, and omissions may be made in the design, operating conditions, and arrangement of the desired and other exemplary embodiments without departing from the spirit of the present innovations.
It will be understood that any described processes or steps within described processes may be combined with other disclosed processes or steps to form structures within the scope of the present device. The exemplary structures and processes disclosed herein are for illustrative purposes and are not to be construed as limiting.
It is also to be understood that variations and modifications can be made on the aforementioned structures and methods without departing from the concepts of the present device, and further it is to be understood that such concepts are intended to be covered by the following claims unless these claims by their language expressly state otherwise.
The above description is considered that of the illustrated embodiments only. Modifications of the device will occur to those skilled in the art and to those who make or use the device. Therefore, it is understood that the embodiments shown in the drawings and described above is merely for illustrative purposes and not intended to limit the scope of the device, which is defined by the following claims as interpreted according to the principles of patent law, including the Doctrine of Equivalents.
Claims
1. A method of providing interactive performance feedback for a user during a session of using exercise equipment, the method comprising:
- measuring user input during the session using at least one sensor to gather sensor data;
- transmitting the sensor data to a processing device;
- evaluating the sensor data utilizing the processing device to determine at least one of a force metric, a frequency metric, and an accuracy metric;
- comparing the at least one of the force metric, the frequency metric, and the accuracy metric to at least one predetermined performance goal; and
- providing feedback to the user during the session based on the comparison of the at least one of the force metric, the frequency metric, and the accuracy metric with the at least one predetermined performance goal.
2. The method of claim 1, wherein:
- the sensor comprises an accelerometer that is mounted on a punching bag.
3. The method of claim 2, including:
- determining at least one of stroke force, strike frequency, and strike accuracy utilizing data from the accelerometer.
4. The method of claim 3, including:
- utilizing the processing device to determine the strike frequency for a series of successive predefined time periods; and including:
- comparing the strike frequency to a predetermine strike frequency goal.
5. The method of claim 4, including:
- causing an audio device to generate an audible feedback noise of a first type if the strike frequency is below the predetermine strike frequency goal.
6. The method of claim 5, including:
- providing music having an initial tempo, and wherein:
- the noise of the first type comprises music having a tempo that is slower than the initial tempo.
7. The method of claim 6, including:
- providing music having a volume;
- comparing the strike force to a predetermined strike force goal;
- lowering the volume of the music if the strike force meets or exceeds the predetermined strike force goal.
8. The method of claim 1, wherein:
- the feedback comprises at least one of audio and visual feedback.
9. The method of claim 1, wherein:
- the exercise equipment is selected from a group consisting of free weights, stationary bikes, treadmills, rowing machines, stair steppers, and elliptical machines; and
- the at least one sensor comprises an accelerometer.
10. The method of claim 9, wherein:
- the at least one sensor comprises an accelerometer configured to generate data from which a frequency metric can be determined.
11. The method of claim 1, wherein:
- the exercise equipment includes a movable member that moves in a repetitive manner defining a frequency in response to a force applied by a user of the exercise equipment; and
- the at least one sensor comprises an accelerometer;
- utilizing the processing device to determine a frequency of the movement of the movable member.
12. The method of claim 11, wherein:
- the movable member comprises a pair of pedals that are configured to move in response to forces applied thereto by a user's feet.
13. The method of claim 1, wherein:
- the accuracy metric comprises foot placement.
14. The method of claim 13, wherein:
- foot placement is measured utilizing at least one IR sensor.
15. A system for providing interactive performance feedback, comprising:
- exercise equipment having a movable input member that is configured to move while a user applies a force to the movable input member;
- at least one sensor operably connected to the movable input member to gather sensor data regarding user input to the movable input member;
- at least one transmitter configured to transmit the sensor data to a processing device, wherein the processing device is configured to evaluate the sensor data and determine at least one of a force metric, a frequency metric, and an accuracy metric and then compare the at least one of the force metric, the frequency metric and the accuracy metric to a predetermined performance goal and provide feedback to a user based at least in part, on the comparison.
16. The system of claim 15, wherein:
- the sensor comprises an accelerometer mounted to the movable input member.
17. The system of claim 16, wherein:
- the movable input member comprises a punching bag.
18. The system of claim 16, wherein:
- the exercise equipment is configured to provide at least one of audio feedback and visual feedback to a user while the user is exercising utilizing the exercise equipment.
19. An interactive performance feedback system for a punching bag, the system comprising:
- at least one transmitter;
- a plurality of accelerometers configured to be affixed to a punching bag, wherein the plurality of accelerometers are operably coupled to the at least one transmitter and provide data to the at least one transmitter regarding motion of a punching bag;
- a processing device operably coupled to the at least one transmitter to receive data from the accelerometers, wherein the processing device is configured to evaluate data from the accelerometers to determine at least one of a force metric, a frequency metric, and an accuracy metric, and wherein the processing device is configured to compare the at least one of the force metric, the frequency metric, and the accuracy metric to at least one predetermined performance goal; and
- an audio device, wherein the audio device is controlled by the processing device to provide audio feedback which varies in at least one of speed, volume and pitch based, at least in part, on the comparison of the at least one of the force metric, the frequency metric and the accuracy metric to the at least one predetermined performance goal.
20. The interactive performance feedback system of claim 19, wherein:
- the processing device is configured to cause the audio device to provide audio feedback while a user is striking the punching bag.
Type: Application
Filed: Apr 6, 2016
Publication Date: Oct 6, 2016
Inventors: Neil Deochand (Kalamazoo, MI), Dale Gregory (Kalamazoo, MI), Derek William Visch (Greenville, MI), Ryan Bowman (St. Joseph, MI), Alexander W. McLean (Wixom, MI), R. Wayne Fuqua (Kalamazoo, WA)
Application Number: 15/092,176