MOTION SUPPORTING DEVICE, MOTION SUPPORTING SYSTEM, MOTION SUPPORTING METHOD, AND STORAGE MEDIUM

Abstract

An motion supporting device includes a body-motion-information acquirer configured to acquire body motion information of an exercising player, a dynamic-information collector (a communicator) configured to collect dynamic information of an implement related to the exercise, and a timing determiner configured to determine, on the basis of the body motion information and the dynamic information, timing for informing the player of advice.

Description

BACKGROUND

1. Technical Field

The present invention relates to an motion supporting device, an motion supporting system, an motion supporting method, and a storage medium.

2. Related Art

There has been known, for example, a device that informs a player playing sports such as soccer of advice as described in Japanese Patent No. 5504568 (Patent Literature 1). The device described in Patent Literature 1 can detect position information of a plurality of players, determine, on the basis of the position information, a player who can receive a pass, and inform a player attempting a pass of appropriate advice.

However, in Patent Literature 1, it is likely that play of the player is disturbed when the advice is informed to the player. Specifically, since the advice is informed to the player during game progress, the player is distracted by the informed advance and sometimes cannot play as the player should originally play. In this way, depending on a situation on the player side, the play of the player is disturbed by the informing of the advice.

In Patent Literature 1, it is hard to say that the advice is surely transmitted to the player. Specifically, since the player concentrates on the play, for example, while the player is attempting a pass, the player sometimes fails to hear the advice. In this way, depending on a situation on the player side, even if the advice is provided, it is likely that the advice is not transmitted to the player.

SUMMARY

An advantage of some aspects of the invention is to solve at least a part of the problems, and the invention can be implemented as the following forms or application examples.

Application Example 1

An motion supporting device according to this application example includes: a body-motion-information acquirer configured to acquire body motion information of an exercising player; a dynamic-information collector configured to collect dynamic information of an implement related to the exercise; and a timing determiner configured to determine, on the basis of the body motion information and the dynamic information, timing for informing the player of advice.

According to this application example, it is possible to collect information related to a movement of the player from the body motion information and collect information related to a progress state of play from the dynamic information.

For example, it is possible to estimate, from the collected information, a period of time when the play is suspended and the player is taking a rest. In such a period of time (timing), the advice is easily transmitted to the player and does not disturb the play.

Therefore, it is possible to determine timing when advice generated for the exercising player is easily surely transmitted to the player without disturbing the play of the player as much as possible.

Application Example 2

The body-motion-information acquirer in the application example may include a body motion sensor worn on the body of the player, and the body motion sensor may measure the body motion information of the player.

According to this application example, the body motion sensor can measure the body motion information on which the movement of the player is directly reflected.

Application Example 3

The body motion information in the application example may include at least one of acceleration information and angular velocity information generated according to a movement of the player.

According to this application example, it is possible to precisely measure movements concerning a linear movement and a rotational movement of the player according to the acceleration information and the angular velocity information.

Application Example 4

The dynamic-information collector in the application example may include a sensor unit including at least one of an acceleration sensor, an angular velocity sensor, a ball sensor, and a positioning sensor attached to the implement. The sensor unit collects the dynamic information.

According to this application example, it is possible to select a sensor unit corresponding to a way of movement of the implement and a type of the implement.

Application Example 5

The timing determiner in the application example may calculate a play motion indicator serving as an indicator of a play motion of the player on the basis of the dynamic information and the body motion information and determine the timing on the basis of an increase/decrease tendency of the play motion indicator.

According to this application example, according to the play motion information including information related to the movement of the player and information related to the progress state of play, it is easy to detect a state in which the player can receive the advice.

Application Example 6

The play motion indicator in the application example may be calculated by adding the dynamic information and the body motion information having a positive correlation to the play motion of the player and by subtracting the dynamic information having a negative correlation to the play motion of the player.

According to this application example, it is possible to calculate the play motion indicator on which various movements of the implement and the player are reflected.

Application Example 7

The timing determiner in the application example may detect an inflection point, which is a point in time when the increase/decrease tendency of the play motion indicator changes from a decrease tendency to an increase tendency and, when the play motion indicator after elapse of a predetermined period from the inflection point is equal to or smaller than a predetermined motion amount, determine that it is the timing for informing the advice.

According to this application example, it is possible to determine, according to the increase/decrease tendency of the play motion index, the timing on the basis of various play situations in which, for example, the player stops during the play and the player is taking a rest.

Application Example 8

The motion supporting device according to the application example may further include: an informer configured to inform the advice; and an advice output section configured to output the advice to the informer, and the advice output section may select a valid advice at the timing determined by the timing determiner out of generated pieces of advice and output the valid advice to the informer.

According to this application example, it is possible to inform the player of generated advice at appropriate timing with the informer and the advice output section.

Application Example 9

An motion supporting method according to this application example includes: acquiring body motion information of an exercising player; collecting dynamic information of an implement related to the exercise; determining, on the basis of the body motion information and the dynamic information, timing for informing the player of advice; and selecting a valid advice at the timing and informing the player of the effecting advice.

According to this application example, it is possible to collect information related to a movement of the player from the body motion information and collect information related to a progress state of play from the dynamic information. For example, it is possible to estimate, from the collected information, a period of time when the play is suspended and the player is taking a rest. In such a period of time (timing), the advice is easily transmitted to the player and does not disturb the play. Therefore, it is possible to determine timing when advice generated for the exercising player is easily surely transmitted to the player without disturbing the play of the player as much as possible and inform the player of the advice.

Application Example 10

A storage medium according to this application example has stored therein a computer program for causing a computer to execute: acquiring body motion information of an exercising player; collecting dynamic information of an implement related to the exercise; determining, on the basis of the body motion information and the dynamic information, timing for informing the player of advice; and selecting a valid advice at the timing and informing the player of the effecting advice.

According to this application example, it is possible to collect information related to a movement of the player from the body motion information and collect information related to a progress state of play from the dynamic information. For example, it is possible to estimate, from the collected information, a period of time when the play is suspended and the player is taking a rest. In such a period of time (timing), the advice is easily transmitted to the player and does not disturb the play. Therefore, it is possible to determine timing when advice generated for the exercising player is easily surely transmitted to the player without disturbing the play of the player as much as possible and inform the player of the advice.

Application Example 11

An motion supporting system according to this application example includes: the motion supporting device described above; an informer configured to inform the advice; and an advice output section configured to select a valid advice at the timing out of generated pieces of advice and output the valid advice to the informer.

According to this application example, it is possible to collect information related to a movement of the player from the body motion information and collect information related to a progress state of play from the dynamic information. For example, it is possible to estimate, from the collected information, a period of time when the play is suspended and the player is taking a rest.

In such a period of time (timing), the advice is easily transmitted to the player and does not disturb the play. Therefore, it is possible to determine timing when advice generated for the exercising player is easily surely transmitted to the player without disturbing the play of the player as much as possible and inform the player of the advice.

Application Example 12

The motion supporting system according to the application example may further include a detecting device configured to detect the dynamic information.

According to this application example, since the detecting device and the motion supporting device are different devices, it is possible to acquire the dynamic information from various implements.

Application Example 13

The motion supporting system according to the application example may further include a terminal device, and the body-motion-information acquirer and the informer may be mounted on the terminal device.

According to this application example, since functions of the terminal device can be minimized, for example, it is possible to realize a reduction in the size and a reduction in the weight of the terminal device worn on the player.

Application Example 14

The motion supporting system according to the application example may further include a display device, and the informer may be mounted on the display device.

According to this application example, for example, it is possible to construct a system configured by combining a detecting device that analyzes and detects an image signal capable of comprehensively detecting movements of the implement and the player, a large display device that displays the advice, and the like.

BRIEF DESCRIPTION OF THE DRAWINGS

The invention will be described with reference to the accompanying drawings, wherein like numbers reference like elements.

FIG. 1 is an explanatory diagram showing the overview of an motion supporting system in a first embodiment.

FIG. 2 is an explanatory diagram showing the exterior of an motion supporting device in the first embodiment.

FIG. 3 is a block diagram for explaining schematic functions of the motion supporting system.

FIG. 4 is an explanatory diagram showing a management table and an advice file group.

FIGS. 5A to 5F are explanatory diagrams concerning timing determination.

FIGS. 6A and 6B are detailed explanatory diagrams concerning the timing determination.

FIG. 7 is a flowchart for explaining a flow of timing determination processing.

FIG. 8 is a flowchart for explaining a flow of advice output processing.

FIG. 9 is a block configuration diagram showing the schematic configuration of an motion supporting system in a second embodiment.

FIG. 10 is a block configuration diagram showing the schematic configuration of an motion supporting system in a third embodiment.

DESCRIPTION OF EXEMPLARY EMBODIMENTS

Embodiments of the invention are explained below with reference to the drawings. Note that, in the figures referred to below, layers and members are sometimes shown in scales different from actual scales in order to show the layers and the members in recognizable sizes.

First Embodiment

Overview of an Motion Supporting System

FIG. 1 is an explanatory diagram showing the overview of an motion supporting system in a first embodiment. FIG. 2 is an explanatory diagram showing the exterior of an motion supporting device. Note that, in this embodiment, an motion supporting system that performs exercise assistance for tennis is explained as an example. However, the invention can also be applied to motion supporting systems that perform support related to various sports such as golf, baseball, and volleyball and motion supporting systems that perform support of exercise other than sports such as rehabilitation exercise.

An motion supporting system 1 in this embodiment includes an motion supporting device 3 worn on the body of a player PL who plays sports (tennis), sensor units 10 (10A, 10B, 10C, and 10D) attached to or incorporated in implements used in the sports, and the like. The motion supporting device 3 and the sensor units 10 are connected to be capable of communicating various data by communication 2 such as near field radio. However, in the motion supporting system 1, a part of these components (elements) may be omitted or new components (elements) may be added.

As shown in FIG. 1, the player PL grips a tennis racket RA and is ready to hit a ball BA. The sensor unit 10A is fixedly attached to the racket RA. The sensor unit 100 is incorporated in the inside of the ball BA. A bag BG including a spare racket RB not used in play and sports implements is placed beside the player PL. The sensor unit 10B is fixedly attached to the racket RB. The sensor unit 10D incorporated in a fitting formed in a clip shape is attached to the bag BG to hold a carrying handle portion of the bag BG.

The motion supporting device 3 shown in FIG. 2 is a wristwatch-type device worn on the wrist of the player PL. The motion supporting device 3 includes a body motion detector 20 and a display 91. The body motion detector 20 detects body motion information of the player PL. The display 91 is a display device capable of displaying images, characters, icons, and the like.

The motion supporting device 3 acquires body motion information of the player PL with the body motion detector 20. The motion supporting device 3 communicates with the sensor units 10 and collects dynamic information from a plurality of implements. A controller 40 (explained below) of the motion supporting device 3 analyzes the dynamic information of the implements and the body motion information of the player PL and determines whether the player PL is in a state in which the player PL can receive advice. If the player PL is in the state in which the player PL can receive advice, the controller 40 determines that it is appropriate timing for informing the advice.

Examples of the timing when the player PL can easily receive the advice include a state in which the player PL can change awareness and feeling during play. For example, a period when the player PL stops a movement and takes a short rest during the play can be considered a state in which the player PL switches awareness and feeling to the next play. Such a period of time is appropriate timing for informing the advice. For example, in a period when the player PL suspends the play because of a change of an implement such as the racket RA, an accident, or the like, since the play is not disturbed, the player PL can easily receive the advice.

The motion supporting device 3 also generates advice for the player PL using the body motion information of the player PL and the dynamic information of the implements. When the appropriate timing for informing the advice is determined, at that timing, the motion supporting device 3 selects valid advice and informs the player PL of the valid advice. When such advice is present, the motion supporting device 3 flashes an entire display region of the display 91 and makes the player PL aware of the presence of the advice and, thereafter, displays words, an image, and the like of the advice.

The motion supporting system 1 including such a series of functions is explained in detail below.

Configuration of the Motion Supporting System

FIG. 3 is a block diagram for explaining the schematic functions of the motion supporting system. The motion supporting system 1 includes the sensor units 10 and the motion supporting device 3. The sensor units 10 and the motion supporting device 3 are connected to be capable of transmitting and receiving data by the communication 2.

The sensor units 10A, 10B, 10C, and 10C included in the sensor units 10 are respectively attached to, for example, the implements related to the exercise such as tennis as explained above.

The sensor units 10 incorporate MEMS (Micro Electro Mechanical Systems) sensors such as an acceleration sensor, a gyro sensor, and a ball sensor, a sensor for satellite positioning such as a GPS (Global Positioning System), and a communication adapter. These sensors incorporated in the sensor units 10 are dynamic sensors attached to implements and the like to detect movements of the implements and the like.

Note that the sensor units 10 are equivalent to the detecting device.

The acceleration sensor measures, in every unit time, a change in an acceleration signal in one axial direction or at least two axial directions crossing each other. The gyro sensor measures, in every unit time, a change in an angular velocity signal about one rotation axis or at least two rotation axes crossing each other. The ball sensor is a sensor including a movable ball of a conductor in a container including a plus electrode and a ground electrode. When vibration is applied to the container, presence or absence of conduction occurs according to movement of the ball. An appearance state of the presence or absence of conduction is output as a ball-movement detection signal.

The respective MEMS sensors include AD (Analog to Digital) conversion circuits and arithmetic circuits. The MEMS sensors convert the acceleration signal, the angular velocity signal, the ball-movement detection signal detected by the MEMS sensors into acceleration data, angular velocity data, and ball-movement detection data and calculate implement dynamic data representing a momentum from the data. The data representing the momentum is calculated from the acceleration data and the angular velocity data according to a publicly-known method (see JP-A-2004-81632 and JP-A-2004-252618). The detection of the ball-movement detection signal by the ball sensor and the calculation of the data representing the momentum can be realized by a method disclosed in JP-A-2011-29014 and the like.

The implement dynamic data calculated in this way is transmitted to the motion supporting device 3 via the communication 2 by a wireless communication function (not shown in the figure) included in the sensor units 10. Note that the implement dynamic data is equivalent to the dynamic information.

The motion supporting device 3 includes the body motion detector 20, a communicator 30, a clocking section 33, the controller 40, a storage 50, and an informer 90, and the like.

As a preferred example, the body motion detector 20 is a sensor unit including an acceleration sensor. The body motion detector 20 measure, in every unit time, a change in acceleration in one axial direction or at least two axial directions crossing each other. The body motion detector 20 calculates various kinds of information concerning a body motion of the player PL using data of the change in the acceleration and outputs the information to the controller 40 as body motion data. Specifically, the body motion detector integrates an amount of the measured change of the acceleration and calculates a momentum per unit time of the player PL. The body motion detector 20 may include a gyro sensor and a sensor for satellite positioning and may be configured to be capable of discriminating and measuring a body motion of the player PL from more directions. The sensors included in the body motion detector 20 are body motion sensors attached to an organism or the like to detect a movement of the organism or the like.

Note that the body motion detector 20 is not limited to the configuration including the acceleration sensor, the gyro sensor, and the sensor for satellite positioning. The body motion sensor 20 may include a pulse sensor that detects a pulse rate of the player PL, a temperature sensor that detects information concerning an external environment, and a pressure sensor.

Note that the body motion data is equivalent to the body motion information and the body motion detector 20 is equivalent to the body-motion-information acquirer.

The communicator 30 is a near field radio adapter having a communication protocol common to the sensor units 10. The communicator 30 receives implement dynamic data transmitted from the sensor units 10. The communicator 30 distinguishes, for each of the sensor units 10A, 10B, 10C, and 10D, implement dynamic data received from the sensor units and outputs the implement dynamic data to the controller 40.

Note that the communicator 30 that receives the implement dynamic data is equivalent to the dynamic-information collector.

The clocking section 33 is a real time clock and includes clocking functions such as a clock function, a timer function, and a stopwatch function. The clocking section 33 outputs a sampling cycle to the body-motion detector 20 with the clock function and outputs time information to the body motion detector 20, the communicator 30, and the controller 40 at any time with the clock function.

The controller 40 includes a processor such as a CPU (Central Processing Unit). The controller 40 is a control device and an arithmetic unit that integrally control the sections of the motion supporting device 3. The controller 40 realizes various functions of the motion supporting device 3 according to various computer programs (not shown in the figure) including a determination program 81 and an output program 83 stored in the storage 50. Note that the controller 40 is equivalent to the computer.

The controller 40 includes functional sections such as an exercise analyzer 41, an advice generator 43, a timing determiner 45, and an advice output section 47. However, these functional sections are only examples. Not all of the functional sections are always required. The controller 40 may include functional sections other than these functional sections.

The exercise analyzer 41 analyzes an exercise state of the player PL using apart of body motion data of the player PL and implement dynamic data. The exercise state is information concerning a way of exercise, for example, what kind of movement the player PL has performed and how much different the movement has from an ideal movement. The respective kinds of information are successively generated for each kind of play. The exercise analyzer 41 successively outputs the analyzed exercise state to the advice generator 43 for each kind of play as exercise state information of the player PL. A unit of play in the exercise analyzer 41 and the advice generator 43 is, for example, one kind of play from the start to the end of each one motion such as a swing during receiving and a swing during service. Even if play belongs to the same category, types of the play may be further subdivided. For example, in the service, first service and second service may be treated as different kinds of play. In the receiving, a forehand, a backhand, a lob, a volley, a square stance, and an open stance may be treated as different kinds of play.

The advice generator 43 generates, on the basis of the exercise state information of the player PL successively output from the exercise analyzer 41, advice for play performed by the player PL. The advice generator 43 may perform invalidation and deletion processing of unnecessary advice in the past.

When generating advice for each kind of play, the advice generator 43 stores the advice in the storage 50 as files of a moving image and sound. A group of the stored files is an advice file group 70. The advice generator 43 manages the stored advice files using a management table 60. The management table 60 includes information indicating whether the advice files are valid or invalid. These kinds of information are updated by the advice generator 43.

The advice file is invalidated by the advice generator 43 in a situation in which the advice file is valid at a point in time of generation but becomes information in the past as the play progresses or the advice file is improved by the player PL before generated advice is informed to the player PL.

Processing for determining invalidation of the advice may be performed according to a method of setting a term of validity and conditions of validity when the advice is generated and invalidating the advice when the term of validity expires or the conditions of validity are not satisfied.

Processing for generating advice for the player PL from the body motion data and the implement dynamic data in the exercise analyzer 41 and the advice generator 43 is disclosed in JP-A-2013-27629.

Specific functions of the advice generator 43 are explained with reference to FIG. 4.

FIG. 4 is an explanatory diagram showing the management table and the advice file group. The management table 60 is a table for managing information related to generated advice. The management table 60 includes items of an ID 61, a validity flag 63, and a link destination 65. The ID 61 is an identifier allocated to each generated advice. The validity flag 63 is a flag representing whether advice is valid “1” or invalid “0”. The link destination 65 is link destination information to an advice file in which generated advice is stored. As the advice file group 70, a moving image A file 71, a file for oral instruction 72, a moving image B file 73, an image file 74, a word file 75, a sound file 76, and the like are illustrated. When the moving image A file 71 and the moving image B file 73 are output to the informer 90, moving images are reproduced. When the image file 74 is output to the informer 90, an image is displayed. When the sound file 76 is output to the informer 90, sound is reproduced. When the word file 75 is output to the informer 90, words are displayed on the display 91. The file for oral instruction 72 indicates that a training coach orally directly gives an instruction to the player PL. Specifically, words to the effect that “a coach gives you advice” is displayed on the display 91.

When generating an advice file as the advice file group 70 for each kind of play, the advice generator 43 adds one row to the management table 60, stores “1” in the validity flag 63 of the ID 61 in the added row, and stores link destination information of the advice file in the link destination 65.

The advice generator 43 also performs batch processing for deleting rows of the ID 61 in which the validity flag 63 is changed to invalid “0” at every predetermined interval (e.g., one-minute interval).

In this way, in the management table 60, the information is managed such that a latest advice file valid for the player PL can be always provided irrespective of at which timing the management table 60 is referred to by the advice generator 43.

Referring back to FIG. 3, the timing determiner 45 is explained.

The timing determiner 45 determines, using the implement dynamic data and the body motion data of the player PL, timing for informing advice. Specifically, the timing determiner 45 calculates a play motion indicator of the player PL using the implement dynamic data of movements of the racket RA, the racket RB, the ball BA, and the bag BG detected at predetermined time and the body motion data of the player PL. The play motion indicator is an indicator for making it possible to distinguish a state of play of the player PL, for example, whether the player PL is in a time period when the player PL is taking a rest during play. For example, the play motion indicator is an indicator for making it possible to determine that, even if there is no movement in the body motion data of the player PL, the player PL is performing play if the ball BA and the racket RA or RB are moving and determine such a state. Conversely, by analyzing the play motion indicator, it is possible to determine that a state of the player PL is a state such as a rest between play and play. Such a state is a state in which the player PL can receive advice. Timing for informing advice is included in such a period of time.

Timing determination is explained with reference to FIGS. 5A to 6B.

FIGS. 5A to 5F are explanatory diagrams concerning the timing determination. FIGS. 6A and 6B are detailed explanatory diagrams concerning the timing determination.

In graphs of FIGS. 5A to 6B, the abscissa represents time t indicating elapse of time and the ordinate represents a momentum per unit time at time t. FIG. 5A shows an momentum RA(t) at time t of the racket RA (the sensor unit 10A). Similarly, FIG. 5B shows a momentum RB(t) in the racket RB (the sensor unit 10B). FIG. 5C shows a momentum BA(t) in the ball BA (the sensor unit 10C). FIG. 5D shows a momentum BG(t) in the bag BG (the sensor unit 10D). FIG. 5E shows a momentum PL(t) at time t of the player PL. FIG. 5F shows a play motion indicator M(t) of the player PL at time t. The timing determiner 45 analyzes an increase/decrease tendency of the play motion indicator M(t) and determines timing for informing advice.

The timing determiner 45 calculates the play motion indicator M(t) according to Expression 1 described below.

M(t)=RA(t)+RB(t)+BA(t)−BG(t)+PL(t)  (Expression 1)

In the play motion indicator M(t), when one of the racket RA and the racket RB is used while the player PL is playing, when the ball BA is moving, and when the player PL is moving, RA(t), RB(t), BA(t), and PL(t) are added up. In the play motion indicator M(t), when the bag BG is used while the player PL is taking a rest, BG(t) is subtracted.

Note that Expression 1 is an example. Other arithmetic expressions can also be applied as long as the momentums RA(t), RB(t), BA(t), and PL(t) indicating a positive correlation with respect to a play motion of the player PL are added up and the momentum BG(t) indicating a negative momentum with respect to the play motion is subtracted to calculate the play motion indicator M(t).

Processing for determining timing for informing advice is explained using, as an example, a section between time t1 and time t2 and a section between time t3 and time t4 when the play motion indicator M(t) decreases in FIGS. 5A to 5F. In the section between time t1 and time t2, the timing determiner 45 determines that there is no appropriate timing for informing advice. In the section between time t3 and time t4, the timing determiner 45 determines that time t4 is timing appropriate for informing advice.

The timing determination is explained in detail with reference to FIGS. 6A and 6B.

A graph shown in FIG. 6A represents a curve Ma obtained by enlarging the play motion indicator M(t) in the section between time t1 and time t2 shown in FIG. 5F. A graph shown in FIG. 6B represents a curve Mb obtained by enlarging the play motion indicator M(t) in the section between time t3 and time t4 shown in FIG. 5F.

An inflection point CP shown in FIG. 6A is a point where a decrease tendency of the play motion indicator M(t) decreasing according to the elapse of time t is eliminated. Specifically, the timing determiner 45 calculates a differential value of the play motion indicator M(t) (a tilt of M(t) at time t), which changes according to the elapse of time t, and sets, as the inflection point CP, a point on a curve where a differential coefficient of the differential value changes from a negative value to zero or a positive value.

A predetermined period THC is a value defining a time period that elapses from the time of the inflection point CP.

A predetermined motion amount THM is a threshold for determining whether the player PL is taking a rest and is a value defining a motion amount based on the inflection point CP in the play motion indicator (the ordinate).

An evaluation point EP is a point on a curve at time when the predetermined period THC elapses from the time of the inflection point CP.

Note that, in the following explanation, the play motion indicator M(t) is abbreviated as M(t).

When M(t) of the evaluation point EP is equal to or smaller than a value obtained by adding the predetermined motion amount THM to M(t) of the inflection point CP, the timing determiner 45 determines that the player PL is taking a rest. Conversely, when M(t) of the evaluation point EP exceeds the value, the timing determiner 45 determines that the player PL is not taking a rest and has shifted to the next play.

A specific example is explained with reference to FIGS. 6A and 6B.

FIG. 6A is an example of the latter case in which it is determined that the player PL is not taking a rest and has shifted to the next play. M(t2) of the evaluation point EP on the curve Ma exceeds the value obtained by adding the predetermined motion amount THM to M(t1) of the inflection point CP. Therefore, it is determined that the player PL has shifted to the next play without taking a rest.

FIG. 6B is an example of the former case in which it is determined that the player PL is taking a rest. M(t4) of the evaluation point EP on the curve Mb is equal to or smaller than the value obtained by adding the predetermined motion amount THM to M(t3) of the inflection point CP. Therefore, it is determined that the player PL is taking a rest. Since the player PL is taking a rest, the player PL can receive advice. That is, time t4 is timing appropriate for informing advice.

At time t2 of the evaluation point EP shown in FIG. 6A, since the player PL has shifted to the next play, even if advice is generated, time t2 is inappropriate as timing for informing the advice. Time t4 of the evaluation point EP shown in FIG. 6B is appropriate as timing for informing advice. When a valid advice file is present with reference to the management table 60 at this timing, the advice is notified to the player PL.

Referring back to FIG. 3, the advice output section 47 is explained.

The advice output section 47 is a functional section executed while being triggered by timing determined by the timing determiner 45. The advice output section 47 selects a valid advice file at a point in time when the advice output section 47 is executed (the determined timing) and outputs the advice file to the informer 90. Specifically, when being executed, the advice output section 47 refers to the management table 60 and repeats the ID 61 from “1” to a last number in order. In repeated processing, when the validity flag 63 is “1”, the advice output section 47 reads a file of the link destination 65 from the advice file group 70 and outputs the read target advice file to the informer 90. When the ID 61 is repeated to the last number, all advice files valid are output at the determined timing. The player PL can check the informed files.

The storage 50 includes a storage device such as a ROM (Read Only Memory), a flash ROM, a RAM (Random Access Memory), an HDD (Hard Disk Drive), or an SSD (Solid State Drive). The storage 50 has stored therein various computer programs for realizing the functions of the controller 40, various files, and the like. The storage 50 includes a work area in which data being processed in various kinds of processing, processing results, and the like are temporarily stored.

In the storage 50, the management table 60, the advice file group 70, and the like are stored. Further, computer programs such as the determination program 81 and the output program 83 are stored.

The determination program 81 is read and executed by the controller 40, whereby the function of the timing determiner 45 included in the controller 40 is realized.

The output program 83 is a computer program invoked from the determination program 81 and executed. The output program 83 is read and executed by the controller 40, whereby the function of the advice output section 47 is realized.

Processing of the determination program 81 and the output program 83 is explained below with reference to flowcharts. Note that both of the determination program 81 and the output program 83 are equivalent to the exercise supporting program.

The informer 90 includes the display 91 and a sound output section 93.

The display 91 is a display device such as electronic paper, an LCD (Liquid Crystal Display), or an organic electroluminescence display. The display 91 performs various kinds of display based on display signals output from the advice output section 47 of the controller 40. In the display 91, the image file, the word file, the moving image file, and the like stored in the advice file group 70 are developed in a display region.

The sound output section 93 includes a speaker and a piezoelectric vibrator. The sound output section 93 is a sound output device that performs various kinds of information based on output signals input from the controller 40. The sound output section 93 performs various sound outputs based on sound signals output from the advice output section 47. The moving image file and sound data such as the sound file stored in the advice file group 70 are reproduced.

Flow of an Motion Supporting Method

An motion supporting method is explained with reference to FIGS. 7 and 8.

FIG. 7 is a flowchart for explaining a flow of timing determination processing. FIG. 8 is a flowchart for explaining a flow of advice output processing.

The flow shown in FIG. 7 is a flow of processing realized when the determination program 81 is read and executed by the controller 40. The flow shown in FIG. 8 is a flow of processing realized when the output program 83 is read and executed by the controller 40.

When FIGS. 6A and 6B are referred to as an example, the flows explain processing started from a state of a decrease tendency (the differential coefficient is a negative value) in the curve Ma and the curve Mb and finished when the inflection point CP is detected and advice is informed. Explanation of processing for determining whether the curve Ma and the curve Mb are in the state of the decrease tendency is omitted.

In step S110, the controller 40 initializes a variable CNT and a variable CX. Specifically, the variable CNT is a variable for counting a time period that elapses from the time of the inflection point CP. In this step, “0” is set as an initial state. The variable CX is a variable that makes it possible to confirm that the inflection point CP appears. In this step, “NULL” is set as an initial state. In a period from the appearance of the inflection point CP to the evaluation point EP (referred to as “inflection point processing is being performed”), content of M(t) is set in the variable CX. When the time exceeds the evaluation point EP, “NULL” is set again.

In step S120, the controller 40 acquires implement dynamic data and body motion data. Specifically, the controller 40 receives RA(t), RB(t), BA(t), and BG(t) from the sensor units 10 as the implement dynamic data at time t. The controller 40 acquires PL(t) from the body motion detector 20 as the body motion data at time t.

In step S130, the controller 40 calculates M(t) and substitutes an index value of M(t) in the variable MX. Specifically, the controller 40 calculates M(t) at time t using the above Expression 1 and substitutes M(t) in the variable MX.

In step S140, the controller 40 determines whether the inflection point processing is not being performed. Specifically, the controller 40 determines whether content of the variable CX is “NULL”. If the content of the variable CX is “NULL”, the inflection point processing is not performed (Yes), the controller 40 proceeds to step S150 in order to perform detection of a new inflection point CP. If the content of the variable CX is not “NULL”, since the inflection point processing is being performed (No), the controller 40 proceeds to step S180 in order to count a time period from the inflection point CP.

In step S150 and step S160, the controller 40 determines whether the variable MX is the inflection point CP. Specifically, the controller 40 calculates a differential coefficient at time t referring to a play-motion index value in the past such as M (t−1) used in the last loop. If the differential coefficient is zero or a positive value, the controller 40 determines that the variable MX is the inflection point CP (Yes) and proceeds to step S170. If the differential coefficient is a negative value, the controller 40 determines that the variable MX is not the inflection point CP (No) and proceeds to step S120 in order to acquire the next implement dynamic data and the next body motion data.

In step S170, the controller 40 sets the inflection point as being processed. The controller 40 sets, in the variable CX, content of the variable MX of the appeared inflection point CP. The content of M(t) is set in the variable CX. This indicates that the inflection point processing is being performed.

In step S180, the controller 40 measures a time period from the inflection point CP. Specifically, the controller 40 increments content of the variable CNT.

In step S190, the controller 40 determines whether the variable CNT is larger than the predetermined period THC. Specifically, the number of counts equivalent to a time period of the predetermined period THC is stored in the predetermined period THC. If the variable CNT exceeds the predetermined period THC (Yes), since the variable MX is the evaluation point EP, the controller 40 proceeds to step S200 and performs evaluation of the variable MX. If the variable CNT does not exceed the predetermined period THC (No), the controller 40 proceeds to step S120 in order to acquire the next implement dynamic data and the next body motion data.

In step S200, the controller 40 determines whether a difference between the variable MX and the variable CX is equal to or smaller than the predetermined motion amount THM. Specifically, when a difference amount between play motion index values of the variable CX (the inflection point CP) and the variable MX (the evaluation point EP) is equal to or smaller than the predetermined motion amount THM, the evaluation point EP is timing appropriate for informing advice. Therefore, if the difference is equal to or smaller than the predetermined motion amount THM (Yes), the controller 40 proceeds to step S210 and outputs advice. If the difference exceeds the predetermined motion amount THM (No), since the player PL has shifted to the next play, the controller 40 acquires the next implement dynamic data and the next body motion data and proceeds to step S110 in order to detect a new inflection point CP.

In step S210, the controller 40 outputs advice. Processing in step S210 is explained in detail with reference to FIG. 8.

In step S220, the controller 40 determines whether the play ends. If the player PL performs operation indicating that the play ends or there is no movement in the acquired implement dynamic data and body motion data for a fixed period, the controller 40 determines that the play ends (Yes) and ends the flow. Otherwise (No), the controller proceeds to step S110, acquires the next implement dynamic data and the next body motion data, and detects a new inflection point CP.

Referring to FIG. 8, when step S210 is executed, the controller 40 proceeds to step S310.

In step S310, the controller 40 accesses the management table. Specifically, the controller 40 reads the elements of the ID 61, the validity flag 63, and the link destination 65 into internal variables and the like from the management table 60 stored in the storage 50.

In step S320, the controller 40 repeats processing by the number of pieces of advice. Specifically, the controller 40 sets loop processing for the number of elements of the ID 61. The loop processing is repeated by the number of elements of the ID 61 from step 320 to step S360.

In step S330, the controller 40 acquires the validity flag 63 and stores the validity flag 63 in a variable FL. The variable FL is an internal variable in which the validity flag 63 is temporarily stored. The controller 40 acquires content (“1” or “0”) of the validity flag 63 and sets the content in the variable FL.

In step S340, the controller 40 determines whether the variable FL is larger than 0. Specifically, if content of the variable FL is a value larger than 0 such as “1” (Yes), the controller 40 proceeds to step S350 in order to inform an advice file of the link destination 65. If the content of the variable FL is a value equal to or smaller than 0 such as “0” (No), the controller 40 proceeds to step S360 in order to process the next advice without informing target advice.

In step S350, the controller 40 outputs the advice file of the link destination 65. Specifically, the controller 40 designates the advice file shown in the link destination 65 and outputs the advice file to the informer 90. The informer 90 performs an output corresponding to a type of the advice file.

In step S360, the controller 40 ends the processing when the processing is repeated by the number of pieces of advice. The controller 40 returns to step S320 and repeats the processing until the processing is repeated by the number of pieces of advice.

As explained above, with the motion supporting system 1 according to this embodiment, it is possible to obtain effects explained below.

The motion supporting system 1 includes dynamic sensors indicated by the dynamic sensors (the sensor units 10) and acquires implement dynamic data. The motion supporting system 1 acquires body motion data of the player PL with the body motion sensor (the body motion detector 20) of the motion supporting device 3.

The timing determiner 45 calculates the play motion indicator M(t) from the implement dynamic data and the body motion data. The timing determiner 45 analyzes an increase/decrease tendency of the play motion indicator M(t). If an increase or a decrease in the play motion indicator M(t) is equal to or smaller than the predetermined motion amount THM after the elapse of the predetermined period THC from the inflection point CP, the controller 40 determines that the player PL is taking a rest and can receive advice. The motion supporting system 1 determines that the timing is timing for informing the player PL of advice.

On the other hand, advice information for the player PL is generated by the advice generator 43. Like the timing determiner 45, the advice generator 43 acquires implement dynamic data and body motion data, generates, on a real time basis, advice information for the player PL, and manages latest advice information to be capable of being referred to using the management table 60.

The timing determiner 45 acquires, at the determined timing, advice for the player PL referring to the management table 60 and outputs the advice to the informer 90.

In this way, it is possible to inform the player PL, who is playing exercise such as sports, of advice at appropriate timing.

Second Embodiment

FIG. 9 is a block configuration diagram showing the schematic configuration of an motion supporting system in a second embodiment. An motion supporting system 101 according to this embodiment is explained with reference to the figure. In embodiments explained below, components same as the components in the first embodiment are denoted by the same reference numerals and signs. Redundant explanation of the components is omitted.

The motion supporting system 101 includes the sensor units 10 functioning as detecting devices, an motion supporting device 103, and a terminal device 105.

In the motion supporting system 101, the player PL wears the terminal device 105. An instructor CO such as a coach, who trains the player PL, uses the motion supporting device 103.

The terminal device 105 includes the body motion detector 20, the communicator 30, and the informer 90. The terminal device 105 measures body motion data of the player PL and transmits the body motion data to the motion supporting device 103 via the communicator 30. The communicator 30 of the terminal device 105 stays on standby to be capable of receiving advice information transmitted from the motion supporting device 103. When the advice information is transmitted to the communicator 30, the communicator 30 immediately receives the advice information and outputs the advice information to the informer 90. The informer 90 informs the advice information at timing when the advice information is transmitted from the motion supporting device 103.

Note that the body motion detector 20 is equivalent to the body-motion-information acquirer.

The motion supporting device 103 includes the communicator 30, the controller 40, and the storage 50. The controller 40 and the storage 50 include the exercise analyzer 41, the advice generator 43, the timing determiner 45, the advice output section 47, the management table 60, the advice file group 70, the determination program 81, and the output program 83. The motion supporting device 103 receives implement dynamic data from the sensor units 10, receives body motion data of the player PL from the terminal device 105, and determines appropriate timing in order to inform the player PL of advice information. When valid advice information is present at the determined timing, the motion supporting device 103 transmits the advice information to the terminal device 105.

According to this embodiment, it is possible to obtain effects explained below in addition to the effects in the first embodiment.

Since the instructor CO of the player PL uses the motion supporting device 103, when the instructor CO directly gives an instruction to the player PL, the instructor CO can directly input the instruction to the motion supporting device 103 and transmit the instruction to the player PL. Therefore, the player PL does not need to go to the instructor CO and ask for instruction every time. The player PL can check advice information through the terminal device 105.

Third Embodiment

FIG. 10 is a block configuration diagram showing the schematic configuration of an motion supporting system in a third embodiment.

In the embodiments explained above, the sensors are attached to the implements and the player PL in order to acquire implement dynamic data and body motion data. However, the invention is not limited to the configuration of the embodiments. The informer 90 informs advice information on the device worn by the player PL. However, the invention is not limited to the configuration of the embodiments. In this embodiment, an example corresponding to such a form is explained.

An motion supporting system 201 includes a detecting device 204, an motion supporting device 203, and a display device 205. The detecting device 204, the motion supporting device 203, and the display device 205 are connected to one another to be capable of communicating data by communication 202.

The detecting device 204 includes a dynamic detector 210, a body motion detector 220, and a communicator 230. The dynamic detector 210 and the body motion detector 220 include image pickup devices such as CCDs (Charge Coupled Devices). The dynamic detector 210 and the body motion detector 220 analyze image signals picked up by the image pickup devices and detect, at every fixed interval (e.g., twice per one second), motion states of movements of the implements and the player PL. The dynamic detector 210 and the body motion detector 220 transmit the detected motion states to the motion supporting device 203 via the communicator 230 as implement dynamic data and body motion data of the player PL.

The motion supporting device 203 includes the controller 40, the storage 50, and the communicator 230. The motion supporting device 203 determines appropriate timing from the implement dynamic data and the body motion data acquired at every fixed interval via the communicator 230 in order to inform the player PL of advice information. When valid advice information is present at the determined timing, the motion supporting device 203 transmits the valid advice information to the display device 205 via the communicator 230.

The display device 205 includes an informer 290 and the communicator 230. The display device 205 is, for example, a projector that displays an image on a large screen. The display device 205 stays on standby to be capable of receiving information transmitted from the motion supporting device 203. When receiving advice information for the player PL, the display device 205 outputs the advice information to a display such as a screen of the projector.

The communicators 230 provided in the respective devices are communication adapters having a common communication protocol. The communicators 230 include, for example, wireless or wired LAN (Local Area Network) adapters, USB (Universal Serial Bus) adapters, or BlueTooth (registered trademark) adapters.

According to this embodiment, it is possible to obtain effects explained below in addition to the effects in the embodiments explained above.

In the motion supporting system 201, since it is unnecessary to attach the devices to the implements and the player PL, preparation for attaching the devices before playing sports is unnecessary. Since the advice information is displayed on the large screen or the like, there is an effect that the advice information easily comes into view of the player PL and is easily transmitted to the player PL.

Such an motion supporting system 201 is relatively easily applied and effective in squash rackets and sports in amusement facilities such as a bowling alley.

Note that the invention is not limited to the embodiments. Various changes, improvements, and the like can be added to the embodiments. Modifications are explained below.

Modification 1

In the embodiments, the timing determiner 45 calculates the play motion indicator M(t) according to Expression 1. However, an expression for calculating the play motion indicator M(t) is not limited to this expression. The play motion indicator M(t) reflecting movements of the implements and the player PL only has to be calculated. For example, the expression may be Expression 2 explained below.

M(t)=a1×(RA(t)+RB(t))/2+a2×BA(t)−a3×BG(t)+a4×PL(t)  (Expression 2)

In Expression 2, a1, a2, a3, and a4 are coefficients set according to a dynamic state of the implements and a body motion state of the player PL. For example, larger values are set for elements having larger influence than the other elements.

By using such Expression 2, the timing determiner 45 can more accurately detect a situation in which the player PL is taking a rest.

RA(t), RB(t), BA(t), BG(t), and PL(t) referred to in the above Expression 1, Expression 2, and the like are the momentums obtained by detecting the respective motions at time t. However, a moving average calculated on the basis of momentums in the past including time t may be used.

By using the moving average, it is possible to calculate the play motion indicator M(t) according to data in which detection values such as sudden noise are attenuated.

Modification 2

In the embodiments and the modification explained above, the validity flag 63 of the management table 60 includes the data of validity “1” and invalidity “0”. However, data of the validity flag 63 is not limited to such data. For example, it is also possible that invalidity is set as “0”, an integer equal to or larger than “1” is used as information representing validity, and meaning of ordering of informing the player PL of advice may be given using the magnitude of an integer value.

With such a configuration, it is possible to inform important advice information among a plurality of kinds of advice information earlier than the other kinds of information. It is possible to surely transmit more important advice to the player PL.

Modification 3

The body motion detectors 20 and 220 in the embodiments and the modifications explained above may include various sensors such as a pulse sensor, a strain gauge, a thermometer, a clinical thermometer, a piezoelectric sensor, an atmospheric pressure sensor, a manometer, an electrochemical sensor, and a vibrometer. Information concerning a motion and a momentum of the player PL output from the sensors may be used as body motion data of the player PL. Further, mental data (presence or absence of vitality, etc.) of the player PL may be added to the calculation of the play motion indicator M(t) using pulse interval data of pulse data.

Modification 4

The informers 90 and 290 in the embodiments and the modifications explained above may be provided in general-purpose information processing terminals such as a smartphone, a tablet terminal, an HMD (head mounted display), and a notebook PC.

Modification 5

In the embodiments and the modifications explained above, tennis is explained as an example of sports in which exercise implements are used. However, the sports are not limited to tennis. The invention is applicable to any sports. For example, the invention is applicable to various sports such as team sports such as baseball, softball, soccer, rugby, and volleyball and individual competition sports such as table tennis, badminton, golf, swimming, horse riding, and bowling. Play of the respective sports is not limited to play during a game and is applicable in various scenes such as a scene in which a player practices sports while checking a form and a scene in which a player enjoys and plays a hobby and a game.

The entire disclosure of Japanese Patent Application No. 2015-081497, filed Apr. 13, 2015 is expressly incorporated by reference herein.

Claims

1. An motion supporting device comprising:

a body-motion-information acquirer configured to acquire body motion information of an exercising player;

a dynamic-information collector configured to collect dynamic information of an implement related to the exercise; and

a timing determiner configured to determine, on the basis of the body motion information and the dynamic information, timing for informing the player of advice.

2. The motion supporting device according to claim 1, wherein

the body-motion-information acquirer includes a body motion sensor worn on a body of the player, and

the body motion sensor measures the body motion information of the player.

3. The motion supporting device according to claim 2, wherein the body motion information includes at least one of acceleration information and angular velocity information generated according to a movement of the player.

4. The motion supporting device according to claim 1, wherein

the dynamic-information collector includes a sensor unit including at least one of an acceleration sensor, an angular velocity sensor, a ball sensor, and a positioning sensor attached to the implement, and

the sensor unit collects the dynamic information.

5. The motion supporting device according to claim 1, wherein the timing determiner calculates a play motion indicator serving as an indicator of a play motion of the player on the basis of the dynamic information and the body motion information and determines the timing on the basis of an increase/decrease tendency of the play motion indicator.

6. The motion supporting device according to claim 5, wherein the play motion indicator is calculated by adding the dynamic information and the body motion information having a positive correlation to the play motion of the player and by subtracting the dynamic information having a negative correlation to the play motion of the player.

7. The motion supporting device according to claim 5, wherein the timing determiner detects an inflection point, which is a point in time when the increase/decrease tendency of the play motion indicator changes from a decrease tendency to an increase tendency and, when the play motion indicator after elapse of a predetermined period from the inflection point is equal to or smaller than a predetermined motion amount, determines that it is the timing for informing the advice.

8. The motion supporting device according to claim 6, wherein the timing determiner detects an inflection point, which is a point in time when the increase/decrease tendency of the play motion indicator changes from a decrease tendency to an increase tendency and, when the play motion indicator after elapse of a predetermined period from the inflection point is equal to or smaller than a predetermined motion amount, determines that it is the timing for informing the advice.

9. The motion supporting device according to claim 1, further comprising:

an informer configured to inform the advice; and

an advice output section configured to output the advice to the informer, wherein

the advice output section selects a valid advice at the timing determined by the timing determiner out of generated pieces of advice and outputs the valid advice to the informer.

10. An motion supporting method comprising:

acquiring body motion information of an exercising player;

collecting dynamic information of an implement related to the exercise;

determining, on the basis of the body motion information and the dynamic information, timing for informing the player of advice; and

selecting a valid advice at the timing and informing the player of the effecting advice.

11. A storage medium having stored therein a computer program for causing a computer to execute:

acquiring body motion information of an exercising player;

collecting dynamic information of an implement related to the exercise;

determining, on the basis of the body motion information and the dynamic information, timing for informing the player of advice; and

selecting a valid advice at the timing and informing the player of the effecting advice.

12. An motion supporting system comprising:

the motion supporting device according to claim 1;

an informer configured to inform the advice; and

an advice output section configured to select a valid advice at the timing out of generated pieces of advice and output the valid advice to the informer.

13. An motion supporting system comprising:

the motion supporting device according to claim 2;

an informer configured to inform the advice; and

an advice output section configured to select a valid advice at the timing out of generated pieces of advice and output the valid advice to the informer.

14. An motion supporting system comprising:

the motion supporting device according to claim 3;

an informer configured to inform the advice; and

an advice output section configured to select a valid advice at the timing out of generated pieces of advice and output the valid advice to the informer.

15. The motion supporting system according to claim 12, further comprising a detecting device configured to detect the dynamic information.

16. The motion supporting system according to claim 12, further comprising a terminal device mounted with the body-motion-information acquirer and the informer.

17. The motion supporting system according to claim 12, further comprising a display device mounted with the informer.

18. An motion supporting device that acquires body motion information of an exercising player, collects dynamic information of an implement related to the exercise, and determines, on the basis of the body motion information and the dynamic information, timing for informing the player of advice.

19. The motion supporting device according to claim 18, wherein the body motion information is measured by a body motion sensor worn on the player.

20. The motion supporting device according to claim 19, wherein the body motion information includes at least one of acceleration information and angular velocity information generated according to a movement of the player.