Input apparatus, control apparatus, control system, and control method
An input apparatus includes a sensor, a calculation section, and a transmission section. The sensor detects a movement of the input apparatus and outputs a detection signal corresponding to the movement of the input apparatus. The calculation section calculates a corresponding value that corresponds to a movement of an image displayed on a screen in a predetermined calculation cycle, the corresponding value corresponding to the detection signal. The transmission section transmits the corresponding value in a transmission cycle shorter than the calculation cycle.
Latest Sony Corporation Patents:
- POROUS CARBON MATERIAL COMPOSITES AND THEIR PRODUCTION PROCESS, ADSORBENTS, COSMETICS, PURIFICATION AGENTS, AND COMPOSITE PHOTOCATALYST MATERIALS
- POSITIONING APPARATUS, POSITIONING METHOD, AND PROGRAM
- Electronic device and method for spatial synchronization of videos
- Surgical support system, data processing apparatus and method
- Information processing apparatus for responding to finger and hand operation inputs
The present application contains subject matter related to that disclosed in Japanese Priority Patent Application JP 2008-214194 filed in the Japan Patent Office on Aug. 22, 2008, the entire content of which is hereby incorporated by reference.
BACKGROUNDThe present invention relates to a 3-dimensional operation input apparatus for operating a GUI (Graphical User Interface), a control apparatus for controlling the GUI in accordance with information transmitted from the input apparatus, a control system including those apparatuses, and a control method.
Pointing devices, particularly a mouse and a touchpad, are used as controllers for GUIs widely used in PCs (Personal Computers). Not just as HIs (Human Interfaces) of PCs as in related art, the GUIs are now starting to be used as an interface for AV equipment and game devices used in living rooms etc. with, for example, televisions as image media. Various input apparatuses that a user is capable of operating 3-dimensionally are proposed as controllers for the GUIs of this type (see, for example, Japanese Patent Application Laid-open No. 2001-56743 (paragraphs [0030] and [0045], FIG. 2) and Japanese Patent No. 3,748,483 (paragraphs [0098] to [0103], FIGS. 7 and 8), hereinafter, referred to as Patent Document 1 and Patent Document 2, respectively).
Patent Document 1 discloses an input apparatus including angular velocity gyroscopes of two axes, that is, two angular velocity sensors. When a user holds the input apparatus in hand and swings it vertically and laterally, for example, the angular velocity sensors detect angular velocities about two orthogonal axes, and a command signal as positional information of a cursor (pointer) or the like displayed by a display means is generated in accordance with the angular velocities. The command signal is transmitted to a control apparatus, and the control apparatus controls display so that the cursor moves on a screen in response to the command signal.
Patent Document 2 discloses a pen-type input apparatus including three (triaxial) acceleration sensors and three (triaxial) angular velocity sensors (gyro). The pen-type input apparatus executes various operations based on signals obtained by the three acceleration sensors and three angular velocity sensors, to thus calculate and output a positional angle of the pen-type input apparatus. Alternatively, the pen-type input apparatus executes various operations to calculate and output movement amounts at a pen tip of the pen-type input apparatus.
SUMMARYAs described above, in the pen-type input apparatus disclosed in Patent Document 2, the movement amounts at the pen tip of the input apparatus are calculated by executing various operations based on six signals obtained by the three angular velocity sensors and three acceleration sensors. Therefore, there is a problem that an operation up to calculating the movement amounts of the input apparatus becomes complex and a time required for calculating the movement amounts is thus prolonged. Prolongation of the time up to calculating the movement amounts leads to prolongation of a cycle in which the input apparatus outputs information on the next movement amounts since having output information on the previous movement amounts.
Prolongation of the cycle of outputting information on the movement amounts leads to prolongation of a cycle in which a control apparatus receives the information on the movement amounts. For example, the control apparatus plots an image so that a pointer on a screen moves in accordance with the movement amounts every time the information on the movement amounts is received. Therefore, prolongation of a reception cycle of the movement amounts results in prolongation of a cycle of starting next plotting so as to move the pointer since having plotted last time to move the pointer. Consequently, there arises a problem that display cannot be made so as to smoothly move the pointer on the screen.
Here, the problem that the time required for calculating the movement amounts is prolonged may be caused by factors other than complexity of the operation of the input apparatus. For example, in a case where an inexpensive control system having low throughput is used for competitively pricing the input apparatus, a time required for calculating movement amounts may become long, with the result that display cannot be made to smoothly move a pointer on a screen as in the above case.
Moreover, in a case where processing of scroll, zoom, or the like of an image displayed on a screen is executed based on movement amounts of the input apparatus, for example, the scroll, zoom, or the like of the image displayed on the screen cannot be displayed smoothly when the cycle of calculating movement amounts is prolonged.
In view of the circumstances as described above, there is a need for an input apparatus, a control apparatus, a control system, and a control method that are capable of making a movement of an image smooth.
According to an embodiment, there is provided an input apparatus including a sensor, a calculation means, and a transmission section.
The sensor detects a movement of the input apparatus and outputs a detection signal corresponding to the movement of the input apparatus.
The calculation means calculates a corresponding value that corresponds to a movement of an image displayed on a screen in a predetermined calculation cycle, the corresponding value corresponding to the detection signal.
The transmission section transmits the corresponding value in a transmission cycle shorter than the calculation cycle.
The “image displayed on a screen” refers to an image displayed on a full screen or a part of the screen. The “image” includes a pointer and images including letters and figures. Examples of the “movement of the image” include a movement of a pointer, scroll of an image, zoom of an image, rotation of an image, and other movements.
In an embodiment, information on the corresponding value is transmitted in a cycle shorter than a cycle of calculating the corresponding value. Accordingly, even when the calculation cycle is prolonged, display can be made to smoothly move the image on the screen. In addition, since an inexpensive control system can be used for the input apparatus, costs can be reduced.
The input apparatus may further include a memory and an update means.
The memory stores the calculated corresponding value.
The update means updates the corresponding value stored in the memory every time the corresponding value is calculated.
In this case, the transmission section may read and transmit the corresponding value stored in the memory in the transmission cycle.
For example, in a case where the corresponding value is calculated by a complex operation, the calculation cycle may fluctuate more or less. In an embodiment, since the transmission section reads and transmits the corresponding value stored in the memory in a regular transmission cycle even when the calculated corresponding value is stored in the memory in a somewhat irregular cycle, the input apparatus can maintain a regular transmission cycle.
The input apparatus may further include a judgment means and a restriction means.
The judgment means judges whether the corresponding value is equal to or smaller than a predetermined threshold value.
The restriction means restricts the transmission of the corresponding value when the corresponding value is equal to or smaller than the predetermined threshold value.
In an embodiment, the “threshold value” is 0 or a value close to 0. Moreover, the corresponding value judged by the judgment means is typically an absolute value.
When the input apparatus transmits information on the corresponding value by wireless communication, there is a problem that power consumption thereof is large. When the corresponding value is 0 or a value close to 0, for example, even when the corresponding value is transmitted, the image does not move or hardly moves on the screen. Therefore, necessity of the input apparatus to transmit the corresponding value is low. In the embodiment of the present invention, since the transmission of the corresponding value is restricted when the corresponding value is 0 or almost 0, power saving of the input apparatus can be realized.
According to another embodiment, there is provided an input apparatus including a sensor, a transmission section, and a cycle control means.
The sensor detects a movement of the input apparatus and outputs a detection signal corresponding to the movement of the input apparatus.
The transmission section transmits a corresponding value that corresponds to a movement of an image displayed on a screen in a predetermined transmission cycle, the corresponding value corresponding to the detection signal.
The cycle control means variably controls the transmission cycle.
In an embodiment, by variably controlling the transmission cycle, power consumption of the input apparatus can be reduced appropriately without the user feeling awkwardness regarding smoothness of the movement of the image displayed on the screen.
In the input apparatus, the cycle control means may variably control the transmission cycle in accordance with the corresponding value.
The input apparatus may further include a judgment means.
The judgment means judges whether the corresponding value is equal to or smaller than a predetermined threshold value.
In this case, the cycle control means controls the transmission cycle to be prolonged when the corresponding value is equal to or smaller than the predetermined threshold value.
In an embodiment, the “threshold value” is a value in a range in which a user does not feel awkwardness regarding the smoothness of the movement of the image. Moreover, the corresponding value judged by the judgment means is typically an absolute value.
For example, if the cycle of plotting the movement of the image on the screen is long when the corresponding value is large, human beings tend to feel awkwardness regarding the smoothness of the movement of the image. On the other hand, if the cycle of plotting the image on the screen is short when the corresponding value is small, human beings hardly feel awkwardness regarding the smoothness of the movement of the image.
This embodiment uses this relationship and prolongs the transmission cycle when the corresponding value is small. Accordingly, power consumption of the input apparatus can be reduced appropriately without the user feeling awkwardness regarding the smoothness of the movement of the image.
In the input apparatus, the cycle control means may control the transmission cycle to be prolonged as the corresponding value decreases when the corresponding value is equal to or smaller than the predetermined threshold value.
The cycle control means may prolong the transmission cycle stepwise or linear-functionally as the corresponding value decreases when the corresponding value is equal to or smaller than the predetermined threshold value. Alternatively, the cycle control means may prolong the transmission cycle by a multi-degree function or exponentially.
Accordingly, power consumption of the input apparatus can be reduced appropriately without the user feeling awkwardness regarding the smoothness of the movement of the image.
In the input apparatus, the judgment means may judge whether the corresponding value is equal to or smaller than 0 or a value close to 0.
In this case, the cycle control means may control the transmission cycle to become infinite when the corresponding value is equal to or smaller than 0 or a value close to 0.
In an embodiment, the threshold value is 0 or a value close to 0.
When the corresponding value is 0 or a value close to 0, for example, even when the corresponding value is transmitted, the image does not move or hardly moves on the screen. Therefore, necessity of the input apparatus to transmit the corresponding value is low. In the embodiment of the present invention, since the transmission cycle is set to be infinite and the transmission of the corresponding value is restricted when the corresponding value is 0 or almost 0, power consumption of the input apparatus can be reduced.
The input apparatus may further include a judgment means.
The judgment means judges whether the corresponding value is equal to or larger than a predetermined threshold value.
In this case, the cycle control means controls the transmission cycle to be prolonged when the corresponding value is equal to or larger than the predetermined threshold value.
In the embodiment of the present invention, the “threshold value” is a value in a range in which a user does not feel awkwardness regarding the smoothness of the movement of the image. Moreover, the corresponding value judged by the judgment means is typically an absolute value.
For example, in a case where the movement of the image is extremely large, even if the cycle of plotting the movement of the image is long, human beings hardly feel awkwardness regarding the smoothness of the movement of the image. Alternatively, it may be imperceptible since the movement of the image is too fast.
This embodiment uses this relationship and controls the transmission cycle to be prolonged when the corresponding value is equal to or larger than the threshold value. Accordingly, since the transmission cycle is prolonged when the movement of the image is extremely fast, power consumption of the input apparatus can be reduced appropriately without the user feeling awkwardness regarding the smoothness of the movement of the image.
In the input apparatus, the cycle control means may control the transmission cycle to be prolonged as the corresponding value increases when the corresponding value is equal to or larger than the predetermined threshold value.
The cycle control means may prolong the transmission cycle stepwise or linear-functionally as the corresponding value increases when the corresponding value is equal to or larger than the predetermined threshold value. Alternatively, the cycle control means may prolong the transmission cycle by a multi-degree function or exponentially.
Accordingly, power consumption of the input apparatus can be reduced appropriately without the user feeling awkwardness regarding the smoothness of the movement of the image.
According to an embodiment, there is provided a control apparatus including a reception section and a display control means.
The reception section receives a corresponding value that corresponds to a movement of an image displayed on a screen in a predetermined reception cycle.
The display control means controls display of the screen so that the movement of the image is plotted in accordance with the corresponding value in a plotting cycle shorter than the reception cycle.
In an embodiment, the movement of the image can be plotted in a plotting cycle shorter than the reception cycle. Accordingly, the image can be displayed so as to smoothly move on the screen even when the reception cycle becomes long.
The control apparatus may further include a memory and an update means.
The memory stores the received corresponding value.
The update means updates the corresponding value stored in the memory every time the corresponding value is received.
In this case, the display control means controls the display of the screen so that the movement of the image is plotted in the plotting cycle in accordance with the corresponding value stored in the memory during a period from a time when the corresponding value is received to a time when the next corresponding value is received.
The control apparatus may further include a curve calculation means.
The curve calculation means calculates a regression curve based on the corresponding value stored in the memory.
In this case, the display control means controls the display of the screen so that the movement of the image is plotted in accordance with the regression curve.
Accordingly, the movement of the image on the screen can be made smoother.
The control apparatus may further include a count means and a time judgment means.
The count means counts a time from the time when the corresponding value is received to the time when the next corresponding value is received.
The time judgment means judges whether the time is equal to or longer than a predetermined time.
In this case, the display control means controls the display of the screen so that the movement of the image on the screen is stopped when the time is equal to or longer than the predetermined time.
In the embodiment of the present invention, the movement of the image is stopped when the time from the reception of the corresponding value to the reception of the next corresponding value is equal to or longer than the predetermined time. Accordingly, it is possible to prevent the control apparatus from moving the image continuously in accordance with the corresponding value stored in the memory even when the transmission of the corresponding value from the input apparatus is stopped.
According to another embodiment of the present invention, there is provided a control apparatus including a reception section, a display control means, and a cycle control means.
The reception section receives a corresponding value that corresponds to a movement of an image displayed on a screen.
The display control means controls display of the screen so that the movement of the image is plotted in accordance with the corresponding value in a predetermined plotting cycle.
The cycle control means variably controls the plotting cycle.
Accordingly, the movement of the image can be plotted smoothly without the user feeling awkward.
In the control apparatus, the cycle control means may variably control the plotting cycle in accordance with the corresponding value.
The control apparatus may further include a judgment means.
The judgment means judges whether the corresponding value is equal to or smaller than a predetermined threshold value.
In this case, the cycle control means controls the plotting cycle to be prolonged when the corresponding value is equal to or smaller than the predetermined threshold value.
In the embodiment of the present invention, the “threshold value” is a value in a range in which a user does not feel awkwardness regarding the smoothness of the movement of the image. Moreover, the corresponding value judged by the judgment means is typically an absolute value.
Accordingly, the movement of the image can be plotted smoothly without the user feeling awkward.
In the control apparatus, the cycle control means may control the plotting cycle to be prolonged as the corresponding value decreases when the corresponding value is equal to or smaller than the predetermined threshold value.
Accordingly, the movement of the image can be plotted smoothly without the user feeling awkward.
In the control apparatus, the judgment means may judge whether the corresponding value is equal to or smaller than 0 or a value close to 0.
In this case, the cycle control means may control the plotting cycle to become infinite when the corresponding value is equal to or smaller than 0 or a value close to 0.
The control apparatus may further include a judgment means.
The judgment means judges whether the corresponding value is equal to or larger than a predetermined threshold value.
In this case, the cycle control means controls the plotting cycle to be prolonged when the corresponding value is equal to or larger than the predetermined threshold value.
In the embodiment of the present invention, the “threshold value” is a value in a range in which a user does not feel awkwardness regarding the smoothness of the movement of the image. Moreover, the corresponding value judged by the judgment means is typically an absolute value.
Accordingly, the movement of the image can be plotted smoothly without the user feeling awkward.
In the control apparatus, the cycle control means may control the plotting cycle to be prolonged as the corresponding value increases when the corresponding value is equal to or larger than the predetermined threshold value.
Accordingly, the movement of the image can be plotted smoothly without the user feeling awkward.
According to an embodiment of the present invention, there is provided a control system including an input apparatus and a control apparatus.
The input apparatus includes a sensor, a calculation means, and a transmission section.
The sensor detects a movement of the input apparatus and outputs a detection signal corresponding to the movement of the input apparatus.
The calculation means calculates a corresponding value that corresponds to a movement of an image displayed on a screen in a predetermined calculation cycle, the corresponding value corresponding to the detection signal.
The transmission section transmits the corresponding value in a transmission cycle shorter than the calculation cycle.
The control apparatus includes a reception section and a display control means.
The reception section receives the transmitted corresponding value.
The display control means controls display of the screen so that the movement of the image is plotted in accordance with the corresponding value.
According to another embodiment of the present invention, there is provided a control system including an input apparatus and a control apparatus.
The input apparatus includes a sensor, a transmission section, and a cycle control means.
The sensor detects a movement of the input apparatus and outputs a detection signal corresponding to the movement of the input apparatus.
The transmission section transmits a corresponding value that corresponds to a movement of an image displayed on a screen in a predetermined transmission cycle, the corresponding value corresponding to the detection signal.
The cycle control means variably controls the transmission cycle.
The control apparatus includes a reception section and a display control means.
The reception section receives the transmitted corresponding value,
The display control means controls display of the screen so that the movement of the image is plotted in accordance with the corresponding value.
According to another embodiment, there is provided a control system including an input apparatus and a control apparatus.
The input apparatus includes a sensor and a transmission section.
The sensor detects a movement of the input apparatus and outputs a detection signal corresponding to the movement of the input apparatus.
The transmission section transmits a corresponding value that corresponds to a movement of an image displayed on a screen, the corresponding value corresponding to the detection signal.
The control apparatus includes a reception section and a display control means.
The reception section receives the transmitted corresponding value in a predetermined reception cycle.
The display control means controls display of the screen so that the movement of the image is plotted in accordance with the corresponding value in a plotting cycle shorter than the reception cycle.
According to another embodiment, there is provided a control system including an input apparatus and a control apparatus.
The input apparatus includes a sensor and a transmission section.
The sensor detects a movement of the input apparatus and outputs a detection signal corresponding to the movement of the input apparatus.
The transmission section transmits a corresponding value that corresponds to a movement of an image displayed on a screen, the corresponding value corresponding to the detection signal.
The control apparatus includes a reception section, a display control means, and a cycle control means.
The reception section receives the transmitted corresponding value.
The display control means controls display of the screen so that the movement of the image is plotted in accordance with the corresponding value in a predetermined plotting cycle.
The cycle control means variably controls the plotting cycle.
According to an embodiment, there is provided a control method including detecting a movement of an input apparatus and outputting a detection signal corresponding to the movement of the input apparatus.
A corresponding value that corresponds to a movement of an image displayed on a screen is calculated in a predetermined calculation cycle, the corresponding value corresponding to the output detection signal.
The corresponding value is transmitted in a transmission cycle shorter than the calculation cycle.
According to another embodiment of the present invention, there is provided a control method including detecting a movement of an input apparatus and outputting a detection signal corresponding to the movement of the input apparatus.
A corresponding value that corresponds to a movement of an image displayed on a screen is transmitted in a predetermined transmission cycle, the corresponding value corresponding to the output detection signal.
The transmission cycle is controlled variably.
According to another embodiment, there is provided a control method including receiving a corresponding value that corresponds to a movement of an image displayed on a screen in a predetermined reception cycle.
Display of the screen is controlled so that the movement of the image is plotted in accordance with the corresponding value in a plotting cycle shorter than the reception cycle.
According to another embodiment, there is provided a control method including receiving a corresponding value that corresponds to a movement of an image displayed on a screen.
Display of the screen is controlled so that the movement of the image is plotted in accordance with the corresponding value in a predetermined plotting cycle.
The plotting cycle is controlled variably.
In the descriptions above, elements described as “ . . . means” may be realized by hardware or both software and hardware. When the elements are realized by both software and hardware, the hardware includes at least a storage device for storing software programs.
Typically, hardware is structured by selectively using at least one of a CPU (Central Processing Unit), an MPU (Micro Processing Unit), a RAM (Random Access Memory), a ROM (Read Only Memory), a DSP (Digital Signal Processor), an FPGA (Field Programmable Gate Array), an ASIC (Application Specific Integrated Circuit), a NIC (Network Interface Card), a WNIC (Wireless NIC), a modem, an optical disc, a magnetic disc, and a flash memory.
As described above, according to the embodiments of the present invention, an input apparatus, a control apparatus, a control system, and a control method that are capable of making a movement of an image smooth can be provided.
Additional features and advantages are described herein, and will be apparent from the following Detailed Description and the figures.
The present application will be described with reference to the drawings according to an embodiment.
Typically, the buttons 11 and 12 are each a press-type button, and push buttons or capacitance-type touch buttons are used. However, the operation section 23 is not limited thereto, and a bar-type operation section 23 that is operated with one end as a fulcrum or a slide-type operation section 23 may be used instead.
The button 11 has a function corresponding to a left button of a mouse as an input device used for a PC, and the button 12 adjacent to the button 11 has a function corresponding to a right button of a mouse, for example. For example, an operation of selecting an icon 4 (see
The input apparatus 1 includes a sensor unit 17, a control unit 30, and batteries 14.
The sensor unit 17 further includes an angular velocity sensor unit 15 for detecting angular accelerations about the two orthogonal axes. Specifically, the angular velocity sensor unit 15 includes two sensors, that is, a first angular velocity sensor 151 and a second angular velocity sensor 152. The acceleration sensor unit 16 and the angular velocity sensor unit 15 are packaged and mounted on a circuit board 25.
As each of the first and second angular velocity sensors 151 and 152, a vibration gyro sensor for detecting Coriolis force in proportion to an angular velocity is used. As each of the first and second acceleration sensors 161 and 162, any sensor such as a piezoresistive sensor, a piezoelectric sensor, or a capacitance sensor may be used. The angular velocity sensors 151 and 152 are not limited to the vibration gyro sensor, and a rotary top gyro sensor, a ring laser gyro sensor, a gas rate gyro sensor, and the like may also be used.
In descriptions on
The control unit 30 includes a main substrate 18, an MPU 19 (Micro Processing Unit) (or CPU) mounted on the main substrate 18, a crystal oscillator 20, a transceiver 21, and an antenna 22 printed on the main substrate 18.
The MPU 19 includes a built-in volatile or nonvolatile memory requisite therefor. The MPU 19 is input with a detection signal from the sensor unit 17, an operation signal from the operation section 23, and the like, and executes various kinds of operational processing in order to generate predetermined control signals (commands) in response to those input signals. The memory may be provided separate from the MPU 19.
Typically, the MPU 19 generates, as the control signals, a movement command corresponding to a detection signal detected by the sensor unit 17 and an operation command corresponding to an operation signal output from the operation section.
Typically, the MPU 19 generates, as the control signals, a movement command corresponding to a detection signal detected by the sensor unit 17 and an operation command corresponding to an operation signal output from the operation section.
Typically, the sensor unit 17 outputs analog signals. In this case, the MPU 19 includes an A/D (Analog/Digital) converter. Alternatively, the sensor unit 17 may be a unit that includes the A/D converter.
The transceiver 21 transmits, as RF radio signals, a control signal generated in the MPU 19 to the control apparatus 40 via the antenna 22.
The crystal oscillator 20 generates clocks and supplies them to the MPU 19. As the batteries 14, dry cell batteries, rechargeable batteries, and the like are used.
The control apparatus 40 is a computer and includes an MPU 35 (or CPU), a display control section 42, a RAM 36, a ROM 37, a video RAM 41, an antenna 39, and a transceiver 38.
The transceiver 38 receives the control signal transmitted from the input apparatus 1 via the antenna 39. The MPU 35 analyzes the control signal and executes various kinds of operational processing. The display control section 42 mainly generates screen data to be displayed on the screen 3 of the display apparatus 5 under control of the MPU 35. The video RAM 41 as a working area of the display control section 42 temporarily stores the generated screen data.
The control apparatus 40 may be an apparatus dedicated to the input apparatus 1, or may be a PC or the like. The control apparatus 40 is not limited to the PC and may be a computer integrally formed with the display apparatus 5, audiovisual equipment, a projector, a game device, a car navigation system, or the like.
Examples of the display apparatus 5 include a liquid crystal display and an EL (Electro-Luminescence) display, but are not limited thereto. The display apparatus 5 may alternatively be an apparatus integrally formed with a display and capable of receiving television broadcasts and the like.
Next, a description will be given on typical examples of ways of moving the input apparatus 1 and ways the pointer 2 moves on the screen 3 accordingly.
As shown in
As shown in
Meanwhile, as shown in
Next, an operation of the control system 100 structured as described above will be described.
As shown in
Further, upon turning on the power of the input apparatus 1, biaxial acceleration signals are output from the acceleration sensor unit 16, and first and second acceleration values (ax, ay) obtained from the biaxial acceleration signals are input to the MPU 19 (Step 102). The signals on the acceleration values are signals corresponding to the position of the input apparatus 1 at a point when the power is turned on (hereinafter, referred to as initial position). Hereinafter, the initial position will be described as being the reference position. It should be noted that the MPU 19 typically carries out Steps 101 and 102 in sync every predetermined clock cycle.
Based on the acceleration values (ax, ay) and the angular velocity values (ωψ, ωθ), the MPU 19 calculates velocity values (first velocity value Vx, second velocity value Vy) by a predetermined operation (Step 103). The first velocity value Vy is a velocity value in a direction along the X′ axis, and the second velocity value Vy is a velocity value in a direction along the Y′ axis. A calculation method of the velocity values will be described later in detail.
As described above, in this embodiment, instead of calculating the velocity values (Vx, Vy) by simply integrating the acceleration values (ax, ay), the velocity values (Vx, Vy) are calculated based on the acceleration values (ax, ay) and the angular velocity values (ωψ, ωθ). Accordingly, as described above, an operational feeling of the input apparatus 1 that matches an intuition of the user can be obtained, and moreover, the movement of the pointer 2 on the screen 3 also accurately matches the movement of the input apparatus 1. However, the velocity values (Vx, Vy) do not always need to be calculated based on the acceleration values (ax, ay) and the angular velocity values (ωψ, ωθ) and may be calculated by simply integrating the acceleration values (ax, ay).
The MPU 19 transmits information on the calculated velocity values (Vx, Vy) to the control apparatus 40 via the transceiver 21 and the antenna 22 (Step 104).
The MPU 35 of the control apparatus 40 receives the information on the velocity values (Vx, Vy) via the antenna 39 and the transceiver 38 (Step 105). In this case, the input apparatus 1 transmits the velocity values (Vx, Vy) every predetermined number of clocks, that is, per predetermined unit time, and the control apparatus 40 receives the velocity values every predetermined number of clocks.
Upon receiving the information on the velocity values, the MPU 35 of the control apparatus 40 generates coordinate values of the pointer 2 based on the received velocity values. The display control section 42 controls display of the screen 3 so that the pointer 2 is displayed at the generated coordinate values.
Next, a description will be given on a relationship among a cycle in which the input apparatus 1 calculates the velocity values (hereinafter, referred to as calculation cycle), a cycle in which the input apparatus 1 transmits information on the velocity values (hereinafter, referred to as transmission cycle), a cycle in which the control apparatus 40 receives the information on the velocity values (hereafter, referred to as reception cycle), and a cycle in which the control apparatus 40 plots the movement of the pointer 2 (hereinafter, referred to as plotting cycle).
As shown in
The control apparatus receives the information on the velocity values in a reception cycle of 84 ms (see Step 105). Upon receiving the information on the velocity values, the MPU 35 of the control apparatus 40 generates coordinate values (X(t), Y(t)) of the pointer 2 in a cycle that is ⅕ the length of the transmission cycle (16.7 ms) (see Step 106). The display control section 42 controls display so that the pointer 2 moves on the screen 3 in the cycle of 16.7 ms (see Step 107).
On the screen 3, the pointer 2 moves as shown in
Next, a typical operation of the control system 100 will be described.
First, the processing of the input apparatus 1 will be described.
As shown in
By the loop of Steps 201 to 206, the velocity values are calculated and stored in the memory in a predetermined cycle (about 84 ms). It should be noted that since the calculation of Step 203 is a complex process as will be described later (see
The MPU 19 executes the processing shown in
Upon turning on the timer, the MPU 19 judges whether the timer is equal to or larger than a defined value (Step 302). The defined value is, for example, a value corresponding to a time of 84 ms. When the timer is equal to or larger than the defined value, that is, when the time of 84 ms has elapsed since having turned on or reset the timer (see Step 306), the MPU 19 judges whether read of the velocity values is inhibited by the read inhibition flag (Step 303). When the read of the velocity values is not inhibited, the MPU 19 reads the velocity values from a specific address in the memory (Step 304) and transmits the read velocity values to the control apparatus 40 via the antenna (Step 305).
Upon transmitting the information on the velocity values, the MPU 19 resets the timer (Step 306) and transmits information on the velocity values again after an elapse of 84 ms since the timer reset (Steps 302 to 305). By the loop of Steps 302 to 306, information on the velocity values is transmitted from the input apparatus 1 in a regular transmission cycle of 84 ms. In other words, although the cycle of 84 ms may fluctuate more or less in the processing shown in
It should be noted that when the read of the velocity values is inhibited in Step 303, the regular transmission cycle of 84 ms may become irregular. However, since a time required for the MPU 19 to store the calculated velocity values in the memory (see Steps 204 to 206 of
The processing shown in
Next, the processing of the control apparatus 40 will be described.
As shown in
Upon turning on the timer, the MPU 35 judges whether the information on the velocity values transmitted from the input apparatus 1 has been received (Step 402). Here, since the input apparatus 1 transmits the information on the velocity values in a regular transmission cycle of 84 ms as described above, the control apparatus 40 typically receives the information on the velocity values in a regular reception cycle of 84 ms. When the information on the velocity values from the input apparatus 1 is received (YES in Step 402), the MPU 35 stores the received information on the velocity values in a memory (Step 403). The memory may be a built-in volatile memory of the MPU 35 or a dedicated memory. Upon storing the velocity values in the memory, the MPU 35 resets the second timer (Step 404) and advances to Step 407.
When the information on the velocity values is not received in Step 402 (NO in Step 402), the MPU 35 judges whether the second timer is equal to or larger than a second defined value (Step 405). The second defined value is, for example, a value corresponding to a time of 168 ms, but is not limited thereto. For example, as long as the second defined value is a value corresponding to a time equal to or longer than the transmission cycle, the second defined value may be a value corresponding to a time of 168 ms or less or a value corresponding to a time of 168 ms or more.
When the second timer is equal to or larger than the second defined value (YES in Step 405), the MPU 35 stores the velocity values set to 0 (0, 0) in the memory (Step 406). Upon storing the velocity values (0, 0) in the memory, the MPU 35 resets the second timer (Step 404) and advances to Step 407. When the second timer is smaller than the second defined value (NO in Step 405), the MPU 35 advances to Step 407.
In Step 407, the MPU 35 judges whether the first timer is equal to or larger than a first defined value (Step 407). The first defined value is, for example, a value corresponding to a time of 16.7 ms that is ⅕ the time of the transmission cycle. The first defined value does not need to be a value corresponding to a time of 16.7 ms. For example, the first defined value may be a value corresponding to half the time of the transmission cycle or a value corresponding to 1/10 the time of the transmission cycle. Moreover, the first defined value may be set so as to match with a refresh timing of an image.
When the first timer is equal to or larger than the first defined value, the MPU 35 reads the velocity values from the memory (Step 408). The MPU 35 adds the velocity values read out from the memory to previous coordinate values by Equations (1) and (2) below to generate new coordinate values (X(t), Y(t)) (Step 409).
X(t)=X(t−1)+Vx (1)
Y(t)=Y(t−1)+Vy (2)
When the coordinate values are generated, the display control section 42 controls display of the screen 3 so that the pointer 2 is displayed at a position corresponding to the generated coordinate values (Step 410). Upon control of the display of the screen 3, the MPU 35 resets the first timer (Step 411) and again executes the processes of Step 402 and subsequent steps.
By the processing shown in
It should be noted that when the second timer is equal to or larger than the second defined value in Step 405, that is, when a time taken to receive information on the next velocity values since having received information on the previous velocity values is equal to or larger than the second defined value (e.g., 168 ms), the velocity values set to 0 (0, 0) are stored in the memory. Therefore, when a time equal to or longer than a predetermined time has elapsed since having received the previous velocity values, the velocity values (0, 0) are read out in Step 408. Thus, the movement of the pointer can be restricted when a predetermined time has elapsed since the reception of the information on the velocity values. Accordingly, it is possible to prevent idle running of the pointer 2 due to the control apparatus 40 continuing to move, despite the fact that the input apparatus 1 has not transmitted the information on the velocity values, the pointer 2 in accordance with the velocity values stored in the memory.
In the descriptions on
As shown in
As shown in
As shown in
When the calculation cycle, the transmission cycle, and the plotting cycle are set to 16 ms as shown in
On the other hand, according to the processing shown in
Next, another embodiment of an operation of the control system 100 will be described.
As described above, due to a use of wireless communication of the input apparatus 1, there is a problem that power consumption is large. Here, in a case where the velocity values calculated by the input apparatus 1 are 0, the pointer 2 does not move on the screen 3 even when the velocity values are transmitted. Therefore, necessity of transmitting information on the velocity values is low. In this regard, the input apparatus 1 of this embodiment restricts transmission of information on velocity values from the input apparatus 1 when the calculated velocity values are 0 (0, 0).
As shown in
On the other hand, when the calculated velocity values are 0 (YES in Step 505), the MPU 19 returns to Step 501 and obtains angular velocity values and acceleration values to thus calculate velocity values. For example, in a case where the input apparatus 1 is placed on a table and is hardly moved or in a case where the user is hardly moving the input apparatus 1, the velocity values calculated by the input apparatus 1 become 0 or values close to 0. Therefore, since the loop of Steps 501 to 505 is repeated when the input apparatus 1 is hardly moved, a state where the read inhibition flag is not canceled is maintained (see Step 507).
As shown in
In other words, by the processing shown in
It should be noted that because the velocity values (0, 0) are stored in the memory when a predetermined time has elapsed since the information on the velocity values has been received as described above, the control apparatus 40 can prevent idle running of the pointer 2 (see
Incidentally, the control signal transmitted from the input apparatus 1 includes an operation command generated when the operation section 23 is operated in addition to a movement command (signal containing information on velocity values). Therefore, it is possible that, when the press of the button 11 is released and an operation command is thus generated, for example, the control signal be transmitted even when the velocity values are 0. Also in processing shown in
Next, another embodiment of the control system 100 will be described.
The description on
As shown in
Upon reading the velocity values, the MPU 19 judges whether the read velocity values are 0 (Step 805). It is also possible to judge whether the velocity values (Vx, Vy) are equal to or smaller than a predetermined threshold value in Step 805. When the velocity values are not 0, the MPU 19 transmits information on the velocity values to the control apparatus 40 via the antenna 22 (Step 806). Then, the MPU 19 resets the timer (Step 807) and repeats the processes of Step 802 and subsequent steps.
On the other hand, when the velocity values are 0 (YES in Step 805), the MPU 19 resets the timer without transmitting the velocity values (Step 807) and repeats the processes of Step 802 and subsequent steps. Accordingly, the transmission of the information on the velocity values is restricted when the input apparatus 1 is hardly moved and the velocity values are thus 0 (0, 0), with the result that power consumption can be reduced appropriately.
Here, the processes in the loop of Step 802, YES in Step 805, and Step 802 and the processes in the loop of Step 802, NO in Step 805, and Step 802 are executed in a regular cycle of 84 ms (see Step 802). Therefore, irrespective of whether the input apparatus 1 is being moved or is hardly moved, the regular cycle of 84 ms can be maintained.
Next, another embodiment of the control system 100 will be described.
As shown in
Upon turning on a first timer and a second timer (Step 901), the MPU 35 judges whether information on velocity values has been received (Step 902). When the information on the velocity values (Vxn, Vyn) is received, the MPU 35 stores the received velocity values in the memory (Step 903). It is also possible to delete velocity values (Vxn-3, Vyn-3) stored in the memory three cycles before the current velocity values when the current velocity values (Vxn, Vyn) are stored in the memory. For realizing such processing, a ring buffer is used, for example.
Next, the MPU 35 resets the second timer (Step 904) and reads the velocity values (Vxn, Vyn) currently stored in the memory, velocity values (Vxn-1, Vyn-1) previously stored in the memory, and velocity values (Vxn-2, Vyn-2) stored in the memory two cycles before the current velocity values from the memory (Step 907). Based on the three sets of read velocity values, the MPU 35 calculates a quadratic regression curve using Equation (3) (Step 908).
Y=a0+a1X+a2X2 (3)
It should be noted that processing the same as that of
Upon calculating the quadratic regression curve, the MPU 35 judges whether the first timer is equal to or larger than a first defined value (Step 909). When the first timer is equal to or larger than the first defined value, that is, when a time of 16.7 ms has elapsed since the reset of the first timer (see Step 912), the MPU 35 calculates coordinate values (X(t), Y(t)) based on the quadratic regression curve (Step 910). Typically, the MPU 35 assigns a time that has elapsed since a reset of the second timer to the quadratic regression curve calculated in Step 908 to calculate the coordinate values (X(t), Y(t)). The display control section 42 controls display of the screen 3 so that the pointer 2 moves on the screen 3 in accordance with the calculated coordinate values (Step 911).
Next, the MPU 35 resets the first timer (Step 912) and repeats the processes of Step 902 and subsequent steps thereafter.
Since the movement of the pointer can be displayed in a curve (
This embodiment has described a case where a quadratic regression curve is used. However, the present invention is not limited thereto, and a regression curve of cubic or more or a multi-degree regression curve may also be used to control display of the movement of the pointer 2. An exponential regression curve may alternatively be used.
Next, another embodiment of an operation of the control system will be described.
The above embodiments have described a case where the calculation cycle and the transmission cycle are the same. In this embodiment, the transmission cycle is shorter than the calculation cycle. Therefore, that point will mainly be described.
As shown in
On the screen 3, the pointer 2 moves as shown in
The defined value may be a value other than the value corresponding to 16.7 ms as long as it is a time shorter than the calculation cycle. For example, the defined value may be a value corresponding to half the time of the calculation cycle or a value corresponding to 1/10 the time of the calculation cycle. The control apparatus 40 only needs to count the plotting cycle of the pointer by the timer in a cycle of 16.7 ms or execute plotting of the pointer 2 every time information on the velocity values is transmitted.
By the processing shown in
Also in this embodiment, processing the same as those of
Next, another embodiment of the control system 100 will be described.
The embodiments shown in
If a cycle in which the pointer 2 is plotted on the screen 3 is long when the velocity values of the pointer 2 are large, human beings tend to feel awkwardness regarding smoothness of the movement of the pointer. On the other hand, if the cycle in which the pointer 2 is plotted on the screen 3 is short when the velocity values of the pointer 2 are small, human beings hardly feels awkwardness regarding the smoothness of the movement of the pointer 2. In this regard, using this relationship in this embodiment, the transmission cycle is prolonged when the velocity values are small to thus realize power saving of the input apparatus 1.
As shown in
When a variably-controlled time has elapsed since turning on the timer or resetting the timer (see Step 1307), the MPU 19 judges whether read of velocity values is inhibited (Step 1303). When the read of velocity values is not inhibited, the MPU 19 reads the velocity values from a specific address in the memory (Step 1304) and transmits the velocity values via the antenna 22 (Step 1305).
Upon transmitting the velocity values, the MPU 19 sets a new defined value based on a level of the velocity values (Step 1306). Upon setting the new defined value, the MPU 19 resets the timer (Step 1307) and repeats the processes of Step 1302 and subsequent steps.
Here, the relationship between the velocity values and the transmission cycle will be described.
Next, another embodiment of a case where the transmission cycle is varied will be described.
For example, in a case where a movement velocity of the pointer 2 on the screen 3 is extremely large, even when the cycle of plotting the movement of the pointer 2 is long, human beings hardly feel awkwardness regarding the smoothness of the movement of the pointer. Alternatively, it is imperceptible since a velocity of the pointer 2 is too fast. In this regard, in this embodiment, using this relationship, the transmission cycle is controlled to be prolonged when the absolute value of the velocity values |V| is equal to or larger than the predetermined threshold value Th, to thus realize a reduction in power consumption of the input apparatus 1.
Any one of
Next, an embodiment of a case where the control apparatus 40 variably controls the plotting cycle will be described.
In the descriptions on
As shown in
As shown in
Any one of
Hereinafter, a method of calculating velocity values (Vx, Vy) in Step 103 of
1. The angular velocity value ωψ about the Y′ axis of a portion of the input apparatus 1 at which the acceleration sensor unit 16 is disposed (hereinafter, referred to as tip end portion) is a combined value of an angular velocity obtained by the turn of a wrist, an angular velocity obtained by the bending of an elbow, and an angular velocity obtained by the rotation from a base of an arm.
2. The velocity value Vx at the tip end portion of the input apparatus 1 is a combined value of values obtained by respectively multiplying the angular velocities of the wrist, elbow, and base of an arm by a distance between the wrist and the tip end portion, a distance between the elbow and the tip end portion, and a distance between the base of an arm and the tip end portion.
Here, regarding a rotational movement of the input apparatus 1 in a minute time, the input apparatus 1 can be considered to be rotating about a center axis parallel to the Y axis and whose position changes with time. Assuming that a distance between the center axis whose position changes with time and the tip end portion of the input apparatus 1 is a radius gyration Rψ(t) about the Y′ axis, the relationship between the velocity value Vx and the angular velocity value ωψ at the tip end portion of the input apparatus 1 can be expressed by Equation (4) below. In other words, the velocity value Vx becomes a value obtained by multiplying the angular velocity value ωψ about the Y′ axis by the distance Rψ(t) between the center axis and the tip end portion. It should be noted that in this embodiment, the acceleration sensor unit 16 and the angular velocity sensor unit 15 are provided integrally on the circuit board 25 of the sensor unit 17. Therefore, the radius gyration R(t) becomes a distance from the center axis to the sensor unit 17. However, when the acceleration sensor unit 16 and the angular velocity sensor unit 15 are provided apart from each other inside the casing 10, the distance from the center axis to the acceleration sensor unit 16 becomes the radius gyration R(t).
Vx=Rψ(t)*ωψ (4)
As shown in Equation (4), the relationship between the velocity value and the angular velocity value at the tip end portion of the input apparatus 1 is a proportional relationship with R(t) as a proportional constant, that is, a correlation.
Equation (4) above is modified to obtain Equation (5).
Rψ(t)=Vx/ωψ (5)
The right-hand side of Equation (5) is a velocity dimension. Even when the velocity value and the angular velocity value represented on the right-hand side of Equation (5) are differentiated to obtain a dimension of the acceleration or acceleration time change rate, the correlation is not lost. Similarly, even when the velocity value and the angular velocity value are integrated to obtain a displacement dimension, the correlation is not lost.
Therefore, with the velocity and the angular velocity represented on the right-hand side of Equation (5) as a dimension of the displacement, acceleration, and acceleration time change rate, Equations (6), (7), and (8) below can be obtained.
Rψ(t)=x/ψ (6)
Rψ(t)=ax/Δωψ (7)
Rψ(t)=Δax/Δ(Δωψ) (8)
Focusing on Equation (7) out of Equations (5), (6), (7), and (8) above, for example, it can be seen that the radius gyration Rψ(t) can be obtained if the acceleration value ax and the angular acceleration value Δωψ are known. As described above, the first acceleration sensor 161 detects the acceleration value ax in the X′-axis direction, and the first angular velocity sensor 151 detects the angular velocity value ωψ about the Y′ axis. Therefore, if the angular velocity value ωψ about the Y′ axis is differentiated to thus calculate the angular acceleration value Δωψ about the Y′ axis, the radius gyration Rψ(t) about the Y′ axis can be obtained.
If the radius gyration R104 (t) about the Y′ axis is known, the velocity value Vx of the input apparatus 1 in the X′-axis direction can be obtained by multiplying the radius gyration Rψ(t) by the angular velocity value ωψ about the Y′ axis detected by the first angular velocity sensor 151 (see Equation (4)). Specifically, a rotational operation amount itself of the user is converted into a linear velocity value in the X′-axis direction, with the result that a velocity value that matches an intuition of the user is obtained. Therefore, because the movement of the pointer 2 becomes a natural movement with respect to the movement of the input apparatus 1, operability of the input apparatus for the user is improved.
This velocity value calculation method can also be applied to a case where the user operates the input apparatus 1 by swinging it in the vertical direction (pitch direction).
Using the acceleration values (ax, ay) from the acceleration sensor unit 16 and the angular acceleration values (ΔΩψ, ΔΩθ), the MPU 19 calculates the radius gyrations (Rψ(t), Rθ(t)) about the Y′ axis and the X′ axis using Equations (7) and (9) (Step 1402).
Rψ(t)=ax/Δωψ (7)
Rθ(t)=ay/Δωθ (9)
After the radius gyrations are calculated, the velocity values (Vx, Vy) are calculated using Equations (4) and (10) (Step 1403).
Vx=Rψ(t)*ωψ (4)
Vy=Rθ(t)*ωθ (10)
The rotational operation amounts themselves of the input apparatus 1 made by the user are thus converted into linear velocity values in the X- and Y-axis directions, with the result that the velocity values that match the intuition of the user are obtained.
Further, by using the acceleration values (ax, ay) detected by the acceleration sensor unit 16 as they are, a calculation amount and power consumption of the input apparatus 1 can be reduced.
The MPU 19 only needs to obtain (ax, ay) from the acceleration sensor unit 16 every predetermined number of clocks and calculate the velocity values (Vx, Vy) in sync therewith, for example. Alternatively, the MPU 19 may calculate the velocity values (Vx, Vy) once every time a plurality of acceleration values (ax, ay) are sampled.
Next, another embodiment of calculating the velocity values (Vx, Vy) using the radius gyrations as in
The MPU 19 of the input apparatus 1 differentiates the acceleration values (ax, ay) from the acceleration sensor unit 16. Accordingly, acceleration time change rates (Δx, Δay) are calculated (Step 1501). Similarly, the MPU 19 carries out a second order differentiation operation on the angular velocity values (ωψ, ωθ) from the angular velocity sensor unit 15 to calculate angular acceleration time change rates (Δ(Δωψ), Δ(Δωθ))) (Step 1502).
Upon calculating the angular acceleration time change rates, the MPU 19 judges whether an absolute value of the angular acceleration time change rate |Δ(Δωψ)| about the Y′ axis exceeds a threshold value th1 (Step 1503). When |Δ(Δωwψ)| above exceeds the threshold value th1, the MPU 19 calculates the radius gyration Rψ(t) about the Y′ axis by dividing the acceleration time change rate Δax in the X′-axis direction by the angular acceleration time change rate Δ(Δωψ) about the Y′ axis (Step 1504). In other words, a ratio of the acceleration time change rate Δax in the X′-axis direction to the angular acceleration time change rate Δ(Δωψ) about the Y′ axis is calculated as the radius gyration Rψ(t) (Equation (8)). The threshold value th1 of |Δ(Δωψ)| can be set as appropriate.
A signal of the radius gyration R104 (t) is passed through a lowpass filter, for example (Step 1505). Information on the radius gyration Rψ(t) from which noises of a high-frequency range have been removed by the lowpass filter is stored in a memory (Step 1506). The memory updates the signal of the radius gyration Rψ(t) every predetermined number of clocks and stores it.
By multiplying the radius gyration R104 (t) by the angular velocity value ωψ about the Y′ axis, the MPU 19 of the input apparatus 1 calculates the velocity value Vx in the X′-axis direction (Step 1508).
On the other hand, when |Δ(Δωψ)| above is equal to or smaller than the threshold th1, the MPU 19 reads out the radius gyration Rψ(t) stored in the memory (Step 1507). By multiplying the read-out radius gyration Rψ(t) by the angular velocity value ωψ about the Y′ axis, the velocity value Vx in the X′-axis direction is calculated (Step 1508).
There are the following two reasons for carrying out the processes of Steps 1501 to 1508.
One is to obtain the radius gyration Rψ(t) of Equation (8) above to thus obtain a linear velocity that matches the intuition of the user.
Second is to remove a gravitational effect in the process of calculating the velocity values (Vx, Vy). When the input apparatus 1 is tilted in the roll direction or the pitch direction from its reference position, detection signals different from the actual movement of the input apparatus 1 are inadvertently output due to the gravitational effect. When the input apparatus 1 is tilted in the pitch direction, for example, gravity acceleration component values are output from the acceleration sensor 162. Therefore, when the effect of the gravity acceleration component values is not removed, the movement of the pointer 2 becomes a movement that does not match a sense of the user.
In
In this case, the first acceleration sensor 161 detects the acceleration in the X′-axis direction even when the input apparatus 1 is not actually moved in the X-axis direction in particular. The state shown in
For example, when the input apparatus 1 is rotated in the pitch direction from the reference position as shown in
In this regard, a fact that a time change rate of the gravity acceleration component value generated by the movement of the input apparatus 1 is smaller than the acceleration value time change rate that focuses on a movement inertial component (movement only) of the input apparatus 1 caused by the operation of the user is used. The time change rate of the gravity acceleration component value is a 1/10 order of a time change rate of the movement inertial component value generated by the operation of the user. The value output from the acceleration sensor unit 16 is a value obtained by combining those two, that is, the signal output from the acceleration sensor unit 16 is a signal obtained by superimposing a low-frequency component value as the gravity acceleration component value on the time change rate of the movement inertial component value generated by the operation of the user.
Therefore, by differentiating the acceleration values in Step 1501, the acceleration time change rates can be obtained. Accordingly, the time change rate of the gravity acceleration component value is removed. As a result, even in the case where a change in a component force of the gravity acceleration due to the tilt of the input apparatus 1 is generated, the radius gyrations can be obtained appropriately, and appropriate velocity values can be calculated from the radius gyrations.
It should be noted that there are cases where, in addition to the gravity acceleration component value, the low-frequency component value contains, for example, a temperature drift of the acceleration sensor unit 16 or a DC offset value.
Moreover, because Equation (8) is used in this embodiment, in Step 1502, a second order differentiation is carried out on the angular velocity value ωψ, and noises of a high-frequency range are superimposed on an operational value of the angular velocity. Though there is no problem when |Δ(Δωψ)| is large, when small, S/N deteriorates. When |Δ(Δωψ)| with S/N deteriorated is used in the calculation of Rψ(t) in Step 1504, precision of Rψ(t) and the velocity value Vx deteriorates.
In this regard, in Step 1503, the angular acceleration time change rate Δ(Δωψ) about the Y′ axis calculated in Step 1502 is used. When Δ(Δωψ) is equal to or smaller than the threshold value th1, the radius gyration Rψ(t) previously stored in the memory and that has less noise is read out (Step 1507), and the read-out radius gyration Rψ(t) is used in calculating the velocity value Vx in Step 1508.
In Steps 1509 to 1514, the MPU 19 calculates the velocity value Vy in the Y′-axis direction in the same manner as in the processes of Steps 1503 to 1508 above. In other words, the MPU 19 judges whether an absolute value of the angular acceleration time change rate |Δ(Δωθ)| about the X′ axis exceeds the threshold value th1 (Step 1509), and when exceeding the threshold value th1, calculates the radius gyration Rθ(t) about the X′ axis using the angular acceleration time change rate (Step 1510).
A signal of the radius gyration Rθ(t) is passed through a lowpass filter (Step 1511) and stored in the memory (Step 1512). When equal to or smaller than the threshold value th1, the radius gyration Rθ(t) stored in the memory is read out (Step 1513), and the velocity value Vy in the Y′-axis direction is calculated based on the radius gyration Rθ(t) (Step 1514).
It should be noted that although the same threshold value th1 is used in both the yaw direction and the pitch direction in this embodiment, different threshold values may be used for those directions.
In Step 1503, it is also possible to judge the angular acceleration value (Δωψ), based on the threshold value, instead of Δ(Δωψ). Also in Step 1509, it is possible to judge the angular acceleration value (Δωθ) based on the threshold value, instead of Δ(Δωθ). In the flowchart shown in
The above embodiments have described the biaxial acceleration sensor unit and the biaxial angular velocity sensor unit. However, the present invention is not limited thereto, and the input apparatus 1 may include triaxial acceleration sensors and triaxial angular velocity sensors whose axes are mutually orthogonal. Alternatively, the processing shown in the above embodiments can be realized with only one of the triaxial acceleration sensors and triaxial angular velocity sensors. Alternatively, the input apparatus 1 may include a uniaxial acceleration sensor or a uniaxial angular velocity sensor. In the case of the uniaxial acceleration sensor or the uniaxial angular velocity sensor, typically a screen on which a plurality of pointing targets of the pointer 2 displayed on the screen 3 are arranged uniaxially is conceivable.
Alternatively, the input apparatus 1 may include a geomagnetic sensor, an image sensor, or the like in place of the acceleration sensors and angular velocity sensors.
In the input apparatus according to the above embodiments, input information has been transmitted to the control apparatus wirelessly. However, the input information may be transmitted by wire.
In the above embodiments, the pointer 2 that moves on the screen in accordance with the movement of the input apparatus 1 has been represented as an image of an arrow. However, the image of the pointer 2 is not limited to the arrow and may be a simple circle, square, or the like, or a character image or any other images.
The detection axes of each of the angular velocity sensor unit 15 and the acceleration sensor unit 16 of the sensor unit 17 do not necessarily need to be mutually orthogonal like the X′ axis and the Y′ axis described above. In this case, the accelerations respectively projected in the mutually-orthogonal axial directions can be obtained by a calculation that uses a trigonometric function. Similarly, the angular velocities about the mutually-orthogonal axes can be obtained by a calculation that uses the trigonometric function.
In the above embodiments, a case where the movement of the input apparatus 1 is converted into a movement of the pointer 2 so as to be displayed has been described. However, the present invention is not limited thereto, and the movement of the input apparatus 1 may be converted into a scroll operation or a zoom operation of an image displayed on the screen 3 and displayed.
First, a scroll operation will be described. In this case, the MPU 35 of the control apparatus 40 controls display so that the letters 7 within the image 6 are scrolled in accordance with information on two velocity values (Vx, Vy) transmitted from the input apparatus 1. Alternatively, the MPU 35 may control display so that the letters 7 within the image 6 are scrolled in accordance with one of the first velocity value V, and the second velocity value Vy.
For example, when the user swings the input apparatus 1 in the pitch direction, the letters 7 are scrolled vertically inside the image 6 in accordance therewith, and when the user swings the input apparatus 1 in the yaw direction, the letters 7 are scrolled laterally in accordance therewith. A relationship between an operation direction of the input apparatus 1 and a direction in which the letters 7 are scrolled only needs to be set as appropriate.
Next, a zoom operation will be described. In this case, the MPU 35 controls display on the screen 3 so that the letters 7 within the image 6 are zoomed in/out in accordance with one of the first velocity value VX and the second velocity value Vy. For example, when the user swings the input apparatus 1 upward with a turn of a wrist from a reference position of the input apparatus 1, the letters 7 within the image 6 are zoomed in on the screen 3. On the other hand, when the user swings the input apparatus 1 downward from the reference position of the input apparatus 1, the letters 7 within the image 6 are zoomed out. A relationship between the operation direction of the input apparatus 1 and zoom in/out only needs to be set as appropriate.
By executing processing the same as those of the above embodiments also in the case of converting the movement of the input apparatus 1 into the scroll or zoom operation, the same operational effect as in the above embodiments can be obtained.
It should be understood that various changes and modifications to the presently preferred embodiments described herein will be apparent to those skilled in the art. Such changes and modifications can be made without departing from the spirit and scope of the present subject matter and without diminishing its intended advantages. It is therefore intended that such changes and modifications be covered by the appended claims.
Claims
1. An input apparatus, comprising:
- a sensor to detect a movement of the input apparatus and output a detection signal corresponding to the movement of the input apparatus;
- a calculation means for calculating a corresponding value that corresponds to a movement of an image displayed on a screen in a predetermined calculation cycle, the corresponding value corresponding to the detection signal; and
- a transmission section to transmit the corresponding value in a transmission cycle shorter than the calculation cycle
- a sensor unit configured to detect movement of a hand of a user and output detection signals based on the movement of the hand of the user, wherein the detection signals includes a plurality of first detection signals and a plurality of second detection signals, and the plurality of the second detection signals are output just after the first detection signals; and
- at least one processor configured to: receive the plurality of the first detection signals and the plurality of the second detection signals; calculate, based on the plurality of the first detection signals, a first current value according to a predetermined calculation cycle, calculate, based on the plurality of the second detection signals, a second current value according to the predetermined calculation cycle after calculating the first current value, generate first movement information that is based on the calculated first current value and represents a first movement direction of the hand of the user, generate second movement information that is based on the calculated second current value and represents a second movement direction of the hand of the user, receive, according to a transmission cycle that is shorter than the predetermined calculation cycle, each of the first movement information and the second movement information that is based on the corresponding one of the calculated first current value and the calculated second current value; control, while calculating the second current value based on the second detection signals according to the predetermined calculation cycle, a display device to sequentially plot a plurality of first images along the first movement direction according to the transmission cycle; and
- control, just after displaying the plurality of the first images, the display device to sequentially plot a plurality of second images along the second movement direction according to the transmission cycle.
2. The input apparatus according to claim 1, further comprising:
- a memory to store the calculated corresponding current value; and
- an update means for updating the corresponding current value stored in the memory every time the corresponding current value is calculated,
- wherein the transmission section reads and transmits the corresponding current value stored in the memory in the transmission cycle.
3. The input apparatus according to claim 1, further comprising:
- a judgment means for judging whether the corresponding current value is equal to or smaller than a predetermined threshold value; and
- a restriction means for restricting the transmission of the corresponding current value when the corresponding current value is equal to or smaller than the predetermined threshold value.
4. A control system, comprising:
- an input apparatus including
- a sensor to detect a movement of the input apparatus and output a detection signal corresponding to the movement of the input apparatus,
- a calculation means for calculating a corresponding value that corresponds to a movement of an image displayed on a screen in a predetermined calculation cycle, the corresponding value corresponding to the detection signal, and
- a transmission section to transmit the corresponding value in a transmission cycle shorter than the calculation cycle; and
- a control apparatus including
- a reception section to receive the transmitted corresponding value, and
- a display control means for controlling display of the screen so that the movement of the image is plotted in accordance with the corresponding value
- a sensor unit configured to detect movement of the input apparatus and output detection signals based on the movement of the input apparatus, wherein the detection signals includes a plurality of first detection signals and a plurality of second detection signals, and the plurality of the second detection signals are output just after the first detection signals; and
- at least one processor configured to: receive the plurality of the first detection signals and the plurality of the second detection signals; calculate, based on the plurality of the first detection signals, a first current value according to a predetermined calculation cycle, calculate, based on the plurality of the second detection signals, a second current value according to the predetermined calculation cycle after calculating the first current value, generate first movement information that is based on the calculated first current value and represents a first movement direction of the input apparatus, generate second movement information that is based on the calculated second current value and represents a second movement direction of the input apparatus, receive, according to a transmission cycle that is shorter than the predetermined calculation cycle, each of the first movement information and the second movement information that is based on the corresponding one of the calculated first current value and the calculated second current value; control, while calculating the second current value based on the second detection signals according to the predetermined calculation cycle, a display device to sequentially plot a plurality of first images along the first movement direction according to the transmission cycle; and
- control, just after displaying the plurality of the first images, the display device to sequentially plot a plurality of second images along the second movement direction according to the transmission cycle.
5. A control method, comprising:
- detecting a movement of an input apparatus and outputting a detection signal corresponding to the movement of the input apparatus;
- calculating a corresponding value that corresponds to a movement of an image displayed on a screen in a predetermined calculation cycle, the corresponding value corresponding to the detection signal; and
- transmitting the corresponding value in a transmission cycle shorter than the calculation cycle
- detecting movement of an input apparatus and outputting detection signals based on the movement of the input apparatus, wherein the detection signals includes a plurality of first detection signals and a plurality of second detection signals, and the plurality of the second detection signals are output just after the first detection signals;
- receiving the plurality of the first detection signals and the plurality of the second detection signals;
- calculating, based on the plurality of the first detection signals, a first current value according to a predetermined calculation cycle;
- calculating, based on the plurality of the second detection signals, a second current value according to the predetermined calculation cycle after calculating the first current value;
- generating first movement information that is based on the calculated first current value and represents a first movement direction of the hand of the user;
- generating second movement information that is based on the calculated second current value and represents a second movement direction of the hand of the user;
- receiving, according to a transmission cycle that is shorter than the predetermined calculation cycle, each of the first movement information and the second movement information that is based on the corresponding one of the calculated first current value and the calculated second current value;
- controlling, while calculating the second current value based on the second detection signals according to the predetermined calculation cycle, a display device to sequentially plot a plurality of first images along the first movement direction according to the transmission cycle; and
- controlling, just after displaying the plurality of the first images, the display device to sequentially plot a plurality of second images along the second movement direction according to the transmission cycle.
6. The control method according to claim 5, wherein the transmission cycle is equal or larger than a refresh timing of the display device.
7. The control method according to claim 5, wherein the coordinate values are calculated based on quadratic regression curve.
8. The control method according to claim 5, wherein the transmission cycle equals a refresh timing of the display device.
9. A display system comprising:
- a sensor unit configured to detect movement of a hand of a user and output detection signals based on the movement of the hand of the user, wherein the detection signals includes a plurality of first detection signals and a plurality of second detection signals, and the plurality of the second detection signals are output just after the first detection signals;
- a display device including at least one of a projector, a liquid crystal display or an electro-luminescence display; and
- at least one processor configured to: receive the plurality of the first detection signals and the plurality of the second detection signals; calculate, based on the plurality of the first detection signals, a first current value according to a predetermined calculation cycle, calculate, based on the plurality of the second detection signals, a second current value according to the predetermined calculation cycle after calculating the first current value, generate first movement information that is based on the calculated first current value and represents a first movement direction of the hand of the user, generate second movement information that is based on the calculated second current value and represents a second movement direction of the hand of the user, receive, according to a transmission cycle that is shorter than the predetermined calculation cycle, each of the first movement information and the second movement information that is based on the corresponding one of the calculated first current value and the calculated second current value; control, while calculating the second current value based on the second detection signals according to the predetermined calculation cycle, the display device to sequentially plot a plurality of first images along the first movement direction according to the transmission cycle; and control, just after displaying the plurality of the first images, the display device to sequentially plot a plurality of second images along the second movement direction according to the transmission cycle.
10. The display system according to claim 9, wherein the processor is configured to generate coordinate values in accordance with the values corresponding to the detection signals.
11. The display system according to claim 10, wherein the transmission cycle is equal or larger than a refresh timing of the display device.
12. The display system according to claim 10, wherein the coordinate values are calculated based on a quadratic regression curve.
13. The display system according to claim 9, wherein the transmission cycle equals a refresh timing of the display device.
14. The display system according to claim 9, wherein the processor generates information in every transmission cycle.
5453758 | September 26, 1995 | Sato |
5485203 | January 16, 1996 | Nakamura et al. |
5675553 | October 7, 1997 | O'Brien et al. |
5786872 | July 28, 1998 | Miyazaki et al. |
6573930 | June 3, 2003 | Kyuma et al. |
7658676 | February 9, 2010 | Ohta |
20060007141 | January 12, 2006 | Wilson et al. |
20070182700 | August 9, 2007 | Baba et al. |
20070257884 | November 8, 2007 | Taira et al. |
20070288640 | December 13, 2007 | Schmieder |
20080222503 | September 11, 2008 | Sandige et al. |
20080278445 | November 13, 2008 | Sweetser et al. |
20090066647 | March 12, 2009 | Kerr et al. |
20100033583 | February 11, 2010 | Tomita et al. |
20100045599 | February 25, 2010 | Yamamoto |
20110141015 | June 16, 2011 | Yamashita |
20120329558 | December 27, 2012 | Haigh-Hutchinson |
04-271393 | September 1992 | JP |
04-291622 | October 1992 | JP |
08-259195 | September 1994 | JP |
07-222027 | August 1995 | JP |
08-154284 | June 1996 | JP |
08-211995 | August 1996 | JP |
09-190275 | July 1997 | JP |
09-269869 | October 1997 | JP |
10-327477 | December 1998 | JP |
3748483 | March 1999 | JP |
11-196479 | July 1999 | JP |
2002-062981 | February 2002 | JP |
2004-334903 | November 2004 | JP |
2009-14915 | July 2009 | JP |
2009-147915 | July 2009 | JP |
200156743 | August 2009 | JP |
- Japanese Office Action dated May 15, 2012, corresponding to Japanese Appln. No. 2008-214194.
Type: Grant
Filed: Oct 2, 2014
Date of Patent: Oct 2, 2018
Assignee: Sony Corporation (Tokyo)
Inventor: Kazuyuki Yamamoto (Kanagawa)
Primary Examiner: Dennis Bonshock
Application Number: 14/505,039
International Classification: G06F 3/0346 (20130101); G06F 3/05 (20060101); G06F 3/033 (20130101);