Method generating an input in an omnidirectional locomotion system
A virtual environment can use an absolute orientation framework. An absolute orientation framework in a virtual environment can be activated using an omnidirectional locomotion platform. An absolute orientation framework enables a user's avatar to move independently from the current viewpoint or camera position. The user's avatar can move in an absolute manner relative to a virtual environment map.
Latest Virtuix Holdings, Inc. Patents:
- EFFICIENT CAPTURE AND DELIVERY OF WALKABLE AND INTERACTIVE VIRTUAL REALITY OR 360 DEGREE VIDEO
- Data management and performance tracking system for walkable or interactive virtual reality
- Efficient capture and delivery of walkable and interactive virtual reality or 360 degree video
- ANTI-SLIP FOOTWEAR WITH ROTATABLE TRACTION ELEMENT
- EFFICIENT CAPTURE AND DELIVERY OF WALKABLE AND INTERACTIVE VIRTUAL REALITY OR 360 DEGREE VIDEO
This application is a continuation of U.S. application Ser. No. 14/663,433 filed Mar. 19, 2015, which claims benefit of U.S. application Ser. No. 14/062,625 filed Oct. 24, 2013, and entitled “Locomotion System and Apparatus,” which is hereby incorporated herein by reference in its entirety. This application claims benefit of U.S. provisional application Ser. No. 61/955,767 filed Mar. 19, 2014, and entitled “Method and System of Decoupling a Locomotion and Virtual Reality System,” which is hereby incorporated herein by reference in its entirety. This application claims benefit of U.S. provisional application Ser. No. 61/981,149 filed Apr. 17, 2014, and entitled “Omnidirectional Locomotion System for Military Application,” which is hereby incorporated herein by reference in its entirety. This application claims benefit of U.S. provisional application Ser. No. 62/004,550 filed May 29, 2014, and entitled “Support Tube System for Vertical Movement of an Omnidirectional Locomotion Device,” which is hereby incorporated herein by reference in its entirety. This application claims benefit of U.S. provisional application Ser. No. 62/099,426 filed Jan. 2, 2015, and entitled “An Omnidirectional Locomotion System and Apparatus,” which is hereby incorporated herein by reference in its entirety. This application claims benefit of U.S. provisional application Ser. No. 62/127,261 filed Mar. 2, 2015, and entitled “An Omnidirectional Locomotion System and Apparatus,” which is hereby incorporated herein by reference in its entirety.
FIELD OF TECHNOLOGYThe present disclosure relates generally to an omnidirectional locomotion system and apparatus that can be used in conjunction with virtual reality systems, and more specifically to a hardware layout and software methods of a omnidirectional locomotion system and related components.
BACKGROUNDThe present disclosure generally relates to locomotion devices that can be used in conjunction with virtual reality systems.
Within a virtual reality environment, users typically desire the ability to walk freely. In particular, the ability to physically walk or run in the real environment and have that motion translated to the virtual environment significantly increases the level of immersion of the user in the virtual environment. However, movement in the real world is often limited by physical space boundaries (e.g., the size of the room within which the user is located). Accordingly, locomotion devices are designed to provide the user the sensation of walking freely, while confining the user to a specific location. For example, many locomotion devices allow a user to walk freely, in 360 degrees, on a platform having a finite size without ever leaving the platform.
Conventional locomotion devices include motorized and non-motorized designs, which may be used in conjunction with virtual reality environments in a multitude of applications including, but not limited, to gaming. Examples of applications beyond gaming include employee training; combat training; physical therapy; exercise; virtual work environments; virtual meeting rooms (for both professional and personal purposes); sports simulation and training; and virtual tourism, concerts, and events.
Motorized locomotion devices typically use sensors to detect the movement of the user and send feedback to motors driving belts or rollers on which the user moves. The belts or rollers are operated to counter the user's movements and bring the user back to a central portion of the platform after each step. There are many drawbacks to motorized locomotion devices. For example, the motorized locomotion devices are usually complex and expensive because of the rolling and motorized components, sensors, processing units, and feedback loops. In addition, complex algorithms are required for the rolling and motorized components to properly counter the movements of the user. Inaccurate feedback to the motor can result in erroneous movement of the belts or rollers that may cause the user to lose balance or drift away from the center of the platform. There may also be issues with latency of feedback and response when the user accelerates, causing incorrect movements or responses that are too slow, potentially allowing the user walk off the platform. Further, because the response movements of the belts or rollers counteract the user's movements, the user may be prone to lose balance and trip.
In addition to issues with the operation of motorized locomotion devices, such devices are usually large and bulky, and thus, do not fit in the average-sized residential room (e.g., a game room, living room, or bedroom) and can be difficult to break up into modular pieces for shipping and storage. The devices are necessarily large, to prevent the user from walking off the platform before the correct system response has been processed; thus, rendering the devices unsuitable for in-home consumer usage.
Non-motorized locomotion devices lack motorized components and, thus, rely on the user's movement and/or gravity to bring the user back to the center of the platform after each step. Omnidirectional ball bearing platforms, for example, have hundreds of ball bearings that allow the user to walk in place while a restraint around the user's waist keeps the user in place. A major issue with omnidirectional ball bearing platforms is that the user does not experience a natural gait with a heel-toe strike movement, but rather instability similar to that of walking on ice. The instability results in the shuffling of feet where neither heel nor toe lift off the device, resulting in an unnatural walking gait that reduces the immersion of the user in the virtual environment. Moreover, these devices are typically heavy and expensive due to the plurality of rolling components.
Accordingly, there remains a need for locomotion devices that allow users to safely access virtual environments while providing the sensation of a more natural walking gait.
SUMMARYThe embodiments described herein are generally directed to a locomotion system for use with a virtual environment technology comprising a platform configured to support a user, a lower platform configured to support the platform and the user while entering the platform, an adjustable struts coupled to the platform and extending upwardly, at variable heights, from the platform, wherein the harness support assembly includes a support halo positioned above the platform and extending about a vertical central axis, and a harness configured to be worn by the user. The harness includes one or more sleds moveably coupled to the support halo.
In an embodiment, a locomotion system for use with a virtual environment technology comprises a platform configured to support a user, struts coupled to the platform and extending upwardly from the platform, wherein the struts includes a support halo positioned above the platform and extending about a vertical central axis, and a harness including a belt configured to be worn by the user, one or more sleds coupled to the belt, and a vertical member coupled to the belt. The sleds slidingly engages an upper and lower surface of the support halo, and the vertical member is disposed within the support halo and is configured to limit the radial movement of the interface structure relative to the support halo.
In an embodiment, a harness for use in an omnidirectional locomotion system comprising a sit harness coupled to a support frame, two upper sleds removably coupled to the support frame by a connection rod, wherein the upper sled is located above a halo, two lower sleds removably coupled to the support frame by a vertical member, wherein the lower sled is located below the halo.
In an embodiment, a virtual reality system comprises a locomotion system including a platform configured to support a user, struts coupled to the platform, and a harness configured to be worn by the user. The struts include a support halo positioned above the platform and extending about a vertical central axis, and wherein the harness is configured to move relative to the support halo. The virtual reality system can further comprise one or more sensors, for example, inertial measurement unit (IMU) configured to detect, track, and transmit the motion of the user to a print circuit board, light emitting diodes (LED) configured to display status information to the user, a cabling system and panel configured to prevent accidental removal, and a visual display in communication with the processing unit, and one or more accessories configured to be handled or used by the user.
The movement of a user in the omnidirectional locomotion system can be determined by data collected from the one or more sensors, for example IMUs. One or more sensors can be removably attached to the user's footwear, harness, accessory, head, arms, or any other location on the user or user accessory. When the user begins movement in any direction the sensors can stream raw gyro data to an aggregator board, for example at 100 Hz. The aggregator board can collect and analyze the data to determine the angular velocity (rate of rotation per second) coming from the gyro that is perpendicular to the direction of the motion. In other embodiments, the sensors can include, but are not limited to capacitance sensors, inertial sensors (IMU), ambient light sensors, magnetic tracking sensors, acoustic sensors, pressure sensors, optical tracking sensors, hall effect sensor, and infrared sensors.
The term “coupled” refers to limitation of movement in the virtual environment with reference to the direction in which the user is looking or where the camera is pointed within the virtual environment.
The term “decoupled” refers to the ability to move in the virtual environment independent of the direction in which the user is looking or the camera is pointed within the virtual environment. In an embodiment, it refers to the ability of the user to walk in any direction on the virtual reality platform (walk movements translated into gamepad input for a computer application that accepts gamepad input) independent of a direction in which the user is looking in the virtual environment. Movements when decoupled are therefore not bound by the direction of the camera or display, when the user is moving, thus enabling a user to look or have a display positioned in any angle, irrespective of the users intended feet and body movement, motion, or direction.
The term “POD” refers generally to a specific type of sensor system, namely a sensor coupled with a multi-controller unit with short-range wireless capabilities. In the present disclosure, the term POD can be interchangeably with the term sensor. The present disclosure in general describes a POD, however, other sensors can be implemented as well, for example, capacitance sensors, inertial sensors (IMU), ambient light sensors, magnetic tracking sensors, acoustic sensors, pressure sensors, optical tracking sensors, hall effect sensor, and infrared sensors.
Current video games use a relative orientation framework. Pushing a joystick to the right or pressing “D” on a keyboard can move a user's avatar 90 degrees to the right from a current viewpoint or camera position. The current camera position can be obtained by measuring a direction of a head mounted display, for example, a virtual reality headset. Thus in the relative orientation framework, movement can be relative to the current camera position. To further illustrate, pushing the joystick up or “W” on the keyboard can move the user's avatar in the forward in the current camera position.
In an embodiment, a game can use an absolute orientation framework (decoupled framework). When a game is played using an omnidirectional locomotion platform a user's avatar can move independently from the current viewpoint or camera position. The user's avatar can move in an absolute manner relative to an in-game map. For example, if the user walks the direction north on omnidirectional locomotion platform, the user's avatar can move north on the in-game map, regardless of the current camera position. In an embodiment, the head mounted display can include a sensor, for example, a magnetometer. The sensor can use an absolute orientation framework similar to omnidirectional locomotion platform, wherein the current in-game camera position can be the direction the user is physically looking outside the game.
In an embodiment, the direction “north” can be magnetic north or polar north. In another embodiment, the direction “north” can be a designated direction set or calibrated at a start of a game. For example, a user wearing a head mounted display (virtual reality headset), can look forward relative to the user's body during calibration, which can calibrate the current forward looking direction with a forward walking orientation prior to decoupling the current camera position and the user's body position. In another embodiment, the halo or harness of an omnidirectional locomotion system, can include sensors to calibrate the forward position of a user with the forward orientation in-game prior to decoupling the current camera position and the user's body position. In another embodiment, upon initiation of a game the current position of the user outside of the game, determined by the sensors in omnidirectional locomotion platform, the harness, or the headset can be calibrated to the starting position of the game. For example, if an in-game user is initiated facing east, then the direction the outside user is facing when the game is initiated can be calibrated east.
In an embodiment, decoupling can be implemented in existing games. Existing games are not configured for decoupling, however the decoupling effect can still be achieved by generating one or more keystrokes based on the user's current camera position. For example, if the user walks forward on the omnidirectional locomotion platform while looking 90 degrees to the left, decoupling can be accomplished by generating the “D” key or left movement key. The absolute orientation framework can be converted to the relative orientation framework by taking into account the current camera direction. In another example, if the user walks forward on the omnidirectional locomotion platform while looking 45 degrees to the right, achieving the decoupling effect can be accomplished by generating the “W” and “A” keys simultaneously or in an alternating manner. In another example, if the user walks forward on the omnidirectional locomotion platform while looking 15 degrees to the right, achieving the decoupling effect can be accomplished by generating more “W” keys than “A” keys.
In an embodiment, a method for detecting a quick stop on an omnidirectional locomotion system can comprise, receiving an angular velocity at a predefined interval, determining a user movement based on the angular velocity, applying a smoothing filter on the angular velocity, determining when the angular velocity is equal or less than a predefined threshold, calculating a slope of the angular velocity, determining when the slope approaches zero for a predefined interval, determining the quick stop when the angular velocity is within the predefined threshold and the slope approaches zero for a predefined interval.
In an embodiment, a locomotion system platform can include sensors, wherein the sensors can be used to determine characteristics of the user operating the locomotion system. The sensors can be located on or within the platform, or on a user of the platform. Another embodiment, relates to an absolute orientation framework, where a character is able to move independently from the camera position (which is the user's viewpoint). The direction a user is looking is ignored and the user can move in an absolute way. If the user walks “north” on the locomotion system, the user in the game will move North in the game, regardless of the camera position.
In an embodiment, a locomotion system platform can comprise one or more sensors distributed in a geometric pattern, one or more electronically coupled printed circuit boards, the one or more sensors electronically coupled to the one or more printed circuit boards, one or more micro-controller units, the one or more micro-controller units electronically coupled to the one or more printed circuit boards and a computer system. The micro-controller units can be electronically coupled to the printed circuit boards and computer system by short-range wireless, for example Bluetooth, WI-FI, or NFS. The computer system can be a server, gaming system, or mobile device, for example, an XBOX, PlayStation, Nintendo, a mobile phone, a tablet, a laptop, a smartphone or a PDA. The sensors can include, but are not limited to capacitance sensors, inertial sensors (IMU), ambient light sensors, magnetic tracking sensors, acoustic sensors, pressure sensors, optical tracking sensors, hall effect sensor, and infrared sensors. In another embodiment, the geometric pattern is concentric circles.
In an embodiment, a forward step can be generated when one or more sensors on a halo are activated. For example, one or more sensors in a halo or platform can be activated by a capacitance reading. Capacitance and time data from the activated sensor can be stored in a computer system. A determination can be made if one or more adjacent sensors are activated. In another embodiment, one or more sensors on a user can be actuated by an inertial measurement or optical measurement. A forward step can be generated.
In an embodiment, a velocity vector can be generated when one or more sensors on a halo are activated. For example, one or more sensors in a halo or platform can be activated by a capacitance reading. Capacitance and time data from the activated sensor can be stored in a computer system. A determination can be made if one or more adjacent sensors are activated. In another embodiment, one or more sensors on a user can be actuated by an inertial measurement or optical measurement. A velocity vector can be generated.
In an embodiment, a step direction can be calculated. One or more sensors can transmit location data and capacitance values to a computer system. In another embodiment, one or more sensors can transmit inertial measurement or optical measurement values. The computer system can normalize the location data of the one or more sensors. The computer system can further weight the normalized position vectors. The computer system can further accumulate the weighted normalized position vectors. The computer system can further normalize the accumulated vectors.
In an embodiment, a velocity of one or more steps can be calculated. A computer system can zero sensors, for example in a center zone. One or more sensors can transmit location data and capacitance values to a computer system. In another embodiment, one or more sensors can transmit inertial measurement or optical measurement values. The computer system can normalize the location data of the one or more sensors. The computer system can further weight the normalized position vectors. The computer system can further accumulate the weighted normalized position vectors. The computer system can further normalize the accumulated vectors. The computer system can determine the length of the accumulated vector. The computer system can calculate the velocity of the accumulated vector.
In an embodiment, a locomotion system platform can provide natural vertical movement. The vertical movement can enable a user to crouch or jump while operating the locomotion system. The vertical movement can comprise a ball bearing system, a spring counterweight, an overheard spring suspension, a pivot arm, a magnetic levitation, a hydraulic actuation, and/or a compressed gas system.
In an embodiment, a locomotion system can comprise a braking mechanism, specifically to prevent a user from falling. When a user is operating the locomotion system, a horizontal force is applied. The concave base of the locomotion system, while enabling a user forward movement by the applied horizontal force, can cause a user to fall or lose balance. A braking mechanism can prevent a user from falling or losing balance by counteracting the horizontal force. The braking mechanism can comprise a counter-weight, a frictional force, and cable brake.
In an embodiment, the locomotion system can accommodate an industrial user. The locomotion system can accommodate a user using a weapon, for example an M4 carbine. The locomotion system can further accommodate a user dressed in standard industrial gear and attire, for example a modular tactical vest, patrol pack, improved load bearing equipment (ILBE), and modular lightweight load-carrying equipment (MOLLE).
In an embodiment, the standard industrial gear can integrate with the locomotion system, specifically, load bearing/carrying equipment can attach to the locomotion system harness. The attachment can be done using Pouch Attachment Ladder System (PALS).\
In an embodiment, a method of generating a gaming input comprising calculating a velocity, calculating a heading, translating the velocity and the heading into 2-dimensional Cartesian coordinates, normalizing the 2-dimensional Cartesian coordinates into a minimum to maximum scale range. In an embodiment, the velocity can be calculated by a distance one or more of a user's foot travels divided by the time it took to travel the distance. In another embodiment, the velocity can be calculated by a pedometry rate, wherein the pedometry rate is determined by monitoring a frequency of steps over a predefined interval. In another embodiment, the velocity can be calculated by monitoring an acceleration of one or more of a user's foot. In another embodiment, the velocity is calculated by normalizing an angular velocity, wherein the angular velocity is a change in rotation of one or more of a user's foot. In another embodiment, the heading can be translated relative to a real world axis and the real world axis can be magnetic North. In another embodiment, the heading can be calibrated to a magnetic North to an initial orientation of a user by an offset. In another embodiment, the heading can be translated relative to an orientation of a user's torso. In another embodiment, the heading can be translated relative to an orientation of a user's head. In another embodiment, the minimum to maximum scale range is defined by gaming input descriptors. In another embodiment, the Y 2-dimensional Cartesian coordinate is for forward or backwards movement. In another embodiment, the X 2-dimensional Cartesian coordinate is for sideways movement.
In another embodiment, a method of generating a stop gaming input comprising calculating a velocity, wherein the velocity is a change in rotation of one or more of a user's foot, normalizing the velocity, determining when the normalized velocity drops below a predefined threshold, determining when a slope of the normalized velocity approaches zero for a predefined interval.
In another embodiment, a method comprising receiving one or more sensor output, calculating a velocity from the one or more sensor output, calculating a heading from the one or more sensor output, translating the velocity and the heading into 2-dimensional Cartesian coordinates, normalizing the 2-dimensional Cartesian coordinates into a minimum to maximum scale range.
In order to describe the manner in which the features of the disclosure can be obtained, a more particular description of the principles briefly described above will be rendered by reference to specific examples thereof which are illustrated in the appended drawings. Understanding that these drawings depict only example embodiments of the disclosure and are not therefore to be considered to be limiting of its scope, the principles herein are described and explained with additional specificity and detail through the use of the accompanying drawings in which:
Various examples of the disclosure are discussed in detail below. While specific implementations are discussed, it should be understood that this is done for illustration purposes only. A person skilled in the relevant art will recognize that other components and configurations can be used without parting from the scope of the disclosure. In other instances, well-known methods, procedures, components, circuits, and networks have not been described in detail so as not to necessarily obscure aspects of the embodiment.
It will also be understood that, although the terms first, second, etc. can be used herein to describe various elements, these elements should not be limited by these terms. These terms are only used to distinguish one element from another. For example, a first sensor could be termed a second sensor, and similarly, a second sensor could be termed a first sensor, without departing from the scope of the present invention.
The terminology used in the description of the invention herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. As used in the description of the invention and the appended claims, the singular forms “a”, “an” and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will also be understood that the term “and/or” as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items. It will be further understood that the terms “comprises” and/or “comprising,” when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.
As used herein, the term “if” may be construed to mean “when” or “upon” or “in response to determining” or “in response to detecting,” depending on the context. Similarly, the phrase “if it is determined” or “if [a stated condition or event] is detected” may be construed to mean “upon determining” or “in response to determining” or “upon detecting [the stated condition or event]” or “in response to detecting [the stated condition or event],” depending on the context.
Upper sleds 125A can be configured to sit on top of halo 134 and lower sleds 125B can be configured to sit below halo 134. Upper sleds 125A and lower sleds 125B can enable a user to move in 360 degrees while providing added stability and preventing the user from falling (in any direction). In an embodiment, upper sleds 125A are configured for use, and lower sleds 125B are not configured for use, enabling the user the capability to jump. In another embodiment, when both upper sleds 125A and lower sleds 125B are configured for use, lower sleds 125B can contain a sensor (for example a Hall effect sensors, pressure sensors or IMU) for detecting a user jump movement and upper sleds 125A can contain a sensor (for example a Hall effect sensor, pressure sensor or IMU) for detecting a user crouch movement. In another embodiment, vertical members 126, upper sleds 125A, lower sleds 125B, or any other location on the sit harness 120, can include a sensor (for example, a Hall effect sensor, a pressure sensor or IMU sensor) configured to determine the orientation of sit harness 120 (and the orientation of the user's torso). In another embodiment, one or more Hall effect sensors can be arranged in or around halo 134. In another embodiment, one or more Hall effect sensors can be arranged in or around vertical members 126, upper sleds 125A, lower sleds 125B, or sit harness 120. One or more magnets can be arranged in or around vertical members 126, upper sleds 125A, lower sleds 125B, and sit harness 120 to communicate with the Hall effect sensors in halo 134 or sit harness 120.
Lower sleds 125B can include connection portions 1255 for removably attaching to vertical member 126. In an embodiment, lower sleds 125B can be can be substantially the same length as upper sleds 125A. In another embodiment, lower sleds 125B can be of a smaller size or larger size than upper sleds 125A. The width of lower sleds 125B can be narrow to not interfere with support struts. The impact portions of lower sleds 125B, which can come into contact with halo 134, can be rounded to aid user movement and minimize contact with halo 134. In another embodiment, the impact portion of lower sleds 125B can be rounded convex, concave, a flat surface, or any other shape as to minimize the contact surface with the underside of halo 134 while maximizing the desired functionality of preventing tilt. During operation, lower sled 126B can prevent a user from excessive tilting and provide more stability and security to the user, for example, when the user tilts forward or backwards, respectively the back or front of the lower sleds 125B impacts the underside of halo 134 preventing further tilting providing more stability and security to the user. The space between halo 134 and lower sleds 125B can determine the amount of tilt for the user. The space between halo 134 and lower sleds 125B can be altered by adjusting lower sleds 125B along vertical member 126. In an embodiment lower sleds 125B can be configured 0.25 inches below halo 134 providing the user with added stability while still enabling the user a full range of motion. The length of the lower sleds 125B can determine the amount of forward and backward tilt of a user, for example, a shorter length of lower sleds 125B enables the user more forward and backward tilt where a longer length of lower sleds 125B enables the user less forward and backwards tilt. To prevent excessive noise, lower sleds 125B can include a rubberized layer (not shown) enabled to dampen noise and impact of lower sleds 125B. In another embodiment, the rubberized layer can be metal springs or any other material to reduce impact noise. In another embodiment to prevent excessive noise, impact portions of lower sleds 125B with halo 134 can be rubberized, metal springs or any other material to reduce impact noise. In another embodiment, a sled can include full rollers to provide easy forward and reverse movements of a user.
In an embodiment, halo 134 can be removed and replaced with a halo of a different shape or size to accommodate a user of a different shape or size. In an embodiment, halo 134 can be of substantially torus shape, to enable minimum contact with sleds 125. In another embodiment, halo 134 can further be shaped similar to a torus, where a minor circle of a torus can be an ellipse or any other shape to enable minimum contact with sleds 125. In another embodiment, halo 134 can be interchanged with a myriad of halos with different circumferences in order to accommodate users of all sizes. In another embodiment, struts 150 can further be enabled for removal in order to accompany different halo designs to accommodate users of all sizes. In another embodiment, removable halo 134 and removable struts 150 can aid in transporting an omnidirectional locomotion system.
A POD can be pre-configured for use, for example, a first POD can be designated for use as a left foot, a second POD can be designated for use with a right foot, a third POD can be designated for use with a torso, a fourth POD can be designated for use with a head, a fifth and sixth POD can be designated with a left and right arm/hand respectively, a seventh POD can be designated to be used with a head, and an eighth POD can be designated with an accessory, such as a gun or sword. Furthermore, more IMUs can be designated or less IMUs can be designated based on specific needs of a user computing system. Alternatively, an POD can be configured before use. For example, a computing system can ask a user to move their left foot to configure an POD on their left foot. The computing system can ask a user to move their right foot to configure an POD on their right foot. The computing system can ask a user for each present POD.
Layer 2 460 can include a control box for receiving PODs 455A value output. In an embodiment, the control box is an aggregator board. Layer 2 460 can include an API 460A for translating received data from PODs 455A. Layer 2 460 can include different libraries 460B, for example, a filtering library, a processing library and motion library enabling translating received data from API 460A. In an embodiment, API 460A can call library functions to enable translation of the received POD data. Layer 2 460 can further include transmitting and receiving components 460C, for example, USB, Bluetooth, short-range wireless, 2.4 GHz radio, Wi-Fi and/or Ethernet.
Layer 3 465 can include a computing system 465B, for example, a PC, a tablet, a phone, a gaming system, or any other computing device. The computing device can run a game or application 465B along with an API 465A. The game or application 465B can be a computer game, a PlayStation game, an XBOX game, or any other game or application. The API 465A can receive data from Layer 2 460 and translate the received data to a format the game or application 465B can understand. Once translated by the API 465A, the movement of a user, tracked by PODs 455A in an omnidirectional locomotion system, can be translated into movements of a game or application. In another embodiment, the movement of a user, tracked by PODs 455A can be outside of an omnidirectional locomotion system.
Each block shown in
Method 510 can begin at block 511. At block 511, a pedometry rate of a user is determined by acceleration data received at an aggregator board from one or more PODs. In another embodiment, gyro data is received at an aggregator board. The pedometry rate can be the frequency of user steps during a predefined interval. In an embodiment, the pedometry rate can be determined by monitoring an acceleration of a user's feet during a predefined interval. In another embodiment acceleration data is received at a PCB that is separate from an aggregator. In another embodiment, accelerated data is received at a computing device bypassing an aggregator or PCB to determine a pedometry rate. In another embodiment, a change in rotation can be determined in place of a pedometry rate. When a pedometry rate is determined at block 511, the method can move to block 512.
At block 512, the determined pedometry rate of a user is used to calculate a velocity. A velocity is calculated by looking for peaks in acceleration followed by high frequency noise to indicate foot impact. Rate and magnitude of the relative energy in each foot step, as measured by the duration and peak of the acceleration, is used to calculate the rate of steps. In an embodiment, the velocity can be an average velocity. In another embodiment, the velocity can be a median velocity. In another embodiment, the velocity can be an angular velocity. When a velocity is calculated at block 512, the method can move to block 513.
At block 513, a heading is calculated for the one or more IMU. A corrected orientation is translated into real physical world axes to provide a heading of one or more PODs. In one embodiment, the one or more POD orientations can be averaged to provide an aggregate combined heading. In an embodiment, one or more PODs can be located on user's head, torso, feet, legs, arms, an accessory, halo, or harness. When a heading is determined at block 513, a method can move to block 514.
At block 514, the heading and velocity can be translated into 2-dimensional Cartesian coordinates (X, Y). The translated coordinates can represent gamepad and/or joystick values. For example, the velocity can be a magnitude or amplitude of the X and Y values and the heading can be translated into degree angles from relative magnetic North of the Earth. When the heading and velocity are translated into coordinates at block 514, the method can move to block 515.
At block 515, the coordinates are normalized into a minimum to maximum scale range, as defined by USB HID joystick/game pad descriptors. By virtue of control decoupled from camera view, additional movements such as walking backward, left and right strafing can be enabled. When the coordinates are normalized method 510 can end.
Method 510 can be used for a decoupled forward movement. A forward movement can be a relative movement in the Y direction relative to the center of one or more PODs, and generates a movement in the Y gamepad/joystick direction. An acceleration when a user foot is in the air can be measured in the direction of the heading of the foot. A forward velocity measurement can be then translated into “real world” coordinates relative to magnetic North of the Earth. All other motions not in the forward Y-axis of a POD, relative to the POD body, can be ignored to disallow spurious or false movements in alternate directions confining the motion identification process to forward motions.
Method 510 can be used for a decoupled backwards movement. A backwards movement can be a relative movement in the Y direction relative to the center of one or more PODs, and generates a movement in the Y gamepad/joystick direction. An acceleration when a user foot is in the air can be measured in the opposite direction of the heading of the foot. A backwards velocity measurement can be then translated into “real world” coordinates relative to magnetic North of the Earth. All other motions not in the backwards Y-axis of an POD, relative to the POD body, are ignored to disallow spurious or false movements in alternate directions confining the motion identification process to forward motions.
Method 510 can be used for a decoupled side movement or strafe movement. A side movement can be a relative movement in the X direction relative to the center of one or more POD, and generates a movement in the X gamepad/joystick direction. An acceleration when a user's foot is in the air can be measured in the perpendicular direction of the heading of the foot. A side velocity measurement can be then translated into “real world” coordinates relative to magnetic North of the Earth. All other motions not in the X-axis of a POD, relative to the POD body, are ignored to disallow spurious or false movements in alternate directions confining the motion identification process to forward motions.
Each block shown in
Method 520 can begin at block 521. At block 521, acceleration data is received at an aggregator from one or more PODs is used to determine a pedometry rate of a user. In another embodiment acceleration data is received at a PCB that is separate from an aggregator. In another embodiment, accelerated data is received at a computing device bypassing an aggregator or PCB to determine a pedometry rate. When a pedometry rate is determined at block 521, the method can move to block 522.
At block 522, the determined pedometry rate of a user is used to calculate a velocity. A velocity is calculated by looking for peaks in acceleration followed by high frequency noise to indicate foot impact. Rate and magnitude of the relative energy in each foot step, as measured by the duration and peak of the acceleration, is used to calculate the rate of steps. When a velocity is calculated at block 522, the method can move to block 523.
At block 523, a heading is calculated for the one or more PODs. An orientation of the one or more PODs is translated into relative body axes of the one or more PODs to determined an intended direction of motion. In one embodiment, the one or more PODs orientations can be averaged to provide an aggregate combined heading. In an embodiment, one or more PODs can be located on user's head, torso, feet, legs, arms, an accessory, halo, or harness. In this embodiment, real world coordinates are not calculated and are not used to provide heading. The one or more PODs relative self-orientations are then averaged to provide a heading. When a heading is calculated at block 523, a method can move to block 524.
At block 524 the aggregated combined heading and velocity can be translated into 2-dimensional Cartesian coordinates (X-axis and Y-axis). The translated coordinates can represent gamepad and joystick values. For example, the velocity can be a magnitude of the X and Y values and heading (orientation) is translated into degrees 90 degree angle increments from the forward (relative to Y-axis of the PODS). When the heading and velocity are translated into coordinates at block 524, the method can move to block 525.
At block 525 the coordinates are normalized into a minimum to maximum scale range, as defined by USB HID joystick/game pad descriptors. When the coordinates are normalized method 520 can end.
Method 520 can be used for forward and backwards coupled movements. Forward and backwards can be relative movement in the Y direction relative to the center of the PODs, and generates a movement in the Y gamepad/joystick direction. An acceleration when a user's foot is in the air can be measured in the direction of the camera position for forward movement and in the opposite direction of the camera position for backwards movement. All other axes, relative to the PODs, can be ignored to disallow spurious or false movements in alternate directions, therefore confining the motion identification process to forward and backwards motions.
Method 520 can be used for side coupled movement or strafing coupled movements. Side movements can be relative movement in the X direction relative to the center of the PODs, and generates a movement in the X gamepad/joystick direction. An acceleration when a user foot is in the air can be measured in the perpendicular direction of the camera position. All other axes, relative to the PODs, can be ignored to disallow spurious or false movements in alternate directions, therefore confining the motion identification process to side motions.
In determining movement of a user of an omnidirectional locomotion system, it is desirable to decrease the time for detecting walking has begun on the omnidirectional locomotion platform. A delay in detection can be perceived as lag between a user's movement on the platform and a user's avatar in a virtual environment. An additional layer for improved step detection performance for the initial step is specified in an embodiment where triggering off an acceleration above a minimum level (threshold) in the forward Y-direction (relative to the POD coordinates) generates a user movement in gamepad/joystick coordinates (relative to real world North of the Earth). This trigger can be armed during times when a motion library has not completed calculating acceleration and velocity intensities. Relative strength of the acceleration energy can be used to ease a transition from a “first step” trigger motion into a full motion library, for example, forwards walking, backwards walking, running, crouching, strafe, creep, jumping or any additional motion gestures detectable on the omnidirectional locomotion system. The trigger has a rate independent hysteresis to alleviate an appearance of jitteriness in user motions caused by noise in measured accelerometer data.
Decreasing a lag between the cessation of movement and its detection is specified in an embodiment which triggering off an acceleration below a maximum level in all relative directions (relative to the POD coordinates) forces user movement to stop. This trigger is armed during times when the motion library has identified intended user motions. The trigger has a rate independent hysteresis as to alleviate the appearance of jitteriness in user motions caused by noise in the measured accelerometer data.
Each block shown in
Method 530 can begin at block 531. At block 531, the method can receive, from one or more PODs, raw gyro data. In an embodiment the raw gyro data can be an angular velocity. The angular velocity can be used to determine if a user is moving forward or backwards, for example walking forwards/backwards or running forwards/backward by the change in rotation of a user's feet. In an embodiment if the angular velocity is non-zero the user can be moving. In another embodiment, the angular velocity can be determined by receiving the one or more POD data over a predefined interval. In another embodiment, the received data can be acceleration data for calculating a velocity. If at block 531 it is determined that the user is moving, the method can move to block 532.
At block 532, the method can normalize or smooth the raw data by applying a filter. In an embodiment, the raw gyro data can be run through a fast stopping filter. In regard to the fast stopping filter, the received raw gyro data can be run through an exponential moving average (EMA) filter, then the smoothed (filtered) values can be compared to previous smoothed values, to determine a smooth delta resulting in a smoothed gyro data graph. In another embodiment, the raw gyro data can be run through an analog speed filter. In regard to the angle speed filter the raw gyro x-axis values for both feet PODs can be run through an EMA filter to calculate the absolute value of each gyro. The filtered values can be added together, scaled, and then an offset is added. In an embodiment the offset can be a scale offset, i.e., so the value falls within a valid joystick output value. The offset value can then run through an EMA filter. The EMA filter can be a new EMA filter or the previously mentioned EMA filter. The result is a smooth output that is approximately equivalent to a velocity, for example a walking velocity. An example smoothed gyro data graph can be seen in
At block 533, the method can determine if the smoothed gyro data at block 532 drops within a predefined threshold. In an embodiment the smoothed gyro data can be an angular velocity (rate of rotation per second) in the direction of motion. For example, the angular velocity can be determined from the gyro axis perpendicular to the direction of the motion. The predefined threshold can be used to determine when the user is slowing down. In an embodiment, predefined threshold can be 0.33 degrees per second. The angular velocity can be monitored at a predetermined interval, for example 1 ms, 5 ms, 10 ms, 15 ms, and 20 ms. As shown in
At block 534, the method can determine when the slope of the smoothed gyro data has approached zero for a predefined interval. For example, during a predefined interval of 1 ms, 5 ms, 10 ms, 15 ms, or 20 ms. When the slope of the angular velocity continues to approach zero, a stop can be detected. In an embodiment, a stop can be detected when the slope is less than 0.01 degrees per second squared. Alternatively, if during this same interval the slope does not continue to approach zero, a stop cannot be detected. In an embodiment, the slope deltas (during the predefined interval) can be analyzed to locate a peak. The velocity can be set to the maximum of each peak until the next peak is located, which then can be set to the velocity. In another embodiment, when the angular velocity slope is within a minimum predefined window, a counter is incremented. If the counter reaches seven, the velocity is set to zero. When the predefined interval has ended the method can move to block 535 if the slope approached zero for the predefined interval or can return to block 531 if the slope did not approached zero for the predefined interval.
At block 535, the method can detect a quick stop. For example, when the smooth gyro data is within the threshold and when the slope of the smooth gyro data approached zero during the predefined interval a quick stop is detected. When a quick stop is detected, method 530 can end.
Platform 170 can be divided into two or more concentric circles. For example, as shown in
Sensors 615 can be of equivalent size or of differing size. For example, sensors 615 can be of a smaller size when located near the center of platform 170 and progressively larger the further from the center of platform 170 the sensors 615 are located. In another embodiment, the sensors can be of equivalent size, for example, 1.5, 2.5, 3.5, 4.5 or 5.5 inches or any other size in diameter.
Slice 602 can contain one or more sensors 615 and PCB 620. Slices 603-608 can be substantially similar to slice 602. Slice 602 can be connected in a daisy chain with slices 601 and 603. Slice 602 can receive power and serial bus from slice 601. Slice 602 can transmit power and serial bus to slice 603. This process can be repeated until slice 608 receives power and serial bus from slice 607. This process can be repeated for more or less slices depending on the number of slices in platform 170. Slices 602-608 can contain a redundant MCU 625 and Program and Debug Kit 630.
Each block shown in
Method 700 can begin at block 701. At block 701, one or more sensors can change from off to on and on to off, when the sensor has a value above a threshold. In an embodiment, the value can be a capacitance or optical value. The threshold can also function as a by-pass filter for sensor capacitances. Each sensor can have an independent threshold value. The threshold value can be adjustable. Threshold values can be adjusted based on a number of variables, for example, the position of sensors in a platform 170, the number of sensors in a platform 170, the size of the sensors in a platform 170, and the size of the activating component activating and deactivating the sensors, for example a user's feet. In an embodiment, the threshold value can determine if a sensor is on or off, providing a direction vector of approximately 22 degrees. In another embodiment, the threshold value as a by-pass filter, wherein only capacitances above the threshold are used in calculating the direction vector and speed vector of approximately 2 to 3 degrees.
At block 702, sensor values or data can be saved. The sensor values can be point-in-time scan values of all sensor data. Sensor data can include, but is not limited to capacitance value, operational state (on or off), historical time values, such as time stamp of last ON event, time stamp of last OFF event. The saved sensor values can be used by computer system 635 to calculate movements by each of the user's feet. The saved sensor values can further be used to historically calculate the user's previous movements to aid in determining the user's actions, for example running, walking, walking backwards, jumping, forward jumping, strafing, and crouching.
At blocks 711 to 712, one or more sensors located in an outer ring can be change from off to on or from on to off. A sensor in an outer ring can be activated to the “on” position by reading a sensor value greater than or equal to the threshold value, for example, one or both of a user's feet moving over a sensor located in an outer ring. A sensor in an outer ring can be deactivated to the “off” position by reading a sensor value less than the threshold value, for example, one or both of a user's feet moving away from a sensor located in an outer ring. At block 713, method 700 can generate “W” or forward in-game movement and method 700 can end.
At blocks 721 to 722, one or more sensors in a middle ring can change from on to off or from on to off. A sensor in a middle ring can be activated to the “on” position by a reading a sensor value greater than or equal to the threshold value, for example, one or more of a user's feet moving over a sensor located in a middle ring. A sensor in a middle ring can be deactivated to the “off” position by reading a sensor value less than the threshold value, for example, one or both of a user's feet moving away from a sensor located in a middle ring.
At block 723, the computer system can check the point-in-time sensor scan of all sensors located in one or more adjacent inner rings of platform 170. At block 724, if one or more sensors are activated, “on,” in one or more adjacent inner rings of the same section as the sensor in the middle ring, method 700 can generate “W” or a forward in-game movement and method 700 can end.
At blocks 731 to 732, one or more sensors in an inner ring can change from off to on or from on to off. A sensor in an inner ring can be activated to the “on” position by reading a sensor value greater than or equal to the threshold value, for example, one or more of a user's feet moving over a sensor located in an inner ring. A sensor in an inner ring can be deactivated to the “off” position by reading a sensor value less than the threshold value, for example, one or both of a user's feet moving away from a sensor located in an inner ring.
At blocks 733, the computer system can check the point-in-time sensor scan of all sensors located in one or more adjacent middle rings of platform 170. At block 734, if one or more sensors is activated “on” in one or more adjacent middle rings of a same section as the sensor in the inner ring, method 700 can generate “W” or a forward in-game movement and method 700 can end and method 700 can end.
Method 750 can begin at block 751. At block 751, one or more sensors can change from off to on when the sensor has a value greater than a threshold. In an embodiment, the value can be a capacitance or optical value. Each sensor has an independent threshold value. The threshold value is adjustable. Threshold values can be adjusted based on a number of variables, for example, the position of sensors in a platform 170, the number of sensors in a platform 170, the size of the sensors in a platform 170, and the size of the activating component activating and deactivating the sensors, for example a user's feet. In an embodiment, the threshold value can determine if a sensor is on or off, providing a direction vector of approximately 22 degrees. In another embodiment, the threshold value as a by-pass filter, wherein only capacitances above the threshold are used in calculating the direction vector and speed vector of approximately 2 to 3 degrees.
At block 761, one or more sensors in an outer ring can change from off to on. A sensor in an outer ring can be activated to the “on” position by reading a sensor value greater than or equal to the threshold value, for example, one or both of a user's feet moving over a sensor located in an outer ring. At block 762, method 750 can generate “W” or forward in-game movement and method 700 can end.
At blocks 771, one or more sensors in a middle ring can change from off to on. A sensor in a middle ring can be activated to the “on” position by reading a sensor value greater than or equal to the threshold value, for example, one or more of a user's feet moving over a sensor located in a middle ring. At block 772, method 750 can save sensor data. The sensor values can be point-in-time scan values of one or more sensor data. Sensor data can include, but is not limited to capacitance value, operational state (on or off), historical time values, such as time stamp of last ON event, time stamp of last OFF event. The saved sensor values can be used by computer system 735 to calculate movements by each of the user's feet. The saved sensor values can further be used to calculate, historically, the user's previous movements to aid in determining the user's actions, for example running, walking, walking backwards, jumping, forward jumping, strafing, and crouching.
At blocks 781, one or more sensors in an inner ring can change from off to on. A sensor in an inner ring can be activated to the “on” position by reading a sensor value greater than or equal to the threshold value, for example, one or more of a user's feet moving over a sensor located in an inner ring. At blocks 782, the computer system can check the point-in-time sensor scan of all sensors located in one or more adjacent middle rings of platform 170. At block 783, if one or more sensors is activated “on” in one or more adjacent middle rings of a same section as the sensor in the inner ring, method 750 can generate “W” or forward in-game movement and method 750 can end.
Each block shown in
Method 800 can begin at block 802. At block 802, one or more sensors changes can be detected, for example, a sensor can change from off to on and on to off, when the sensor has a value above a threshold value. In an embodiment, the value can be a capacitance or optical value. The threshold value can also function as a by-pass filter for sensor capacitances. Each sensor can have an independent threshold value. The threshold value can be adjustable. Threshold values can be adjusted based on a number of variables, for example, the position of sensors in a platform 170, the number of sensors in a platform 170, the size of the sensors in a platform 170, and the size of the activating component activating and deactivating the sensors, for example a user's feet. In an embodiment, sensors 615 can include one or more capacitive sensors that register a default capacitance. In another embodiment, registered capacitive changes that occur in excess of the threshold can indicate that the respective sensor has changed state, for example from an “off” to an “on” state, indicating engagement in an associated position on the locomotion system platform 170 and providing a direction vector of approximately 22 degrees. In another embodiment, the threshold value as a by-pass filter, wherein only capacitances above the threshold are used in calculating the direction vector and speed vector of approximately 2 to 3 degrees.
In block 804, a save sensor scan operation is performed in which time data is saved for one or more or all sensor scan data. The sensor values can be point-in-time scan values of one or more sensor data. Sensor data can include, but is not limited to capacitance value, operational state (on or off), historical time values, such as time stamp of last ON event, time stamp of last OFF event. The saved sensor values can be used by computer system 635 to calculate movements by each of the user's feet. The saved sensor values can further be used to historically calculate the user's previous movements to aid in determining the user's actions, for example running, walking, walking backwards, jumping, forward jumping, strafing, and crouching. The time data associated with indications of sensor state changes can be used to calculate velocity vectors from sensor data.
At blocks 806 to 808, one or more sensors located in an outer ring can be changed from off to on or from on to off. A sensor in an outer ring can be activated to the “on” position by reading a sensor value greater than or equal to the threshold value or by a step direction vector method, for example, one or both of a user's feet moving over a sensor located in an outer ring. A sensor in an outer ring can be deactivated to the “off” position by reading a sensor value less than the threshold value or by a step direction vector method, for example, one or both of a user's feet moving away from a sensor located in an outer ring. At block 810, method 800 can generate a velocity vector of an outer ring sensor and method 800 can end.
At blocks 812 to 814, one or more sensors located in a middle ring can be changed from off to on or from off to on. A sensor in a middle ring can be activated to the “on” position by reading a sensor value greater than or equal to the threshold value or by a step direction vector method, for example, one or both of a user's feet moving over a sensor located in a middle ring. A sensor in a middle ring can be deactivated to the “off” position by reading a sensor value less than the threshold value or by a step direction vector method, for example, one or both of a user's feet moving away from a sensor located in a middle ring.
At block 816, the computer system can check the point-in-time sensor scan 804 of all sensors located in one or more adjacent inner rings of platform 170. At block 818, if one or more sensors are activated, “on,” in one or more adjacent inner rings of the same section as the one or more sensors in the middle ring, method 800 can generate a velocity vector of the one or more activated middle ring sensors and method 800 can end.
At block 820 to 822, one or more sensors in an inner ring can change from off to on or from on to off. A sensor in an inner ring can be activated to the “on” position by reading a sensor value greater than or equal to the value or by a step direction vector method, for example, one or more of a user's feet moving over a sensor located in an inner ring. A sensor in an inner ring can be deactivated to the “off” position by reading a sensor value less than the threshold value or by a step direction vector method, for example, one or both of a user's feet moving away from a sensor located in an inner ring.
At block 824, the computer system can check the point-in-time sensor scan of all sensors located in one or more adjacent middle rings of platform 170. At block 826, if one or more sensors are activated “on” in one or more adjacent middle rings of a same section as the sensor in the inner ring, method 800 can generate a velocity vector of the one or more activated middle ring sensors and method 800 can end.
Method 850 can begin at block 852. At block 852, one or more sensors can change from off to on when a sensor reads a value greater than a threshold value. Each sensor can have an independent threshold value. The threshold value can be adjustable. Threshold values can be adjusted based on a number of variables, for example, the position of sensors in a platform 170, the number of sensors in a platform 170, the size of the sensors in a platform 170, and the size of the activating component activating and deactivating the sensors, for example a user's feet. In an embodiment, sensors 615 can include one or more capacitive sensors that register a default capacitance. In another embodiment, registered capacitive changes that occur in excess of the threshold can indicate that the respective sensor has changed state, for example from an “off” to an “on” state, indicating engagement in an associated position on the locomotion system platform 170 and providing a direction vector of approximately 22 degrees. In another embodiment, the threshold value as a by-pass filter, wherein only capacitances above the threshold are used in calculating the direction vector and speed vector of approximately 2 to 3 degrees.
At block 854, one or more sensors in an outer ring can change from off to on. A sensor in an outer ring can be activated to the “on” position by a reading over the threshold value or by a step direction vector, for example, one or both of a user's feet moving over a sensor located in an outer ring. In another embodiment, one or more outer ring sensors are activated only following an activation of one or more adjacent middle ring sensors in the same section. At block 856, method 850 can generate a velocity vector of one or more outer ring sensors and method 850 can end.
At block 858, one or more sensors in a middle ring can change from off to on. A sensor in a middle ring can be activated to the “on” position by reading a sensor value greater than or equal to the threshold value or by a step direction vector, for example, one or more of a user's feet moving over a sensor located in a middle ring. At block 860, method 850 can save sensor data and then method 850 can end. The sensor values can be point-in-time scan values of one or more sensor data. Sensor data can include, but is not limited to capacitance value, operational state (on or off), historical time values, such as time stamp of last ON event, time stamp of last OFF event. The saved sensor values can be used by computer system 635 to calculate movements by each of the user's feet. The saved sensor values can further be used to historically calculate the user's previous movements to aid in determining the user's actions, for example running, walking, walking backwards, jumping, forward jumping, strafing, and crouching.
At block 862, one or more sensors in an inner ring can change from off to on. A sensor in an inner ring can be activated to the “on” position by reading a sensor value greater than or equal to the threshold value or by a step direction vector, for example, one or more of a user's feet moving over a sensor located in an inner ring. At blocks 864, the computer system can check the point-in-time sensor scan of one or more of the sensors located in one or more adjacent middle rings in the same section of platform 170. At block 866, if the time difference between the current time of activation of the inner ring sensor and the time of the last “OFF” time stamp of the one or more adjacent middle ring sensors is less than a variable time stamp threshold, for example 1 millisecond, method 850 can generate a velocity vector of one or more middle ring sensors at block 868 and method 850 can end.
The velocity vector generated in
Velocity vectors can be generated using (X,Y) position coordinates of one or more sensors in which a change is registered, as shown in
A vector speed representation can be calculated by multiplying normalized coordinates by a speed value, for example, a value between 0 and 1. The resulting vector “length” can represent the speed. In another embodiment, vector speed calculations can be performed based on a frequency of user steps. In another embodiment, a time interval between activation of consecutive or adjacent sensors can be used to determine the vector speed. For example, using the saved sensor time stamp data.
In an embodiment, a velocity vector calculation can be used to calculate a user jump. For example, using the inner ring sensors and time stamp data of the center sensors to calculate activation and deactivation of the each foot. In another embodiment, the inner, middle and outer sensors can be used to calculate a forward, sideways, and backwards jump.
Each block shown in
Method 900 begins at block 902. At block 902 a relative velocity vector input can be received. Subsequently, an angle of the vector input is computed. The angle computed can be the angle measure between the velocity vector direction and absolute north, the front of platform 170. At block 904, if the angle of the velocity vector input is 0, then a previous vector quantity 905 is used. In an embodiment, if after receiving 0 vectors for 1/10th second, the vector is reset to 0. At block 906, if the angle of the velocity vector input is less than 30 degrees, the forward motion direction at block 907 is used. At block 908, if the angle of the velocity vector input is between 30 and 80 degrees, a 45 degree motion selection at block 909 is made, for example, in either the left or right direction. At block 910, if the angle of velocity vector input is between 80 and 90 degrees, a 90 degree motion at block 911 selection is made, for example, in either the left or right direction. At block 912, if the angle of the velocity vector input is greater than 90 degrees, a backstep motion at block 913 is made vector is reset to 0.
Current video games use a relative orientation framework. Pushing a joystick to the right or pressing “D” on a keyboard can move a user's avatar 90 degrees to the right from a current viewpoint or camera position. In one embodiment, the current camera position can be obtained by measuring a direction of a head mounted display (e.g., a virtual reality headset). Thus in the relative orientation framework, movement can be relative to the current camera position. To further illustrate, pushing the joystick up or “W” on the keyboard can move the user's avatar in the forward in the current camera position.
In an example embodiment, a game can use an absolute orientation framework (decoupled framework). When a game is played using platform 170, the user's avatar can move independently from the current viewpoint or camera position. The user's avatar can move in an absolute manner relative to an in-game map. For example, if the user walks the direction north on platform 170, the user's avatar can move north on the in-game map, regardless of the current camera position. In a related aspect, the head mounted display can include a magnetometer. The magnetometer can use an absolute orientation framework similar to platform 170, wherein the current in-game camera position can be the direction the user is physically looking outside the game.
In an embodiment, the direction “north” can be magnetic north or polar north. In another embodiment, the direction “north” can be a designated direction set or calibrated at a start of a game. For example, a user wearing a head mounted display, such as a virtual reality headset, can look forward relative to the user's body during calibration, which can calibrate the current forward looking direction with a forward walking orientation prior to decoupling the current camera position and the user's body position. In another embodiment, the halo or harness attached to platform 170, can include sensors to calibrate the forward position of a user with the forward orientation in-game prior to decoupling the current camera position and the user's body position. In another embodiment, upon initiation of a game the current position of the user outside of the game, determined by the sensors in platform 170, the harness, or the headset can be calibrated to the starting position of the game. For example, if an avatar is initiated facing east, then the direction the user is facing when the game is initiated can be calibrated east.
In an example embodiment, decoupling can be implemented in existing games. Existing games are not set up for decoupling, however the decoupling effect can still be achieved by generating one or more keystrokes based on the user's current camera position. For example, if the user walks forward on the platform 170 while looking 90 degrees to the left, decoupling can be accomplished by generating the “D” key or left movement key. The absolute orientation framework can be converted to the relative orientation framework by taking into account the current camera direction. In another example, if the user walks forward on the platform 170 while looking 45 degrees to the right, achieving the decoupling effect can be accomplished by generating the “W” and “A” keys simultaneously or in an alternating manner. In yet another example, if the user walks forward on the platform 170 while looking 15 degrees to the right, achieving the decoupling effect can be accomplished by generating the more “W” keys than “A” keys.
In an embodiment, the sensors can monitor directions of a user's left foot and right foot to determine the user's intended movement direction.
Each block shown in
Method 1000 can begin at block 1001. At block 1001, one or more sensors can be activated by recording a measurement. In an embodiment, sensors on platform 170 can be activated by recording a capacitance measurement. For example, if a user steps forward to the outer two rings of slice 601, the four sensors in rings 611 and 612 can have capacitance readings. If the capacitance readings of the sensors are greater than a predefined threshold, the capacitance readings can be used to calculate the step direction. In an embodiment all sensor readings greater than zero can be used in calculating the step direction. In another embodiment, sensors can be activated by recording an inertial measurement or optical measurement. When a sensor value has been recorded at one or more sensors, the method can proceed to block 1002.
At block 1002, the active sensors with a recorded value greater than or equal to threshold can be normalized. During the normalization process, the position of one or more sensors can be converted to one or more direction vectors. For example, if the active sensors are in slice 601, the normalized direction vectors can be in the direction of slice 601. When the normalization of the sensor positions has completed, the method can proceed to block 1003.
At block 1003, weighted vectors can be calculated for the normalized position vectors. In an embodiment, the weighted vectors by capacitance can be calculated. For example, sensors with a greater capacitance reading can be assigned a higher weight. In an embodiment the weight of each active sensor is calculated by multiplying the normalized position vectors by the sensor capacitance values. When the vectors have been weighted the method can move to block 1003.
At block 1004, the weighted vectors can be accumulated to calculate an accumulated vector. For example, the directionally weighted vectors can be added together to calculate an accumulated vector. When an accumulated vector has been calculated the method can move to block 1005.
At block 1005, the accumulated vector can be normalized. For example, normalizing the accumulated vector can determine the step direction vector. When the accumulated vectors have been normalized and the step direction vector created method 1000 can end.
Method 1050 illustrated in
Each block shown in
Method 1050 can begin at block 1052. At block 1052 an event can occur, for example, a current time, position an inertial, optical or capacitance measurement of one or more sensors. When an event has occurred, the method can proceed to block 1054. At block 1054, the sensors can be zeroed. In an embodiment, the sensors in a center zone of platform 170 can be zeroed. In an embodiment, the center zone can be the inner two rings of platform 170. In another embodiment center zone can a geometric shape, a circle, hexagon or octagon. When the sensors have been set to zero, method 1050 can proceed to block 1056.
At block 1056, a threshold can be used to filter active sensors. In an embodiment, a threshold can be used to filter active sensors based on capacitance, optical measurements, or inertial measurements. For example, if the capacitance readings of the active sensors are greater than a predefined threshold, the active sensor can be included in the velocity calculation. In an embodiment the threshold can be set to zero. When the active sensors with a capacitance reading greater than or equal to threshold value are determine, the method can proceed to block 1058. At block 1058, a step direction vector is calculated. For example, the step direction vector can be calculated using method 1000. When the step direction vector is calculated method 1050 can proceed to block 1060.
At block 1060, the length of the direction vector is determined. If the length of the direction vector is greater than zero, method 1050 can proceed to a block 1062. At block 1062, it is determined if a user has taken a step. For example, an active sensor reading outside of the center zone can be a confirmation of a step. If it is determined a step was taken, method 1050 can proceed to a block 1080. At block 1080 the velocity can be calculated. In an embodiment, the velocity can be a vector which is the average of two-step direction vectors multiplied by the step rate or speed. In the same embodiment, the magnitude of the velocity vector is the user speed. A zero length vector can mean the user is stopped. A vector length between 0 and 1 can mean the user is walking or running. A vector length of 1 can mean the user is running. The velocity can be calculated, in an embodiment, using Equations (1)-(3).
time=clamp(abs(timeStep[0]−timeStep[1]),minTime,maxTime) Equation (1)
speed=1.0f−(time−speedRunning)/(speedSlow−speedrunning) Equation (2)
vVelocity=normalize(vStep[0]+vStep[1])*speed Equation (3)
Once the velocity is calculated at block 1080, the method can proceed to block 1082 and end.
If at block 1062 a step was not taken, the method can proceed to block 1064. At block 1064, a step is recorded. For example, the direction vector has a length greater than zero (block 1060) and the sensors in center zone were zeroed out (block 1054), therefore a foot has moved to the outer sensors. When a step is recorded, method 1050 can move to block 1080 to calculate a velocity. Once the velocity is calculated at block 1080.
If at block 1060, the length of the direction vector is equal to or less than zero, method 1050 can proceed to a block 1070. At block 1070, it is determined if a user has taken a step. For example, an active sensor reading outside of the center zone, a step has been taken. If it is determined a step was taken, method 1050 can proceed to a block 1072. At block 1072, the number of steps is incremented and a step variable is set to false. For example, there was in a step (foot in outer sensors) and now there is no foot detected in the outer sensors, thus step is complete. After the step is completed, method 1050 can proceed to block 1080.
If at block 1070, a step was not taken, the method can proceed to block 1074. At block 1074, it can be determined if step was too slow. In an embodiment, if a foot stayed in an outer zone of platform 170. In an embodiment, a step being too slow can be determined by subtracting the current time from the previous step time and then determining if the calculated value is greater or less than a step threshold value. If the step is too slow then method 1050 can proceed to block 1076. At block 1076, the steps values are reset. For example, number of steps, step vector and step time can be set to zero. When the step values are set to zero method 1050 can proceed to block 1080. If at block 1074 a step was not too slow, method 1050 can proceed to block 1080.
Vertical supports 1101 can enable vertical movement of halo 134. In an embodiment, vertical supports 1101 can be hollow to enable entry of horizontal struts 1102 and coupling to vertical poles 1105 by a linear ball bearing system. Vertical supports 1101 can be of variable length. Vertical supports 1101 can also include a protective covering. The protective covering can prevent foreign materials from entering the hollow portion of Vertical supports 1101 and thus prevent foreign materials from interfering with linear ball bearing system, pole 1105 and springs 1106. For example, the protective covering can be overlapping bristles. In an embodiment, the vertical supports 1101 are far enough away from the center support to prevent interference with a user and any industrial gear, for example a gun, sword, baton, paddle, racquet. Vertical supports 1101 can keep vertical poles 1105, vertical for example, 90 degree angle, to enable consistent vertical movement from the user. Horizontal struts 1102 extend from halo 134 and attached to the vertical poles 1105 by a ball bearing system. The ball bearing system can enable vertical movement of halo 134. In another embodiment, horizontal struts 1102 can also extend at an acute angle, for example, 75 degrees, 45 degrees, or any other angle less than 90 degrees, as shown in
Springs 1106 can raise the halo 134 and struts 150 when a user is in the standing position. Springs 1106 can provide support during forward user movements. Springs 1106 can further compress enabling a user to crouch, and aid a user in standing, standing up from a crouch, or jumping by uncompressing. The spring constant can be calculated, in an embodiment, using Hooke's Law. The total force can be the weight of the halo can be added to the upward force needed to provide stability for a user. The stability can differ depending on the height of a user. The total force can be divided by the number of vertical supports. In an embodiment, the spring constant can be between 0.2 lb/in and 4.0 lb/in. In another embodiment, the spring constant can be between 0.4 lb/in and 2.0 lb/in.
In an embodiment, vertical supports can include telescoping poles. In another embodiment vertical supports are telescoping poles. For example, the height of the vertical supports/telescoping poles will be the same height as halo. The telescoping pole can enable a user to move vertically by compressing and extending in response to the user's movements.
In an embodiment, the vertical supports can be a bungee cord or suspended spring system. In this embodiment, a minimal resistance would be applied to the halo when a user is in the crouch position. Upon a user moving to the stand position from the crouch position, the resistance on the halo would subside. In another embodiment, vertical movement can be achieved by a pivot arm system. A pivot can be attached to the struts on either the vertical support or the halo. Upon a user moving to the crouch or stand position, the pivots can actuate enabling the vertical movement of the user. In another embodiment, vertical movement can be achieved by a magnetic levitation system. The struts can be attached to the vertical support by magnets. The magnetic field created by the magnetic polarization can enable vertical movement. In another embodiment, vertical movement can be achieved by hydraulic actuation. The horizontal struts can be attached to the vertical supports by hydraulics. Vertical movement of the user can be actuated by the hydraulics. In another embodiment, vertical movement can be achieved by compressed gas. Vertical movement can be achieved by actuating a regulator causing the release and restriction of the flow of compressed gas.
Embodiments described herein comprise a combination of features and advantages intended to address various shortcomings associated with certain prior devices, systems, and methods. The foregoing has outlined rather broadly the features and technical advantages of the invention in order that the detailed description of the invention that follows may be better understood. The various characteristics described above, as well as other features, will be readily apparent to those skilled in the art upon reading the detailed description, and by referring to the accompanying drawings. It should be appreciated by those skilled in the art that the conception and the specific embodiments disclosed may be readily utilized as a basis for modifying or designing other structures for carrying out the same purposes of the invention. It should also be realized by those skilled in the art that such equivalent constructions do not depart from the spirit and scope of the invention as set forth in the appended claims.
Examples within the scope of the present disclosure can also include tangible and/or non-transitory computer-readable storage media for carrying or having computer-executable instructions or data structures stored thereon. Such non-transitory computer-readable storage media can be any available media that can be accessed by a general purpose or special purpose computer, including the functional design of any special purpose processor as discussed above. By way of example, and not limitation, such non-transitory computer-readable media can include RAM, ROM, EEPROM, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage devices, or any other medium which can be utilized to carry or store desired program code means in the form of computer-executable instructions, data structures, or processor chip design. When information is transferred or provided over a network or another communications connection (either hardwired, wireless, or combination thereof) to a computer, the computer properly views the connection as a computer-readable medium. Thus, any such connection is properly termed a computer-readable medium. Combinations of the above should also be included within the scope of the computer-readable media.
Computer-executable instructions include, for example, instructions and data which cause a general purpose computer, special purpose computer, or special purpose processing device to perform a certain function or group of functions. Computer-executable instructions also include program modules that are executed by computers in stand-alone or network environments. Generally, program modules include routines, programs, components, data structures, objects, and the functions inherent in the design of special-purpose processors, etc. that perform particular tasks or implement particular abstract data types. Computer-executable instructions, associated data structures, and program modules represent examples of the program code means for executing steps of the methods disclosed herein. The particular sequence of such executable instructions or associated data structures represents examples of corresponding acts for implementing the functions described in such steps.
Those of skill in the art will appreciate that other examples of the disclosure can be practiced in network computing environments with many types of computer system configurations, including personal computers, handheld devices, multi-processor systems, microprocessor-based or programmable consumer electronics, network PCs, minicomputers, mainframe computers, and the like. Examples can also be practiced in distributed computing environments where tasks are performed by local and remote processing devices that are linked (either by hardwired links, wireless links, or by a combination thereof) through a communications network. In a distributed computing environment, program modules can be located in both local and remote memory storage devices.
The various examples described above are provided by way of illustration only and should not be construed to limit the scope of the disclosure. For example, the principles herein apply not only to a smartphone device but to other devices capable of detecting communications such as a laptop computer. Those skilled in the art will readily recognize various modifications and changes that can be made to the principles described herein without following the example embodiments and applications illustrated and described herein, and without departing from the scope of the disclosure.
Claims
1. A method of generating an input for controlling an application from movement within a concave platform of an omnidirectional locomotion system configured to support a user on the concave platform, the method comprising:
- receiving, from at least two or more sensors, movement data from movement within the concave platform configured to support the user on the concave platform;
- calculating, at a processor, a velocity from the movement data;
- calculating, at the processor, a heading from the movement data;
- translating, at the processor, the velocity and the heading into 2-dimensional Cartesian coordinates at least one of a forward, backwards, or sideways movement input values;
- normalizing, at the processor, the 2-dimensional Cartesian coordinates at least one of a forward, backwards, or sideways movement input values into a minimum to maximum scale range; and
- transmitting, the normalized coordinates movement input values as the input for controlling the application.
2. The method of claim 1, wherein the velocity is calculated by a distance a foot of a the user travels divided by the time it took to travel the distance.
3. The method of claim 1, wherein the velocity is calculated by a pedometry rate.
4. The method of claim 3, wherein the pedometry rate is determined by monitoring a frequency of steps over a predefined interval.
5. The method of claim 1, wherein the velocity is calculated by monitoring an acceleration of a foot of a the user.
6. The method of claim 1, wherein the velocity is calculated by normalizing an angular velocity.
7. The method of claim 6, wherein the angular velocity is a change in rotation of a foot of a the user.
8. The method of claim 1, further comprising:
- translating, at the processor, the heading relative to a real world axis.
9. The method of claim 8, wherein the real world axis is magnetic North.
10. The method of claim 9, further comprising:
- calibrating, at the processor, the magnetic North to an initial orientation of a the user by an offset.
11. The method of claim 1, further comprising:
- translating, at the processor, the heading relative to an orientation of a torso of a the user.
12. The method of claim 1, further comprising:
- translating, at the processor, the heading relative to an orientation of a head of a the user.
13. The method of claim 1, wherein the minimum to maximum scale range is defined by gaming input descriptors.
14. The method of claim 1, wherein a Y 2-dimensional Cartesian coordinate is for forward or backwards movement.
15. The method of claim 1, wherein an X 2-dimensional Cartesian coordinate is for sideways movement.
16. The method of claim 1, where the two or more sensors are located within the concave platform.
17. The method of claim 1, where the two or more sensors are located outside the concave platform.
18. The method of claim 1, where the two or more sensors are located under the concave platform.
19. A system for generating an input for controlling an application from movement within a concave platform of an omnidirectional locomotion system configured to support a user on the concave platform, the system comprising:
- at least one processor; and
- at least one memory storing instructions, which when executed by the at least one processor causes the at least one processor to: receive, from at least two or more sensors, movement data from movement within the concave platform configured to support the user; calculate a velocity from the movement data; calculate a heading from the movement data; translate the velocity and the heading into 2-dimensional Cartesian coordinates at least one of a forward, backwards, or sideways movement input values; normalize the 2-dimensional Cartesian coordinates at least one of a forward, backwards, or sideways movement input values into a minimum to maximum scale range; and transmit the normalized coordinates movement input values as the input.
20. The system of claim 19, wherein the velocity is calculated by a distance a foot of a the user travels divided by the time it took to travel the distance.
21. The system of claim 19, wherein the velocity is calculated by a pedometry rate.
22. The system of claim 21, wherein the pedometry rate is determined by monitoring a frequency of steps over a predefined interval.
23. The system of claim 19, wherein the velocity is calculated by monitoring an acceleration of a foot of a the user.
24. The system of claim 19, wherein the velocity is calculated by normalizing an angular velocity.
25. The system of claim 24, wherein the angular velocity is a change in rotation of a foot of a the user.
26. The system of claim 19, further comprising instructions, which when executed by the at least one processor causes the at least one processor to translate the heading relative to a real world axis.
27. The system of claim 26, wherein the real world axis is magnetic North.
28. The system of claim 27, further comprising instructions, which when executed by the at least one processor causes the at least one processor to calibrate the magnetic North to an initial orientation of a the user by an offset.
29. The system of claim 19, further comprising instructions, which when executed by the at least one processor causes the at least one processor to translate the heading relative to an orientation of a torso of a the user.
30. The system of claim 19, further comprising instructions, which when executed by the at least one processor causes the at least one processor to translate the heading relative to an orientation of a head of a the user.
31. The system of claim 19, wherein the minimum to maximum scale range is defined by gaming input descriptors.
32. The system of claim 19, wherein a Y 2-dimensional Cartesian coordinate is for forward or backwards movement.
33. The system of claim 19, wherein an X 2-dimensional Cartesian coordinate is for sideways movement.
34. The system of claim 19, where the two or more sensors are located within the concave platform.
35. The system of claim 19, where the two or more sensors are located outside the concave platform.
36. The system of claim 19, where the two or more sensors are located under the concave platform.
37. A non-transitory computer readable medium storing instructions, which when executed by at least one processor causes the at least one processor to:
- receive, from at least two or more sensors, movement data from movement within a concave platform of an omnidirectional locomotion system configured to support a user on the concave platform;
- calculate a velocity from the movement data;
- calculate a heading from the movement data;
- translate the velocity and the heading into 2-dimensional Cartesian coordinates at least one of a forward, backwards, or sideways movement input values;
- normalize the 2-dimensional Cartesian coordinates at least one of a forward, backwards, or sideways movement input values into a minimum to maximum scale range; and
- transmit the normalized coordinates movement input values as an input for controlling an application.
38. The non-transitory computer readable medium of claim 37, wherein the velocity is calculated by a distance a foot of a the user travels divided by the time it took to travel the distance.
39. The non-transitory computer readable medium of claim 37, wherein the velocity is calculated by a pedometry rate.
40. The non-transitory computer readable medium of claim 39, wherein the pedometry rate is determined by monitoring a frequency of steps over a predefined interval.
41. The non-transitory computer readable medium of claim 37, wherein the velocity is calculated by monitoring an acceleration of a foot of a the user.
42. The non-transitory computer readable medium of claim 37, wherein the velocity is calculated by normalizing an angular velocity.
43. The non-transitory computer readable medium of claim 42, wherein the angular velocity is a change in rotation of a foot of a the user.
44. The non-transitory computer readable medium of claim 37, further comprising instructions, which when executed by the at least one processor causes the at least one processor to translate the heading relative to a real world axis.
45. The non-transitory computer readable medium of claim 44, wherein the real world axis is magnetic North.
46. The non-transitory computer readable medium of claim 45, further comprising instructions, which when executed by the at least one processor causes the at least one processor to calibrate the magnetic North to an initial orientation of a the user by an offset.
47. The non-transitory computer readable medium of claim 37, further comprising instructions, which when executed by the at least one processor causes the at least one processor to translate the heading relative to an orientation of a torso of a the user.
48. The non-transitory computer readable medium of claim 37, further comprising instructions, which when executed by the at least one processor causes the at least one processor to translate the heading relative to an orientation of a head of a the user.
49. The non-transitory computer readable medium of claim 37, wherein the minimum to maximum scale range is defined by gaming input descriptors.
50. The non-transitory computer readable medium of claim 37, wherein a Y 2-dimensional Cartesian coordinate is for forward or backwards movement.
51. The non-transitory computer readable medium of claim 37, wherein an X 2-dimensional Cartesian coordinate is for sideways movement.
52. The non-transitory computer readable medium of claim 37, where the two or more sensors are located within the concave platform.
53. The non-transitory computer readable medium of claim 37, where the two or more sensors are located outside the concave platform.
54. The non-transitory computer readable medium of claim 37, where the two or more sensors are located under the concave platform.
| 5782639 | July 21, 1998 | Beal |
| 5792031 | August 11, 1998 | Alton |
| 5846134 | December 8, 1998 | Latypov |
| 5902214 | May 11, 1999 | Makikawa |
| 5913727 | June 22, 1999 | Ahdoot |
| 5930741 | July 27, 1999 | Kramer |
| 6135928 | October 24, 2000 | Butterfield |
| 6270414 | August 7, 2001 | Roelofs |
| 7470218 | December 30, 2008 | Williams |
| 7780573 | August 24, 2010 | Carmein |
| 8456419 | June 4, 2013 | Wilson |
| 8696458 | April 15, 2014 | Foxlin |
| 9816819 | November 14, 2017 | Keal |
| 10668352 | June 2, 2020 | Wang |
| 11000753 | May 11, 2021 | Kim |
| 20060139317 | June 29, 2006 | Leu |
| 20080223131 | September 18, 2008 | Vannucci |
| 20090209343 | August 20, 2009 | Foxlin |
| 20130237378 | September 12, 2013 | Carrell |
| 20140044309 | February 13, 2014 | Leyvand |
| 20140046586 | February 13, 2014 | Keal |
| 20140092135 | April 3, 2014 | McArdle |
| 20150019135 | January 15, 2015 | Kacyvenski |
| 20160035228 | February 4, 2016 | Cakmak |
| 20190209891 | July 11, 2019 | Fung |
Type: Grant
Filed: Dec 22, 2021
Date of Patent: Jan 2, 2024
Assignee: Virtuix Holdings, Inc. (Austin, TX)
Inventors: Jan Goetgeluk (Austin, TX), Ricardo Soza (Round Rock, TX), Duane Bester (Houston, TX), James Douglas Shuffield (Cedar Park, TX)
Primary Examiner: Adam L Basehoar
Application Number: 17/559,005
International Classification: A63F 13/40 (20140101); A63F 13/212 (20140101); A63B 24/00 (20060101); A63F 13/211 (20140101); G06F 3/01 (20060101); A63B 71/06 (20060101); A63F 13/216 (20140101); A63B 69/00 (20060101); A63F 13/214 (20140101); A63F 13/5255 (20140101);
