Abstract: A system for providing a motion for a robotic device includes: a memory storing: a plurality of animation styles, and a sample motion for the robotic device. The sample motion complies with kinematic and dynamic constraints associated with the robotic device. The system includes a processing element in communication with the memory; an animation engine executed by the processing element. The animation engine receives: a target kinematic state of at least a portion of the robotic device, a selection of at least one of the plurality of animation styles, and a real or simulated state of the robotic device. The animation engine generates at least one actuator command configured to modify the sample motion based on the target kinematic state, the selected at least one of the plurality of animation styles, and the real or simulated state of the robotic device.

Abstract: A robot design and control system including a procedural animation engine and a graphical animation editor that enable animators to author stylized walking gaits achievable by physical robotic characters, including bipedal robots of varying design. The animation engine generates dynamically feasible reference trajectories for omnidirectional walking given a desired walking velocity that may be input from a joystick or an artificial intelligence (AI) planner. This allows a legged robot to walk along an arbitrary path while expressing a custom animation “style,” e.g., a happy walk, a sneaky walk, or other manner of walking. The stylized walking motion or gait is generalized by the animation engine from a small number of animation samples that are defined at key walking velocities and tracked using a whole-body controller. The set of samples that are used as input to define a walking style is authored by an animator using the animation editor.

Abstract: A new controller for use in robots with kinematic loops as well as in most other types of robots (such as those with fully actuated kinematic trees). The controller includes an inverse kinematics (IK) module that implements a versatile IK formulation for retargeting of motions, including expressive motions, onto mechanical systems (i.e., robots with loops and/or without loops). Further, the controller is configured to support the precise control of the position and orientation of end effectors and the center of mass (CoM) (such as of walking robots). The formulation of the algorithms carried out by the IK module safeguards against a disassembly when IK targets are moved outside the workspace of the robot. A regularizer is included in the controller that smoothly circumvents kinematic singularities where velocities go to infinity.

Abstract: A robot design and control system including a procedural animation engine and a graphical animation editor that enable animators to author stylized walking gaits achievable by physical robotic characters, including bipedal robots of varying design. The animation engine generates dynamically feasible reference trajectories for omnidirectional walking given a desired walking velocity that may be input from a joystick or an artificial intelligence (AI) planner. This allows a legged robot to walk along an arbitrary path while expressing a custom animation “style,” e.g., a happy walk, a sneaky walk, or other manner of walking. The stylized walking motion or gait is generalized by the animation engine from a small number of animation samples that are defined at key walking velocities and tracked using a whole-body controller. The set of samples that are used as input to define a walking style is authored by an animator using the animation editor.

Abstract: A system includes a computing platform having processing hardware, one or more sensor(s), and a memory storing perception software and animation software, as well as an augmented reality (AR) headset including another processing hardware. The computing platform is configured to obtain an environmental data using the sensor(s), determine the location and orientation of the AR headset using the perception software and the environmental data, identify an action for execution by the computing platform, using the animation software and the location and orientation of the AR headset, and transmit performative data corresponding to the identified action to the AR headset. The AR headset is configured to receive, from the computing platform, the performative data, and to render at least one AR effect corresponding to the identified action using the performative data.

Abstract: A system includes a computing platform having processing hardware, one or more sensor(s), and a memory storing perception software and animation software, as well as an augmented reality (AR) headset including another processing hardware. The computing platform is configured to obtain an environmental data using the sensor(s), determine the location and orientation of the AR headset using the perception software and the environmental data, identify an action for execution by the computing platform, using the animation software and the location and orientation of the AR headset, and transmit performative data corresponding to the identified action to the AR headset. The AR headset is configured to receive, from the computing platform, the performative data, and to render at least one AR effect corresponding to the identified action using the performative data.

Abstract: A new controller for use in robots with kinematic loops as well as in most other types of robots (such as those with fully actuated kinematic trees). The controller includes an inverse kinematics (IK) module that implements a versatile IK formulation for retargeting of motions, including expressive motions, onto mechanical systems (i.e., robots with loops and/or without loops). Further, the controller is configured to support the precise control of the position and orientation of end effectors and the center of mass (CoM) (such as of walking robots). The formulation of the algorithms carried out by the IK module safeguards against a disassembly when IK targets are moved outside the workspace of the robot. A regularizer is included in the controller that smoothly circumvents kinematic singularities where velocities go to infinity.

Abstract: A robot actor, or character mobility hardware platform, adapted to unleash or provide a wide variety of characters in the physical world. The robot actor enables the often screen-constrained characters to become life-like, interactive participants with nearby people in ways not presently achievable. The robot actor is an untethered, free-roaming robot that is has two (or more) legs, is adapted for high dexterity, is controlled and designed to be self-balancing, and, due to this combination of characteristics, the robot can provide characters with an illusion of life and, in many cases, in correct proportion and scale. The hardware and software of the robot actor will become a new generation of animatronic figures by providing a hardware platform capable of continuously evolving to become more capable through advances in controls and artificial intelligence (AI).

Abstract: A robot actor, or character mobility hardware platform, adapted to unleash or provide a wide variety of characters in the physical world. The robot actor enables the often screen-constrained characters to become life-like, interactive participants with nearby people in ways not presently achievable. The robot actor is an untethered, free-roaming robot that is has two (or more) legs, is adapted for high dexterity, is controlled and designed to be self-balancing, and, due to this combination of characteristics, the robot can provide characters with an illusion of life and, in many cases, in correct proportion and scale. The hardware and software of the robot actor will become a new generation of animatronic figures by providing a hardware platform capable of continuously evolving to become more capable through advances in controls and artificial intelligence (AI).

Abstract: A robot actor, or character mobility hardware platform, adapted to unleash or provide a wide variety of characters in the physical world. The robot actor enables the often screen-constrained characters to become life-like, interactive participants with nearby people in ways not presently achievable. The robot actor is an untethered, free-roaming robot that is has two (or more) legs, is adapted for high dexterity, is controlled and designed to be self-balancing, and, due to this combination of characteristics, the robot can provide characters with an illusion of life and, in many cases, in correct proportion and scale. The hardware and software of the robot actor will become a new generation of animatronic figures by providing a hardware platform capable of continuously evolving to become more capable through advances in controls and artificial intelligence (AI).