Abstract: A robot design and control system including a procedural animation engine and a graphical animation editor that enable animators to author stylized walking gaits achievable by physical robotic characters, including bipedal robots of varying design. The animation engine generates dynamically feasible reference trajectories for omnidirectional walking given a desired walking velocity that may be input from a joystick or an artificial intelligence (AI) planner. This allows a legged robot to walk along an arbitrary path while expressing a custom animation “style,” e.g., a happy walk, a sneaky walk, or other manner of walking. The stylized walking motion or gait is generalized by the animation engine from a small number of animation samples that are defined at key walking velocities and tracked using a whole-body controller. The set of samples that are used as input to define a walking style is authored by an animator using the animation editor.

Abstract: A system includes a computing platform having processing hardware, one or more sensor(s), and a memory storing perception software and animation software, as well as an augmented reality (AR) headset including another processing hardware. The computing platform is configured to obtain an environmental data using the sensor(s), determine the location and orientation of the AR headset using the perception software and the environmental data, identify an action for execution by the computing platform, using the animation software and the location and orientation of the AR headset, and transmit performative data corresponding to the identified action to the AR headset. The AR headset is configured to receive, from the computing platform, the performative data, and to render at least one AR effect corresponding to the identified action using the performative data.

Abstract: A system includes a computing platform having processing hardware, one or more sensor(s), and a memory storing perception software and animation software, as well as an augmented reality (AR) headset including another processing hardware. The computing platform is configured to obtain an environmental data using the sensor(s), determine the location and orientation of the AR headset using the perception software and the environmental data, identify an action for execution by the computing platform, using the animation software and the location and orientation of the AR headset, and transmit performative data corresponding to the identified action to the AR headset. The AR headset is configured to receive, from the computing platform, the performative data, and to render at least one AR effect corresponding to the identified action using the performative data.