Abstract: Methods and corresponding systems that are useful in design and fabrication of kinetic wire mechanisms or characters. The method includes a computational technique for the design of kinetic wire mechanisms tailored for fabrication on consumer-grade hardware such as a desktop CNC bending device. The method takes as input a skeletal animation of the mechanism to be fabricated and estimates, from the skeletal animation, a cable-driven and compliant wire structure, which matches user-selected keyframes. To enable localized deformations, the technique involves shaping the mechanism's body (i.e., the wire) into functional spring-like entities at a set of locations along the length of the mechanism's body.

Abstract: A system for providing a user of a virtual reality (VR) system with physical interactions with an object in the real world or in the surrounding physical space while they are concurrently interacting in the virtual world with a corresponding virtual object. The real world object is dynamic with the system including a physical interaction system that includes a robot with a manipulator for moving, positioning, and/or orienting the real world object to move it into contact with the user. For example, the physical object is moved into contact with a tracked body part of the user at a time that is synchronized with a time of an interaction event occurring in the virtual world being created by the VR system. Further, a system is described for providing a dynamic physical interaction to a human participant, e.g., a fast and compelling handover in an augmented reality (AR) system.

Abstract: Methods and corresponding systems that are useful in design and fabrication of kinetic wire mechanisms or characters. The method includes a computational technique for the design of kinetic wire mechanisms tailored for fabrication on consumer-grade hardware such as a desktop CNC bending device. The method takes as input a skeletal animation of the mechanism to be fabricated and estimates, from the skeletal animation, a cable-driven and compliant wire structure, which matches user-selected keyframes. To enable localized deformations, the technique involves shaping the mechanism's body (i.e., the wire) into functional spring-like entities at a set of locations along the length of the mechanism's body.

Abstract: Methods, systems, and computer-readable memory are provided for determining time-varying anatomical and physiological tissue characteristics of an animation rig. For example, shape and material properties are defined for a plurality of sample configurations of the animation rig. The shape and material properties are associated with the plurality of sample configurations. An animation of the animation rig is obtained, and one or more configurations of the animation rig are determined for one or more frames of the animation. The determined one or more configurations include shape and material properties, and are determined using one or more sample configurations of the animation rig. A simulation of the animation rig is performed using the determined one or more configurations. Performing the simulation includes computing physical effects for addition to the animation of the animation rig.

Abstract: Methods, systems, and computer-readable memory are provided for determining time-varying anatomical and physiological tissue characteristics of an animation rig. For example, shape and material properties are defined for a plurality of sample configurations of the animation rig. The shape and material properties are associated with the plurality of sample configurations. An animation of the animation rig is obtained, and one or more configurations of the animation rig are determined for one or more frames of the animation. The determined one or more configurations include shape and material properties, and are determined using one or more sample configurations of the animation rig. A simulation of the animation rig is performed using the determined one or more configurations. Performing the simulation includes computing physical effects for addition to the animation of the animation rig.

Abstract: A camera acquires a set of coded images and a set of flash images of a semi-specular object. The coded images are acquired while scanning the object with a laser beam pattern, and the flash images are acquired while illuminating the object with a set of light sources at different locations near the camera, there being one flash image for each light source. 3D coordinates of points on the surface of the object are determined from the set of coded images, and 2D silhouettes of the object are determined from shadows cast in the set of flash images. Surface normals are obtained for the 3D points from photometric stereo on the set of flash images. The 3D coordinates, 2D silhouettes and surface normals are compared with a known 3D model of the object to determine the pose of the object.

Abstract: A camera acquires a set of coded images and a set of flash images of a semi-specular object. The coded images are acquired while scanning the object with a laser beam pattern, and the flash images are acquired while illuminating the object with a set of light sources at different locations near the camera, there being one flash image for each light source. 3D coordinates of points on the surface of the object are determined from the set of coded images, and 2D silhouettes of the object are determined from shadows cast in the set of flash images. Surface normals are obtained for the 3D points from photometric stereo on the set of flash images. The 3D coordinates, 2D silhouettes and surface normals are compared with a known 3D model of the object to determine the pose of the object.