Abstract: Methods and systems for interacting with multiple three-dimensional (3D) object data models are provided. An example method may involve providing to a display device for display a first 3D object data model and a second 3D object data model. Information associated with a modification to the first 3D object data model may be received. Based on the received information, a same change may be applied to the first 3D object data model and applied to the second 3D object data model to obtain a first modified 3D object data model and a second modified 3D object data model. According to the method, the first modified 3D object data model and the second modified 3D object data model may be provided to the display device for substantially simultaneous display.

Abstract: Methods and systems for robot functions and user interfaces are described. A server may receive a set of robot parameters, and may predict new parameters based on a robot command. In this manner, a user may receive parameters corresponding to the predicted values and mitigate network and processing latency. In other examples, a robot may provide a forward looking image and a robot speed. When a command to move forward is issued, the server may provide a predicted image and predicted speed. The server may be able to calculate a predicted image and a predicted speed (or other parameter) more quickly than the robot could provide the same information. The predicted information may be displayed on a user interface with a corresponding indication that the values are predicted. The robot may provide the server and the user interface with the actual data when it is available.

Abstract: Disclosed are methods and systems for determining and displaying a simulated deformation of a 3D object data model. In one aspect, a method is disclosed that includes causing a force to be applied to an object to cause a deformation of the object and causing a plurality of reference scans of the object to be captured. The method further includes, based on the plurality of reference scans, generating a 3D object data model representing the object and, further based on the plurality of reference scans, identifying a constraint point of the 3D object data model, where the constraint point represents a point of minimum deformation of the object. The method still further includes selecting a predefined deformation model, where the predefined deformation model defines a simulated deformation, and where the simulated deformation simulates at least a portion of the deformation of the object proximate to the point of minimum deformation.

Abstract: Methods and systems for image marking and generation of a three-dimensional (3D) image of an object are described. In an example, a computing device may be configured to receive a first set of images of an object that capture details of the object. The computing device may also be configured to receive a second set of images that include markings projected on the object and that are indexed to correspond to images of the first set of images. The computing device may be configured to spatially align images of the second set of images based on the markings projected on the object and determine respective images of the first set of images corresponding to spatially aligned images of the second set of images. The computing device may then generate a 3D image of the object from the respective images of the first set of images.

Abstract: The present application discloses shared robot knowledge bases for use with cloud computing systems. In one embodiment, the cloud computing system collects data from a robot about an object the robot has encountered in its environment, and stores the received data in the shared robot knowledge base. In another embodiment, the cloud computing system sends instructions for interacting with an object to a robot, receives feedback from the robot based on its interaction with the object, and updates data in the shared robot knowledge base based on the feedback. In yet another embodiment, the cloud computing system sends instructions to a robot for executing an application based on information stored in the shared robot knowledge base. In the disclosed embodiments, information in the shared robot knowledge bases is updated based on robot experiences so that any particular robot may benefit from prior experiences of other robots.

Abstract: Methods and systems for determining a view of an object in a three-dimensional (3D) image viewer are described. In an example, a computing device may be configured to receive a 3D object data model that may have a default view for rendering an image depicting an object in a default position. The computing device may be configured to determine, by way of a simulation of movement of the object, a rest position of the object that may describe one or more of a size, an orientation, and a shape that the object maintains when subjected to one or more forces. The computing device may be configured to provide information associated with instructions for rendering in a 3D image viewer a given image representing the 3D object data model of the object, where the given image may depict the object in the determined rest position.

Abstract: Methods and systems for material refinement for portions of a three-dimensional (3D) object data model are provided. An example method may include rendering a portion of a 3D object data model, and determining a first appearance metric between an appearance of the portion in the rendered view and a two-dimensional (2D) image. For one or more iterations, a modification to material properties associated with the portion may be determined based on the first appearance metric, and another view of the portion of the 3D object data model may be rendered. Also for the one or more iterations, another appearance metric between and an appearance of the portion in the rendered another view and the 2D image may be determined. Additionally, modified material properties for the portion that are associated with a minimum appearance metric of the one or more iterations may be stored for the 3D object data model.

Abstract: Methods and systems for interacting with multiple three-dimensional (3D) object data models are provided. An example method may involve receiving an annotated template of a first three-dimensional (3D) object data model. The annotated template may be associated with a given category of objects and may include one or more annotations to one or more aspects of an object described by the first 3D object data model. The method may also include determining matching correspondences between the first 3D object data model and a second 3D object data model that is a given object in the given category. For the one or more matching correspondences, an annotation that is associated with a correspondence point of the first 3D object data model may be applied as a call-out to a matching correspondence point of the second 3D object data model.

Abstract: Methods and systems for displaying information on or within a three-dimensional (3D) image are described. In an example, a computing device may be configured to determine, based on a two-dimensional (2D) content displayed on a display device, an object depicted in the 2D content. The computing device may be configured to receive information indicative of a request to initiate a three-dimensional (3D) image viewer to view the object in the 3D image viewer. The computing device, accordingly, may be configured to provide rendering information associated with instructions for rendering in the 3D image viewer a 3D image representing a 3D object data model of the object on the display device. The computing device may be configured to provide, in the 3D image viewer, information relating to the object and including at least a portion of the 2D content.

Abstract: Methods and systems for providing a three-dimensional (3D) image viewer in a webpage are provided. According to an example method, a webpage may be provided, and the webpage may include embedded language that identifies a 3D image viewer to be provided within the webpage. Based on the embedded language, a computer having a processor and a memory may request information associated with rendering a 3D object data model in the 3D image viewer. The method may also include providing the 3D image viewer within the webpage, and receiving information associated with rendering the 3D object data model. Additionally, the 3D object data model may be rendered in the 3D image viewer based on the received information. Additional example systems and methods are described herein.

Abstract: Disclosed are methods and systems for building data models by using light to determine material properties of illuminated objects. In an embodiment, a system includes a set of device pairs (of lighting-source and image-capture devices) arranged on the perimeter (and directed at a central region of) a 3D shape. The system iterates from an initial state through a plurality of imaging states. The initial state involves (1) an object being situated in a controlled-lighting space and (2) the device pairs being positioned within the controlled-lighting space and around the object, which is situated in the central region of the 3D shape. Each imaging state involves the activation of an imaging-state-specific subset of lighting-source and image-capture devices. The system captures image data indicative of the appearance of the object during the imaging states, and stores that data in a 3D-data model of the object.

Abstract: Methods and systems for robotic analysis of an ambient environment, as well as a user, are provided. In some examples, a robotic device may provide a personalized interaction or response to a user based on a determined state of the environment (such as local weather), and a state of the user.