Abstract: Methods and systems for interacting with multiple three-dimensional (3D) object data models are provided. An example method may involve providing to a display device for display a first 3D object data model and a second 3D object data model. Information associated with a modification to the first 3D object data model may be received. Based on the received information, a same change may be applied to the first 3D object data model and applied to the second 3D object data model to obtain a first modified 3D object data model and a second modified 3D object data model. According to the method, the first modified 3D object data model and the second modified 3D object data model may be provided to the display device for substantially simultaneous display.

Abstract: Methods and systems for determining three-dimensional (3D) object data models of an object based on movement of the object. A processor may receive first scan data and second scan data of an object within in a space. The first scan data may comprise a first position of the object in the space and a first mesh image defining a first view of a shape of the object at the first position. The second scan data may comprise movement information defining a movement of the object from the first position to a second position within the space and a second mesh image defining a second view of the shape of the object at the second position. The first scan data and the second scan data may be aligned to generate a 3D object data model based on the first mesh image, the movement information, and the second mesh image.

Abstract: Disclosed are methods and systems for determining and displaying a simulated deformation of a 3D object data model. In one aspect, a method is disclosed that includes causing a force to be applied to an object to cause a deformation of the object and causing a plurality of reference scans of the object to be captured. The method further includes, based on the plurality of reference scans, generating a 3D object data model representing the object and, further based on the plurality of reference scans, identifying a constraint point of the 3D object data model, where the constraint point represents a point of minimum deformation of the object. The method still further includes selecting a predefined deformation model, where the predefined deformation model defines a simulated deformation, and where the simulated deformation simulates at least a portion of the deformation of the object proximate to the point of minimum deformation.

Abstract: Methods and systems for using a mobile device with a multi-element display, a camera, and a controller to determine a 3D model of a target object. The multi-element display is configured to generate a light field. At least a portion of the light field reflects from a target object. The camera is configured to capture a plurality of images based on the portion of the light field reflected from the target object. The controller is configured to determine a 3D model of the target object based on the images. The 3D model includes three-dimensional shape and color information about the target object. In some examples, the light field could include specific light patterns, spectral content, and other forms of modulated/structured light.

Abstract: The present application discloses shared robot knowledge bases for use with cloud computing systems. In one embodiment, the cloud computing system collects data from a robot about an object the robot has encountered in its environment, and stores the received data in the shared robot knowledge base. In another embodiment, the cloud computing system sends instructions for interacting with an object to a robot, receives feedback from the robot based on its interaction with the object, and updates data in the shared robot knowledge base based on the feedback. In yet another embodiment, the cloud computing system sends instructions to a robot for executing an application based on information stored in the shared robot knowledge base. In the disclosed embodiments, information in the shared robot knowledge bases is updated based on robot experiences so that any particular robot may benefit from prior experiences of other robots.

Abstract: Methods and systems for image acquisition are described. In an example, a computing device may be configured to cause incremental relative rotation of a projector with respect to an image-capture device through multiple discrete angles. At each angle of the multiple discrete angles, the computing device may be configured to cause the image-capture device to capture a first image of an object, cause the projector to project a pattern on the object, and cause the image-capture device, while the pattern is projected on the object, to capture a second image of the object.

Abstract: Methods and systems for determining three-dimensional (3D) object data models of an object based on movement of the object. A processor may receive first scan data and second scan data of an object within in a space. The first scan data may comprise a first position of the object in the space and a first mesh image defining a first view of a shape of the object at the first position. The second scan data may comprise movement information defining a movement of the object from the first position to a second position within the space and a second mesh image defining a second view of the shape of the object at the second position. The first scan data and the second scan data may be aligned to generate a 3D object data model based on the first mesh image, the movement information, and the second mesh image.

Abstract: Methods and systems are provided for determining and transmitting applicable lighting information, applicable viewing perspective, and a 3D model for an object in response to a search query. An example method includes receiving, at a server, a search query regarding an object. A 3D model for the object is determined. The 3D model includes three-dimensional shape information about the object. The method also includes determining, based on a plurality of stored images of the object, at least one applicable light field and at least one applicable viewing perspective. A search query result is transmitted from the server. The search query result may include the 3D model, the applicable light field(s), and the applicable viewing perspective(s). A server and a non-transitory computer readable medium are also disclosed that could perform a similar method.

Abstract: Methods and systems for representing information associated with an object in an area are provided. An example method includes determining a high-resolution representation of information associated with an area in which a robotic device is configured to operate. The high-resolution representation of information may include data associated with an object in the area and an indication of an occurrence of an update to the data. The method may further include determining a proximity of the robotic device to the object in the area. According to the method, when the proximity is less than a proximity threshold or the occurrence of the update is greater than an age threshold, a low-resolution representation of information associated with the area may be determined and provided to the robotic device.

Abstract: Methods and systems for material refinement for portions of a three-dimensional (3D) object data model are provided. An example method may include rendering a portion of a 3D object data model, and determining a first appearance metric between an appearance of the portion in the rendered view and a two-dimensional (2D) image. For one or more iterations, a modification to material properties associated with the portion may be determined based on the first appearance metric, and another view of the portion of the 3D object data model may be rendered. Also for the one or more iterations, another appearance metric between and an appearance of the portion in the rendered another view and the 2D image may be determined. Additionally, modified material properties for the portion that are associated with a minimum appearance metric of the one or more iterations may be stored for the 3D object data model.

Abstract: Methods and systems for interacting with multiple three-dimensional (3D) object data models are provided. An example method may involve receiving an annotated template of a first three-dimensional (3D) object data model. The annotated template may be associated with a given category of objects and may include one or more annotations to one or more aspects of an object described by the first 3D object data model. The method may also include determining matching correspondences between the first 3D object data model and a second 3D object data model that is a given object in the given category. For the one or more matching correspondences, an annotation that is associated with a correspondence point of the first 3D object data model may be applied as a call-out to a matching correspondence point of the second 3D object data model.

Abstract: A method includes receiving a first request for a first robot to perform a first task and processing the first request through first and second computing resources to identify instructions for the first robot to perform the first task. The method also includes providing the one or more instructions to the first robot and identifying information associated with the second computing resource, wherein such information includes environmental information related to a location where the first task is to be performed. The method further includes associating the identified information with the first computing resource, receiving a second request for a second robot to perform a second task, processing the second request through the first computing resource, accessing the information associated with the first computing resource, and, based upon the accessed information, providing instructions to the second robot to perform the second task.

Abstract: Methods and systems for providing a three-dimensional (3D) image viewer in a webpage are provided. According to an example method, a webpage may be provided, and the webpage may include embedded language that identifies a 3D image viewer to be provided within the webpage. Based on the embedded language, a computer having a processor and a memory may request information associated with rendering a 3D object data model in the 3D image viewer. The method may also include providing the 3D image viewer within the webpage, and receiving information associated with rendering the 3D object data model. Additionally, the 3D object data model may be rendered in the 3D image viewer based on the received information. Additional example systems and methods are described herein.

Abstract: Disclosed are methods and systems for building data models by using light to determine material properties of illuminated objects. In an embodiment, a system includes a set of device pairs (of lighting-source and image-capture devices) arranged on the perimeter (and directed at a central region of) a 3D shape. The system iterates from an initial state through a plurality of imaging states. The initial state involves (1) an object being situated in a controlled-lighting space and (2) the device pairs being positioned within the controlled-lighting space and around the object, which is situated in the central region of the 3D shape. Each imaging state involves the activation of an imaging-state-specific subset of lighting-source and image-capture devices. The system captures image data indicative of the appearance of the object during the imaging states, and stores that data in a 3D-data model of the object.

Abstract: Examples disclose systems and methods for recognizing objects. A method may be executable to receive a query from a robot. The query may include identification data associated with an object and contextual data associated with the object. The query may also include situational data. The method may also be executable to identify the object based at least in part on the data in the query received from the robot. Further, the method may be executable to send data associated with the identified object to the robot in response to the query.

Abstract: Methods and systems for acquiring and ranking image sets are described. In an example, a computing device may be configured to determine a feature-based score that may be based on features of the object including geometry of the object. The computing device also may be configured to receive a plurality of sets of images of the object. A number of respective images of each set of images may be based on the feature-based score. The computing device further may be configured to determine for each set of images a respective image-based score based on a prospective three-dimensional (3D) visualization of the object to be generated by a merged output of that set of images. The computing device also may be configured to determine a respective ranking for each set of images based on the respective image-based score; and select a set of images based on the respective ranking.

Abstract: Methods and systems for distributing tasks among robotic devices are described. A server may receive from a first device, information associated with an assigned task of the first device. The server may determine whether the assigned task can be executed more efficiently with assistance from additional devices, and may further determine available devices that can assist in executing the assigned task. The determined available devices may be ranked according to an amount of usage of the devices over time, and a second device may be selected from the available devices based on the ranking. A subtask of the assigned task may then be determined from a plurality of subtasks of the assigned task based on capabilities of the selected second device. An instruction may then be sent to the second device, instructing the second device to execute the determined subtask.

Abstract: Methods and systems are provided for determining and transmitting applicable lighting information, applicable viewing perspective, and a 3D model for an object in response to a search query. An example method includes receiving, at a server, a search query regarding an object. A 3D model for the object is determined. The 3D model includes three-dimensional shape information about the object. The method also includes determining, based on a plurality of stored images of the object, at least one applicable light field and at least one applicable viewing perspective. A search query result is transmitted from the server. The search query result may include the 3D model, the applicable light field(s), and the applicable viewing perspective(s). A server and a non-transitory computer readable medium are also disclosed that could perform a similar method.