Abstract: A robot is configured to assist an end-user with creative tasks. While the end-user modifies the work piece, the robot observes the modifications made by the end-user and determines one or more objectives that the end-user may endeavor to accomplish. The robot then determines a set of actions to perform that assist the end-user with accomplishing the objectives.

Abstract: A robot system is configured to identify gestures performed by an end-user proximate to a work piece. The robot system then determines a set of modifications to be made to the work piece based on the gestures. A projector coupled to the robot system projects images onto the work piece that represent the modification to be made and/or a CAD model of the work piece. The robot system then performs the modifications.

Abstract: Methods, systems, and apparatus include computer programs encoded on a computer-readable storage medium, including a method for identifying, inventorying and managing physical possessions. Image data is captured including one or more images or video of physical possessions of a person that occupy a space. The captured image data is automatically analyzed to recognize physical products included in the image data and to determine a position of each recognized physical product in the space. The recognized physical products are automatically inventoried including preparing a list of products. Each entry in the list includes a product name or identifying information and location information for where the product is located in the space. A representation of the space is generated including respective physical products. A user interface is provided for presenting the inventory including providing the representation of the space and displaying a representation of respective physical products in the space.

Abstract: A control engine is trained to operate a robotic camera according to a variety of different cinematographic techniques. The control engine may reconfigure the robotic camera to respond to a set of cues, to enforce a set of constraints, or to apply one or more characteristic styles. A training engine trains a network within the control engine based on training data that exemplifies cue responses, enforced constraints, and characteristic styles.

Abstract: A motion capture setup records the movements of an operator, and a control engine then translates those movements into control signals for controlling a robot. The control engine may directly translate the operator movements into analogous movements to be performed by the robot, or the control engine may compute robot dynamics that cause a portion of the robot to mimic a corresponding portion of the operator.

Abstract: A technique for displaying a representative path associated with a robotic device. The technique includes detecting at least one reference point within a first image of a workspace, generating the representative path based on path instructions associated with the robotic device and the at least one reference point, and displaying the representative path within the workspace.

Abstract: Methods, systems, and apparatus, including medium-encoded computer program products, for passing actionable information between different buildings to facilitate building management without human intervention include, in one aspect, a method including: determining, in a building information modelling (BIM) system of a first building, a set of rules defining actions to be taken by a building automation system of the first building in response to a defined set of remote information received from a BIM system of a second building, the set of remote information corresponding to one or more sensors in or associated with the second building; receiving data from the BIM system of the second building in accordance with the set of remote information; and using the building automation system of the first building to automatically change configuration, use, or operation of the first building in response to the received data in accordance with the set of rules.

Abstract: One embodiment of the present invention sets forth a technique for determining a location of an object that is being manipulated or processed by a robot. The technique includes capturing a digital image of the object while the object is disposed by the robot within an imaging space, wherein the digital image includes a direct view of the object and a reflected view of the object, detecting a visible feature of the object in the direct view and the visible feature of the object in the reflected view, and computing a first location of the visible feature in a first direction based on a position of the visible feature in the direct view. The technique further includes computing a second location of the visible feature in a second direction based on a position of the visible feature in the reflected view and causing the robot to move the object to a processing station based at least in part on the first location and the second location.

Abstract: One embodiment of the present invention sets forth a technique for performing tasks associated with a construction project. The technique includes transmitting to a worker, via a mobile computing device worn by the worker, a first instruction related to performing a first task included in a plurality of tasks associated with a construction project, and transmitting to a light-emitting device a command to provide a visual indicator to the worker that facilitates performing the first task, based on an input received from the mobile computing device, determining that the worker has completed the first task of the construction project, selecting, from a database that tracks eligibility of each of the plurality of tasks, a second task included in the plurality of tasks that the worker is eligible to perform, and transmitting to the worker, via the mobile computing device, a second instruction related to performing the second task.

Abstract: Methods, systems, and apparatus include computer programs encoded on a computer-readable storage medium, including a method for identifying, inventorying and managing physical possessions. Image data is captured including one or more images or video of physical possessions of a person that occupy a space. The captured image data is automatically analyzed to recognize physical products included in the image data and to determine a position of each recognized physical product in the space. The recognized physical products are automatically inventoried including preparing a list of products. Each entry in the list includes a product name or identifying information and location information for where the product is located in the space. A representation of the space is generated including respective physical products. A user interface is provided for presenting the inventory including providing the representation of the space and displaying a representation of respective physical products in the space.