Abstract: Apparatuses and methods determine the three-dimensional position and orientation of a fiducial marker and tracking the three-dimensional position and orientation across different fields-of-view. Methods include: capturing an image of a first space in which the fiducial marker is disposed with a first sensor having a first field-of-view; determining the three-dimensional location and orientation of the fiducial marker within the first space based on the image of the first space in which the fiducial marker is disposed; capturing an image of a second space in which the fiducial marker is disposed with a second sensor having a second field-of-view; calculating pan and tilt information for the second sensor to move the second field-of-view of the second sensor to acquire an image of the fiducial marker; and determining the three-dimensional location and orientation of the fiducial marker within the second space based on the image of the second space.

Abstract: Methods for selecting a path of a multi-component end effector along a surface, robots that perform the methods, and storage media that directs robots to perform the methods. The multi-component end effector is attached to a robot, which is configured to move the multi-component end effector along the surface on a continuous tool centerpoint path (TCP). The multi-component end effector includes a plurality of end effector elements configured to move relative to one another. The method includes providing a discretized TCP that includes a plurality of spaced-apart waypoints along the continuous TCP. The method also includes determining a plurality of distance heuristics. The method further includes updating the plurality of distance heuristics to define a plurality of updated distance heuristics. The method also includes selecting the path of the multi-component end effector along the surface based upon the plurality of updated distance heuristics.

Abstract: Disclosed herein is a livery printing system and a method of generating a control path. The system includes a training system having a processor and a memory with code configured to cause the processor to receive a 3D digital model associated with an object; generate simulated control paths, based on the 3D digital model, for actuators of a printing device with printheads, determine a reward value for each one of the simulated control paths based on a simulated physical value, a simulated surface coverage value, or a simulated printing speed value. A value of one simulated control path variable of any of the simulated control paths is different than the value of the simulated control path variable of another simulated control path. One of the simulated control paths is selected based on a comparison between the reward values determined for the simulated control paths.

Abstract: Apparatuses and methods determine the three-dimensional position and orientation of a fiducial marker and tracking the three-dimensional position and orientation across different fields-of-view. Methods include: capturing an image of a first space in which the fiducial marker is disposed with a first sensor having a first field-of-view; determining the three-dimensional location and orientation of the fiducial marker within the first space based on the image of the first space in which the fiducial marker is disposed; capturing an image of a second space in which the fiducial marker is disposed with a second sensor having a second field-of-view; calculating pan and tilt information for the second sensor to move the second field-of-view of the second sensor to acquire an image of the fiducial marker; and determining the three-dimensional location and orientation of the fiducial marker within the second space based on the image of the second space.

Abstract: Methods of performing a rotational and translational calibrations of a print control system of an inkjet printer system having an inkjet printhead assembly with one or more inkjet printheads are disclosed. Rotational calibration is performed by printing a first rotational calibration pattern from a first standoff distance and a second rotational calibration pattern from a second standoff distance on a first calibration object. The print control system is calibrated until the rotational calibration patterns are within a direction difference tolerance of each other. Translational calibration is performed by printing a first translation calibration pattern on a second calibration object, rotating the inkjet printhead assembly 180°, and printing a second translational calibration pattern on the second calibration object. The print control system is calibrated until the translational calibration patterns are within a direction difference tolerance of each other.

Abstract: One embodiment comprises a method of operating a robotic system. The method comprises defining a Tool Center Point (TCP) for an end effector of the robotic system, providing a primary control plan that defines a tool path for the end effector, where the tool path has a plurality of pre-defined TCP positions. The method further comprises providing a secondary control plan that defines operation of the end effector at the plurality of pre-defined TCP positions, and determining a deviation between a pre-defined TCP position of the end effector and an actual TCP position of the end effector during implementation of the primary control plan by the robotic system. The method further comprises modifying the secondary control plan for the end effector based on the deviation during the implementation of the primary control plan by the robotic system.

Abstract: Systems and methods for assessing the calibration of an array of cameras. The method including inputting into a processor captured images from at least two cameras of the array of cameras, the captured images having features from an image. The method further including extracting one or more extracted features from the captured images, matching one or more extracted features between pairs of the at least two cameras to create a set of matched features, selecting matching points from the set of matched features, generating a three-dimensional reconstruction of objects in a field of view of the at least two cameras, and outputting the three-dimensional reconstruction wherein the three-dimensional reconstruction comprises indicators of calibration errors.

Abstract: An apparatus includes a memory configured to store multiple sets of image data. Each of the sets corresponds to a respective portion of a surface of an object and a respective portion of a structured light pattern projected onto the surface. The apparatus includes a processor configured to perform structured light reconstruction of the sets, including matching a first group of image pixels that correspond to a projected pixel of the structured light pattern in a first set of image data with a second group of image pixels that correspond to the projected pixel in a second set of image data. The processor is configured to perform stereo reconstruction of the sets, including matching one or more features detected within the first group of image pixels with one or more features detected within the second group of image pixels, to generate three-dimensional point data of the surface.

Abstract: Disclosed herein is an apparatus that comprises an instruction receiving module configured to receive, at a master device, a set of instructions for operating a plurality of peripheral devices. The apparatus also comprises an instruction identification module configured to identify at least one subset of the set of instructions that are associated with at least one slave device. The apparatus further comprises an instruction distribution module configured to send the at least one subset of instructions to the at least one slave device. The apparatus additionally comprises a trigger module configured to send a start signal, from the master device to the at least one slave device, that triggers the at least one slave device to begin executing the at least one subset of instructions such that each of the plurality of peripheral devices operates synchronously based on the executing instructions.

Abstract: Systems and methods for assessing the calibration of an array of cameras. The method including inputting into a processor captured images from at least two cameras of the array of cameras, the captured images having features from an image. The method further including extracting one or more extracted features from the captured images, matching one or more extracted features between pairs of the at least two cameras to create a set of matched features, selecting matching points from the set of matched features, generating a three-dimensional reconstruction of objects in a field of view of the at least two cameras, and outputting the three-dimensional reconstruction wherein the three-dimensional reconstruction comprises indicators of calibration errors.

Abstract: An apparatus includes a memory configured to store multiple sets of image data. Each of the sets corresponds to a respective portion of a surface of an object and a respective portion of a structured light pattern projected onto the surface. The apparatus includes a processor configured to perform structured light reconstruction of the sets, including matching a first group of image pixels that correspond to a projected pixel of the structured light pattern in a first set of image data with a second group of image pixels that correspond to the projected pixel in a second set of image data. The processor is configured to perform stereo reconstruction of the sets, including matching one or more features detected within the first group of image pixels with one or more features detected within the second group of image pixels, to generate three-dimensional point data of the surface.

Abstract: In one or more embodiments, a system for calibration between a camera and a ranging sensor comprises a ranging sensor to obtain ranging measurements for a target located at N number of locations with an emitter at M number of rotation positions. The system further comprises a camera to image the target to generate imaging measurements corresponding to the ranging measurements.

Abstract: Disclosed herein is an apparatus that comprises an instruction receiving module configured to receive, at a master device, a set of instructions for operating a plurality of peripheral devices. The apparatus also comprises an instruction identification module configured to identify at least one subset of the set of instructions that are associated with at least one slave device. The apparatus further comprises an instruction distribution module configured to send the at least one subset of instructions to the at least one slave device. The apparatus additionally comprises a trigger module configured to send a start signal, from the master device to the at least one slave device, that triggers the at least one slave device to begin executing the at least one subset of instructions such that each of the plurality of peripheral devices operates synchronously based on the executing instructions.

Abstract: Methods of performing a rotational and translational calibrations of a print control system of an inkjet printer system having an inkjet printhead assembly with one or more inkjet printheads are disclosed. Rotational calibration is performed by printing a first rotational calibration pattern from a first standoff distance and a second rotational calibration pattern from a second standoff distance on a first calibration object. The print control system is calibrated until the rotational calibration patterns are within a direction difference tolerance of each other. Translational calibration is performed by printing a first translation calibration pattern on a second calibration object, rotating the inkjet printhead assembly 180°, and printing a second translational calibration pattern on the second calibration object. The print control system is calibrated until the translational calibration patterns are within a direction difference tolerance of each other.

Abstract: A camera vision system for creating 3D reconstructions of objects may include a camera, a distance sensor having a fixed spatial relationship with the camera, and a system controller. The system controller receives distance sensor signals from the distance sensor indicating a sensor-to-object distance, determines a camera-to-object distance and a corresponding camera focus state based on the sensor-to-object distance, and transmits camera focus state control signals to cause the camera to adjust to the camera focus state. The system controller retrieves camera intrinsic parameter values for the camera focus state, transmits image capture control signals to cause the camera to capture an object image of the object, receives object image data from the camera for the captured object image, and stores the object image data and the camera intrinsic parameter values in an image database for use in the 3D reconstruction.

Abstract: In one or more embodiments, a system for calibration between a camera and a ranging sensor comprises a ranging sensor to obtain ranging measurements for a target located at N number of locations with an emitter at M number of rotation positions. The system further comprises a camera to image the target to generate imaging measurements corresponding to the ranging measurements.

Abstract: A method includes generating, based on first surface data that includes three-dimensional (3D) point positions corresponding to a first portion of a surface of an object, first hole data that indicates first positions of holes in the first portion of the surface. The method includes generating, based on second surface data corresponding to a second portion of the surface of the object, second hole data that indicates second positions of the holes in the second portion of the surface. The method also includes matching the first positions to the second positions to perform an alignment with respect to the first surface data and the second surface data.

Abstract: A method for live metrology of an object includes performing a scanning operation by a plurality of sensors to collect electronic images of an object. The electronic images include 3-D point cloud data for live metrology of the object and the point cloud data from each sensor define a point cloud that represents the object. The method also includes stitching the point clouds from the plurality of sensors to generate a reconstructed model of an as-manufactured object. The method further includes comparing the reconstructed model of the as-manufactured object to an as-designed model of the object to determine that the object is manufactured within an allowable tolerance to the as-designed model of the object.

Abstract: A camera vision system for creating 3D reconstructions of objects may include a camera, a distance sensor having a fixed spatial relationship with the camera, and a system controller. The system controller receives distance sensor signals from the distance sensor indicating a sensor-to-object distance, determines a camera-to-object distance and a corresponding camera focus state based on the sensor-to-object distance, and transmits camera focus state control signals to cause the camera to adjust to the camera focus state. The system controller retrieves camera intrinsic parameter values for the camera focus state, transmits image capture control signals to cause the camera to capture an object image of the object, receives object image data from the camera for the captured object image, and stores the object image data and the camera intrinsic parameter values in an image database for use in the 3D reconstruction.

Abstract: A method of collecting a metrology data set of a contoured surface with a metrology system and executing an automatic control plan for printing on a contoured surface is disclosed. The method includes attaching a work piece to a work piece frame and scanning a contoured surface of the work piece to obtain a metrology data set, a three-dimensional point cloud model is generated based on the metrology data set. Additionally, the method includes defining a spatial reference model of the work piece frame, and defining a print path for a print head assembly of a surface treatment assembly. Furthermore, the method includes discretizing the contoured surface into a plurality of regions and the print path is further defined into at least one independent regional print path for each region of the plurality of regions. Moreover, a computer software simulation verifies a control plan for printing on the contoured surface.