Abstract: A modular vision system that can include a housing with a faceplate and a first and second optical module mounted to the faceplate. Each of the first and second optical modules can include a mounting body, a rectangular image sensor, and an imaging lens that defines an optical axis and a field of view. The first optical module can be configured to be mounted to the faceplate in a first plurality of mounting orientations and the second optical module can be configured to be mounted to the faceplate in a second plurality of mounting orientations. The first and second optical modules can thus collectively provide a plurality of imaging configurations.

Abstract: The techniques described herein relate to methods, apparatus, and computer readable media configured to test a pose of a three-dimensional model. A three-dimensional model is stored, the three dimensional model comprising a set of probes. Three-dimensional data of an object is received, the three-dimensional data comprising a set of data entries. The three-dimensional data is converted into a set of fields, comprising generating a first field comprising a first set of values, where each value of the first set of values is indicative of a first characteristic of an associated one or more data entries from the set of data entries, and generating a second field comprising a second set of values, where each second value of the second set of values is indicative of a second characteristic of an associated one or more data entries from the set of data entries, wherein the second characteristic is different than the first characteristic.

Abstract: Systems and methods are provided for acquiring images of objects. Light of different types (e.g., different polarization orientations) can be directed onto an object from different respective directions (e.g., from different sides of the object). A single image acquisition can be executed in order to acquire different sub-images corresponding to the different light types. An image of a surface of the object, including representation of surface features of the surface, can be generated based on the sub-images.

Abstract: Systems and methods are provided for acquiring images of objects using an imaging device and a controllable mirror. The controllable mirror can be controlled to change a field of view for the imaging device, including so as to acquire images of different locations, of different parts of an object, or with different degrees of zoom.

Abstract: This invention provides an aimer assembly for a vision system that is coaxial (on-axis) with the camera optical axis, thus providing an aligned aim point at a wide range of working distances. The aimer includes a projecting light element located aside the camera optical axis. The beam and received light from the imaged (illuminated) scene are selectively reflected or transmitted through a dichoric mirror assembly in a manner that permits the beam to be aligned with the optical axis and projected to the scene while only light from the scene is received by the sensor. The aimer beam and illuminator employ differing light wavelengths. In a further embodiment, an internal illuminator includes a plurality of light sources below the camera optical axis. Some of the light sources are covered by a prismatic structure for close distance, and other light sources are collimated, projecting over a longer distance.

Abstract: The techniques described herein relate to computerized methods and apparatuses for detecting objects in an image. The techniques described herein further relate to computerized methods and apparatuses for detecting one or more objects using a pre-trained machine learning model and one or more other machine learning models that can be trained in a field training process. The pre-trained machine learning model may be a deep machine learning model.

Abstract: Embodiments relate to predicting height information for an object. First distance data is determined at a first time when an object is at a first position that is only partially within the field-of-view. Second distance data is determined at a second, later time when the object is at a second, different position that is only partially within the field-of-view. A distance measurement model that models a physical parameter of the object within the field-of-view is determined for the object based on the first and second distance data. Third distance data indicative of an estimated distance to the object prior to the object being entirely within the field-of-view of the distance sensing device is determined based on the first distance data, the second distance data, and the distance measurement model. Data indicative of a height of the object is determined based on the third distance data.

Abstract: A system and method for estimating dimensions of an approximately cuboidal object from a 3D image of the object acquired by an image sensor of the vision system processor is provided. An identification module, associated with the vision system processor, automatically identifies a 3D region in the 3D image that contains the cuboidal object. A selection module, associated with the vision system processor, automatically selects 3D image data from the 3D image that corresponds to approximate faces or boundaries of the cuboidal object. An analysis module statistically analyzes, and generates statistics for, the selected 3D image data that correspond to approximate cuboidal object faces or boundaries. A refinement module chooses statistics that correspond to improved cuboidal dimensions from among cuboidal object length, width and height. The improved cuboidal dimensions are provided as dimensions for the object. A user interface displays a plurality of interface screens for setup and runtime operation.

Abstract: This invention provides a vision system camera, and associated methods of operation, having a multi-core processor, high-speed, high-resolution imager, FOVE, auto-focus lens and imager-connected pre-processor to pre-process image data provides the acquisition and processing speed, as well as the image resolution that are highly desirable in a wide range of applications. This arrangement effectively scans objects that require a wide field of view, vary in size and move relatively quickly with respect to the system field of view. This vision system provides a physical package with a wide variety of physical interconnections to support various options and control functions. The package effectively dissipates internally generated heat by arranging components to optimize heat transfer to the ambient environment and includes dissipating structure (e.g. fins) to facilitate such transfer.

Abstract: A system for forming a homogenized illumination line which can be imaged as a low-speckle line is disclosed. The system includes a laser configured to emit a collimated laser beam; and an illumination-fan generator that includes one or more linear diffusers. The illumination-fan generator is arranged and configured to (i) receive the collimated laser beam, (ii) output a planar fan of diffused light, such that the planar fan emanates from a light line formed on the distal-most one of the one or more linear diffusers, and (iii) cause formation of an illumination line at an intersection of the planar fan and an object.

Abstract: This invention provides a system and method for finding multiple line features in an image. Two related steps are used to identify line features. First, the process computes x and y-components of the gradient field at each image location, projects the gradient field over a plurality subregions, and detects a plurality of gradient extrema, yielding a plurality of edge points with position and gradient. Next, the process iteratively chooses two edge points, fits a model line to them, and if edge point gradients are consistent with the model, computes the full set of inlier points whose position and gradient are consistent with that model. The candidate line with greatest inlier count is retained and the set of remaining outlier points is derived. The process then repeatedly applies the line fitting operation on this and subsequent outlier sets to find a plurality of line results. The process can be exhaustive RANSAC-based.

Abstract: A system or method can analyze symbols on a set of objects having different sizes. The system can identify a characteristic object dimension corresponding to the set of objects. An image of a first object can be received, and, a first virtual object boundary feature (e.g., edge) in the image can be identified for the first object based on the characteristic object dimension. A first symbol can be identified in the image, and whether the first symbol is positioned on the first object can be determined, based on the first virtual object boundary feature.

Abstract: In some aspects, the techniques described herein relate to systems, methods, and computer readable media for data pre-processing for stereo-temporal image sequences to improve three-dimensional data reconstruction. In some aspects, the techniques described herein relate to systems, methods, and computer readable media for improved correspondence refinement for image areas affected by oversaturation. In some aspects, the techniques described herein relate to systems, methods, and computer readable media configured to fill missing correspondences to improve three-dimensional (3-D) reconstruction. The techniques include identifying image points without correspondences, using existing correspondences and/or other information to generate approximated correspondences, and cross-checking the approximated correspondences to determine whether the approximated correspondences should be used for the image processing.

Abstract: Methods, systems, and computer readable media for generating a three-dimensional reconstruction of an object with reduced distortion are described. In some aspects, a system includes at least two image sensors, at least two projectors, and a processor. Each image sensor is configured to capture one or more images of an object. Each projector is configured to illuminate the object with an associated optical pattern and from a different perspective. The processor is configured to perform the acts of receiving, from each image sensor, for each projector, images of the object illuminated with the associated optical pattern and generating, from the received images, a three-dimensional reconstruction of the object. The three-dimensional reconstruction has reduced distortion due to the received images of the object being generated when each projector illuminates the object with an associated optical pattern from the different perspective.

Abstract: This provides an ID reader, typically configured for handheld operation, which integrates three types of illumination into a compact package that generates robust performance and resistance to harsh environmental conditions, such as dust and moisture. These illumination types include, direct (diffuse) light, low-angle light and polarized light. The ID reader includes a sealed reader module assembly having the illuminators in combination with an imager assembly (optics and image sensor) at its relative center. Additionally, also an on-axis aimer and a variable focus system with liquid lens have been integrated in this module and is placed on axis using a mirror assembly that includes a dichroic filter. As the optimal distance to read a code with low-angle light is typically shorter than the optimal distance to use the polarized illumination a variable (e.g. liquid) lens can adjust the focus of the reader to the optimal distance for the selected illumination.

Abstract: This invention provides a system and method for finding patterns in images that incorporates neural net classifiers. A pattern finding tool is coupled with a classifier that can be run before or after the tool to have labeled pattern results with sub-pixel accuracy. In the case of a pattern finding tool that can detect multiple templates, its performance is improved when a neural net classifier informs the pattern finding tool to work only on a subset of the originally trained templates. Similarly, in the case of a pattern finding tool that initially detects a pattern, a neural network classifier can then determine whether it has found the correct pattern. The neural network can also reconstruct/clean-up an imaged shape, and/or to eliminate pixels less relevant to the shape of interest, therefore reducing the search time, as well significantly increasing the chance of lock on the correct shapes.

Abstract: A calibration fixture that enables more accurate calibration of a touch probe on, for example, a CMM, with respect to the camera. The camera is mounted so that its optical axis is approximately or substantially parallel with the z-axis of the probe. The probe and workpiece are in relative motion, along a plane defined by orthogonal x and y axes, and optionally the z-axis and/or and rotation R about the z-axis. The calibration fixture is arranged to image from beneath the touch surface of the probe and, via a 180-degree prism structure, to transmit light from the probe touch point along the optical axis to the camera. Alternatively, two cameras respectively view the fiducial location relative to the CMM arm and the probe location when aligned on the fiducial. The fixture can define an integrated assembly with an optics block and a camera assembly.

Abstract: This invention provides an easy-to-manufacture, easy-to-analyze calibration object which combines measurable and repeatable, but not necessarily accurate, 3D features—such as a two-sided calibration object/target in (e.g.) the form of a frustum, with a pair of accurate and measurable features, more particularly parallel faces separated by a precise specified thickness, so as to provide for simple field calibration of opposite-facing DS sensors. Illustratively, a composite calibration object can be constructed, which includes the two-sided frustum that has been sandblasted and anodized (to provide measurable, repeatable features), with a flange whose above/below parallel surfaces have been ground to a precise specified thickness. The 3D corner positions of the two-sided frustum are used to calibrate the two sensors in X and Y, but cannot establish absolute Z without accurate information about the thickness of the two-sided frustum; the flange provides the absolute Z information.

Abstract: This invention provides a system and method for displaying color match information on an acquired image of an object. A model/pattern having a plurality of color test points at locations of stable color is provided. A display process generates visible geometric shapes with respect to the color test points in a predetermined color. An alignment process aligns features of the object with respect to features on the model so that the geometric shapes appear in locations on the object that correspond to locations on the model. The geometric shapes can comprise closed shapes that surround a region expected to be stable color on the object. Such shapes can define circles, squares, diamonds or any other acceptable closed or open shape that is visible to the user on the display.

Abstract: This invention provides a system and method for generating camera calibrations for a vision system camera along three discrete planes in a 3D volume space that uses at least two (e.g. parallel) object planes at different known heights. For any third (e.g. parallel) plane of a specified height, the system and method then automatically generates calibration data for the camera by interpolating/extrapolating from the first two calibrations. This alleviates the need to set the calibration object at more than two heights, speeding the calibration process and simplifying the user's calibration setup, and also allowing interpolation/extrapolation to heights that are space-constrained, and not readily accessible by a calibration object. The calibration plate can be calibrated at each height using a full 2D hand-eye calibration, or using a hand-eye calibration at the first height and then at a second height with translation to a known position along the height (e.g. Z) direction.