Abstract: This invention provides a vision system camera, and associated methods of operation, having a multi-core processor, high-speed, high-resolution imager, FOVE, auto-focus lens and imager-connected pre-processor to pre-process image data provides the acquisition and processing speed, as well as the image resolution that are highly desirable in a wide range of applications. This arrangement effectively scans objects that require a wide field of view, vary in size and move relatively quickly with respect to the system field of view. This vision system provides a physical package with a wide variety of physical interconnections to support various options and control functions. The package effectively dissipates internally generated heat by arranging components to optimize heat transfer to the ambient environment and includes dissipating structure (e.g. fins) to facilitate such transfer.

Abstract: This invention provides a system and method for finding patterns in images that incorporates neural net classifiers. A pattern finding tool is coupled with a classifier that can be run before or after the tool to have labeled pattern results with sub-pixel accuracy. In the case of a pattern finding tool that can detect multiple templates, its performance is improved when a neural net classifier informs the pattern finding tool to work only on a subset of the originally trained templates. Similarly, in the case of a pattern finding tool that initially detects a pattern, a neural network classifier can then determine whether it has found the correct pattern. The neural network can also reconstruct/clean-up an imaged shape, and/or to eliminate pixels less relevant to the shape of interest, therefore reducing the search time, as well significantly increasing the chance of lock on the correct shapes.

Abstract: Methods and systems for extracting a one-dimensional (1D) signal from a two-dimensional (2D) digital image along a projection line are provided herein. The methods and systems store the digital image in a memory hierarchy wherein non-blocking prefetch operations can fetch pixels from a main store to a data cache. A prefetch plan, pixel processing plan, and prefetch distance are selected responsive to the orientation of the projection line. The prefetch plan uses a first memory address order that is designed to be favorable for efficiently fetching pixels from the main store to the data cache for the given orientation. The pixel processing plan uses a second address order that is designed to be favorable for computing a 1D signal along the projection line.

Abstract: A system or method can analyze symbols on a set of objects having different sizes. The system can identify a characteristic object dimension corresponding to the set of objects. An image of a first object can be received, and, a first virtual object boundary feature (e.g., edge) in the image can be identified for the first object based on the characteristic object dimension. A first symbol can be identified in the image, and whether the first symbol is positioned on the first object can be determined, based on the first virtual object boundary feature.

Abstract: Disclosed is a defect inspection device. The defect inspection device may include a lighting system designed for transmitting a lighting pattern having different illuminances for each area on a surface of an inspection object; a photographing unit for obtaining an image data of the inspection object; one or more processors for processing the image data; and a memory for storing a deep learning-based model. In addition, the one or more processors are adapted to control, the lighting system to transmit a lighting pattern having a different illuminance for each area on a surface of an inspection object, input, an image data obtained by the photographing unit into the deep learning-based model, wherein the image data includes a rapid change of illuminance in at least a part of the object surface; and determine, a defect on a surface of the inspection object using the deep learning-based model.

Abstract: This invention provides a system and method for determining the location and characteristics of certain surface features that comprises elevated or depressed regions with respect to a smooth surrounding surface on an object. A filter acts on a range image of the scene. A filter defines an annulus or other perimeter shape around each pixel in which a best-fit surface is established. A normal to the pixel allows derivation of local displacement height. The displacement height is used to establish a height deviation image of the object, with which bumps, dents or other height-displacement features can be determined. The bump filter can be used to locate regions on a surface with minimal irregularities by mapping such irregularities to a grid and then thresholding the grid to generate a cost function. Regions with a minimal cost are acceptable candidates for application of labels and other items in which a smooth surface is desirable.

Abstract: In accordance with some embodiments of the disclosed subject matter, methods, systems, and media for generating images of multiple sides of an object are provided. In some embodiments, a method comprises receiving information indicative of a 3D pose of a first object in a first coordinate space at a first time; receiving a group of images captured using at least one image sensor, each image associated with a field of view within the first coordinate space; mapping at least a portion of a surface of the first object to a 2D area with respect to the image based on the 3D pose of the first object; associating, for images including the surface, a portion of that image with the surface of the first object based on the 2D area; and generating a composite image of the surface using images associated with the surface.

Abstract: Embodiments relate to predicting height information for an object. First distance data is determined at a first time when an object is at a first position that is only partially within the field-of-view. Second distance data is determined at a second, later time when the object is at a second, different position that is only partially within the field-of-view. A distance measurement model that models a physical parameter of the object within the field-of-view is determined for the object based on the first and second distance data. Third distance data indicative of an estimated distance to the object prior to the object being entirely within the field-of-view of the distance sensing device is determined based on the first distance data, the second distance data, and the distance measurement model. Data indicative of a height of the object is determined based on the third distance data.

Abstract: An on-axis aimer and distance measurement apparatus for a vision system can include a light source configured to generate a first light beam along a first axis. The first light beam can project an aimer pattern on an object and a receiver can be configured to receive reflected light from the first light beam to determine a distance between a lens of the vision system and the object. One or more parameters of vision system can be controlled based on the determined distance.

Abstract: This invention provides a system for separating a field of view (FOV) of a scene imaged by a vision system camera assembly, in which a separating mirror assembly redirects a first optical path of at least a first optics with respect to at least a first image sensor in the camera assembly. A first reflecting assembly redirects the first optical path from the separating mirror toward a first FOV. The first optical path is extended free of splitting the image. The separating mirror assembly redirects a second optical path of a second optics with respect to a second image sensor in the camera assembly. A second reflecting assembly redirects the second optical path from the separating mirror toward a second FOV. The second optical path is extended free of splitting the image projected from the scene on the second image sensor.

Abstract: This invention provides a system and method that performs 3D imaging of a complex object, where image data is likely lost. Available 3D image data, in combination with an absence/loss of image data, allows computation of x, y and z dimensions. Absence/loss of data is assumed to be just another type of image data, and represents the presence of something that has prevented accurate data from being generated in the subject image. Segments of data can be connected to areas of absent data and generate a maximum bounding box. The shadow that this object generates can be represented as negative or missing data, but is not representative of the physical object. The height from the positive data, the object shadow size based on that height, the location in the FOV, and the ray angles that generate the images, are estimated and the object shadow size is removed from the result.

Abstract: Methods, systems, and computer readable media for generating a three-dimensional reconstruction of an object with reduced distortion are described. In some aspects, a system includes at least two image sensors, at least two projectors, and a processor. Each image sensor is configured to capture one or more images of an object. Each projector is configured to illuminate the object with an associated optical pattern and from a different perspective. The processor is configured to perform the acts of receiving, from each image sensor, for each projector, images of the object illuminated with the associated optical pattern and generating, from the received images, a three-dimensional reconstruction of the object. The three-dimensional reconstruction has reduced distortion due to the received images of the object being generated when each projector illuminates the object with an associated optical pattern from the different perspective.

Abstract: A system and method for communicating at least one of updated configuration information and hardware setup recommendations to a user of an ID decoding vision system is provided. An image of an object containing one or more IDs is acquired with a mobile device. The ID associated with the object is decoded to derive information. Physical dimensions of the ID associated with the object are determined. Based on the information and the dimensions, configuration data can be transmitted to a remote server that automatically determines setup information for the vision system based upon the configuration data. The remote server thereby transmits at least one of (a) updated configuration information to the vision system and (b) hardware setup recommendations to a user of the vision system based upon the configuration data.

Abstract: The techniques described herein relate to methods, apparatus, and computer readable media configured to test a pose of a three-dimensional model. A three-dimensional model is stored, the three dimensional model comprising a set of probes. Three-dimensional data of an object is received, the three-dimensional data comprising a set of data entries. The three-dimensional data is converted into a set of fields, comprising generating a first field comprising a first set of values, where each value of the first set of values is indicative of a first characteristic of an associated one or more data entries from the set of data entries, and generating a second field comprising a second set of values, where each second value of the second set of values is indicative of a second characteristic of an associated one or more data entries from the set of data entries, wherein the second characteristic is different than the first characteristic.

Abstract: This invention provides a vision system with an exchangeable illumination assembly that allows for increased versatility in the type and configuration of illumination supplied to the system without altering the underlying optics, sensor, vision processor, or the associated housing. The vision system housing includes a front plate that optionally includes a plurality of mounting bases for accepting different types of lenses, and a connector that allows removable interconnection with the illustrative illumination assembly. The illumination assembly includes a cover that is light transmissive. The cover encloses an illumination component that can include a plurality of lighting elements that surround an aperture through which received light rays from the imaged scene pass through to the lens. The arrangement of lighting elements is highly variable and the user can be supplied with an illumination assembly that best suits its needs without need to change the vision system processor, sensor or housing.

Abstract: This invention provides a vision system having a housing and an interchangeable lens module is provided. The module is adapted to seat on a C-mount ring provided on the front, mounting face of the housing. The module is attached via a plurality of fasteners that pass through a frame of the module and into the mounting face. The module includes a connector in a fixed location, which mates with a connector well on the mounting face to provide power and control to a driver board that operates a variable (e.g. liquid) lens within the optics of the lens module. The driver board is connected to the lens body by a flexible printed circuit board (PCB), which also allows for axial motion of the lens body with respect to the frame. This axial motion can be effected by an adjustment ring that can include an indexed/lockable, geared, outer surface.

Abstract: An image based code reader comprises an image sensor. The image sensor is configured to acquire an image of a code. Additionally, the image based code reader includes a lens configured to project an image scene including the code onto the image sensor, the lens comprising a variable optical power that controls a focus distance of the image based code reader. The image based code reader further includes a processor operatively coupled to the image sensor and the lens. The processor is configured to acquire the image of the code using only pixels located within a region of interest of the sensor, and a size of the region of interest is selected based on the focus distance of the reader.

Abstract: This invention provides a system and method that automatically decides motion parameters of hand-eye calibration, and conducts the calibration procedure with minimal human intervention. It automatically computes hand-eye calibration motion parameters and spatial positions during pre-calibration, whereby the calibration pattern can continuously remain inside, and covering, the entire field of view FOV of the vision system camera, providing a fully automatic hand-eye calibration process. This system and method advantageously operates in a robot-based hand-eye calibration environment and can compensate for a cantilever effect between the calibration target and the FOV. A hand-eye calibration computes the transformation from the robot coordinate space to the camera coordinate space.

Abstract: The techniques described herein relate to methods, apparatus, and computer readable media configured to determining a candidate three-dimensional (3D) orientation of an object represented by a three-dimensional (3D) point cloud. The method includes receiving data indicative of a 3D point cloud comprising a plurality of 3D points, determining a first histogram for the plurality of 3D points based on geometric features determined based on the plurality of 3D points, accessing data indicative of a second histogram of geometric features of a 3D representation of a reference object, computing, for each of a plurality of different rotations between the first histogram and the second histogram in 3D space, a scoring metric for the associated rotation, and determining the candidate 3D orientation based on the scoring metrics of the plurality of different rotations.