Abstract: A method for performing automatic visual inspection includes: capturing visual information of an object using a scanning system including a plurality of cameras; extracting, by a computing system including a processor and memory, one or more feature maps from the visual information using one or more feature extractors; classifying, by the computing system, the object by supplying the one or more feature maps to a complex classifier to compute a classification of the object, the complex classifier including: a plurality of simple classifiers, each simple classifier of the plurality of simple classifiers being configured to compute outputs representing a characteristic of the object; and one or more logical operators configured to combine the outputs of the simple classifiers to compute the classification of the object; and outputting, by the computing system, the classification of the object as a result of the automatic visual inspection.

Abstract: A method for generating a three-dimensional (3D) model of an object includes: capturing images of the object from a plurality of viewpoints, the images including color images; generating a 3D model of the object from the images, the 3D model including a plurality of planar patches; for each patch of the planar patches: mapping image regions of the images to the patch, each image region including at least one color vector; and computing, for each patch, at least one minimal color vector among the color vectors of the image regions mapped to the patch; generating a diffuse component of a bidirectional reflectance distribution function (BRDF) for each patch of planar patches of the 3D model in accordance with the at least one minimal color vector computed for each patch; and outputting the 3D model with the BRDF for each patch.

Abstract: A method for estimating tightly enclosing bounding boxes by a computing system includes: controlling a scanning system including one or more depth cameras to capture visual information of the scene including one or more objects; detecting the one or more objects of the scene based on the visual information; singulating each the one or more objects from the frame of the scene to generate one or more 3D models corresponding to the one or more objects, the one or more 3D models including a partial 3D model of a corresponding one of the one or more objects; extrapolating a more complete 3D model of the corresponding one of the one or more objects based on the partial 3D model; and estimating a tightly enclosing bounding box of the corresponding one of the one or more objects based on the more complete 3D model.

Abstract: A method for estimating tightly enclosing bounding boxes by a computing system includes: controlling a scanning system including one or more depth cameras to capture visual information of the scene including one or more objects; detecting the one or more objects of the scene based on the visual information; singulating each the one or more objects from the frame of the scene to generate one or more 3D models corresponding to the one or more objects, the one or more 3D models including a partial 3D model of a corresponding one of the one or more objects; extrapolating a more complete 3D model of the corresponding one of the one or more objects based on the partial 3D model; and estimating a tightly enclosing bounding box of the corresponding one of the one or more objects based on the more complete 3D model.

Abstract: A method for automatically recognizing content of labels on objects includes: capturing visual information of an object using a scanning system including one or more cameras, the object having one or more labels on one or more exterior surfaces; detecting, by a computing system, one or more surfaces of the object having labels; rectifying, by the computing system, the visual information of the one or more surfaces of the object to compute one or more rectified images; and decoding, by the computing system, content of a label depicted in at least one of the one or more rectified images.

Abstract: A method for performing automatic visual inspection includes: capturing visual information of an object using a scanning system including a plurality of cameras; extracting, by a computing system including a processor and memory, one or more feature maps from the visual information using one or more feature extractors; classifying, by the computing system, the object by supplying the one or more feature maps to a complex classifier to compute a classification of the object, the complex classifier including: a plurality of simple classifiers, each simple classifier of the plurality of simple classifiers being configured to compute outputs representing a characteristic of the object; and one or more logical operators configured to combine the outputs of the simple classifiers to compute the classification of the object; and outputting, by the computing system, the classification of the object as a result of the automatic visual inspection.

Abstract: A method for generating a three-dimensional (3D) model of an object includes: capturing images of the object from a plurality of viewpoints, the images including color images; generating a 3D model of the object from the images, the 3D model including a plurality of planar patches; for each patch of the planar patches: mapping image regions of the images to the patch, each image region including at least one color vector; and computing, for each patch, at least one minimal color vector among the color vectors of the image regions mapped to the patch; generating a diffuse component of a bidirectional reflectance distribution function (BRDF) for each patch of planar patches of the 3D model in accordance with the at least one minimal color vector computed for each patch; and outputting the 3D model with the BRDF for each patch.

Abstract: A method for estimating tightly enclosing bounding boxes by a computing system includes: controlling a scanning system including one or more depth cameras to capture visual information of the scene including one or more objects; detecting the one or more objects of the scene based on the visual information; singulating each the one or more objects from the frame of the scene to generate one or more 3D models corresponding to the one or more objects, the one or more 3D models including a partial 3D model of a corresponding one of the one or more objects; extrapolating a more complete 3D model of the corresponding one of the one or more objects based on the partial 3D model; and estimating a tightly enclosing bounding box of the corresponding one of the one or more objects based on the more complete 3D model.

Abstract: A keypoint detection system includes: a camera system including at least one camera; and a processor and memory, the processor and memory being configured to: receive an image captured by the camera system; compute a plurality of keypoints in the image using a convolutional neural network including: a first layer implementing a first convolutional kernel; a second layer implementing a second convolutional kernel; an output layer; and a plurality of connections between the first layer and the second layer and between the second layer and the output layer, each of the connections having a corresponding weight stored in the memory; and output the plurality of keypoints of the image computed by the convolutional neural network.

Abstract: A method for generating a three-dimensional (3D) model of an object includes: capturing images of the object from a plurality of viewpoints, the images including color images; generating a 3D model of the object from the images, the 3D model including a plurality of planar patches; for each patch of the planar patches: mapping image regions of the images to the patch, each image region including at least one color vector; and computing, for each patch, at least one minimal color vector among the color vectors of the image regions mapped to the patch; generating a diffuse component of a bidirectional reflectance distribution function (BRDF) for each patch of planar patches of the 3D model in accordance with the at least one minimal color vector computed for each patch; and outputting the 3D model with the BRDF for each patch.

Abstract: A method for performing automatic visual inspection includes: capturing visual information of an object using a scanning system including a plurality of cameras; extracting, by a computing system including a processor and memory, one or more feature maps from the visual information using one or more feature extractors; classifying, by the computing system, the object by supplying the one or more feature maps to a complex classifier to compute a classification of the object, the complex classifier including: a plurality of simple classifiers, each simple classifier of the plurality of simple classifiers being configured to compute outputs representing a characteristic of the object; and one or more logical operators configured to combine the outputs of the simple classifiers to compute the classification of the object; and outputting, by the computing system, the classification of the object as a result of the automatic visual inspection.

Abstract: A system for acquiring three-dimensional (3-D) models of objects includes a first camera group including: a first plurality of depth cameras having overlapping fields of view; a first processor; and a first memory storing instructions that, when executed by the first processor, cause the first processor to: control the first depth cameras to simultaneously capture a first group of images of a first portion of a first object; compute a partial 3-D model representing the first portion of the first object; and detect defects in the first object based on the partial 3-D model representing the first portion of the first object.

Abstract: A method for estimating tightly enclosing bounding boxes by a computing system includes: controlling a scanning system including one or more depth cameras to capture visual information of the scene including one or more objects; detecting the one or more objects of the scene based on the visual information; singulating each the one or more objects from the frame of the scene to generate one or more 3D models corresponding to the one or more objects, the one or more 3D models including a partial 3D model of a corresponding one of the one or more objects; extrapolating a more complete 3D model of the corresponding one of the one or more objects based on the partial 3D model; and estimating a tightly enclosing bounding box of the corresponding one of the one or more objects based on the more complete 3D model.

Abstract: A keypoint detection system includes: a camera system including at least one camera; and a processor and memory, the processor and memory being configured to: receive an image captured by the camera system; compute a plurality of keypoints in the image using a convolutional neural network including: a first layer implementing a first convolutional kernel; a second layer implementing a second convolutional kernel; an output layer; and a plurality of connections between the first layer and the second layer and between the second layer and the output layer, each of the connections having a corresponding weight stored in the memory; and output the plurality of keypoints of the image computed by the convolutional neural network.

Abstract: A method for calibrating a camera group includes: controlling a first and second cameras to capture first and second images of a first scene, the first camera having a first field of view (FOV), the second camera having a second FOV overlapping the first FOV in a first overlap region; the first scene including a calibration target in the first overlap region; computing a first relative pose based on the first and second images; controlling the second camera and a third camera to capture third and fourth images of a second scene, the third camera having a third FOV overlapping the second FOV in a second overlap region, the second scene including a calibration target in the second overlap region; computing a second relative pose based on the third and fourth images; and computing a third relative pose based on the first and second relative poses.

Abstract: A method for automatically recognizing content of labels on objects includes: capturing visual information of an object using a scanning system including one or more cameras, the object having one or more labels on one or more exterior surfaces; detecting, by a computing system, one or more surfaces of the object having labels; rectifying, by the computing system, the visual information of the one or more surfaces of the object to compute one or more rectified images; and decoding, by the computing system, content of a label depicted in at least one of the one or more rectified images.

Abstract: A method for estimating tightly enclosing bounding boxes by a computing system includes: controlling a scanning system including one or more depth cameras to capture visual information of the scene including one or more objects; detecting the one or more objects of the scene based on the visual information; singulating each the one or more objects from the frame of the scene to generate one or more 3D models corresponding to the one or more objects, the one or more 3D models including a partial 3D model of a corresponding one of the one or more objects; extrapolating a more complete 3D model of the corresponding one of the one or more objects based on the partial 3D model; and estimating a tightly enclosing bounding box of the corresponding one of the one or more objects based on the more complete 3D model.

Abstract: A method for performing automatic visual inspection includes: capturing visual information of an object using a scanning system including a plurality of cameras; extracting, by a computing system including a processor and memory, one or more feature maps from the visual information using one or more feature extractors; classifying, by the computing system, the object by supplying the one or more feature maps to a complex classifier to compute a classification of the object, the complex classifier including: a plurality of simple classifiers, each simple classifier of the plurality of simple classifiers being configured to compute outputs representing a characteristic of the object; and one or more logical operators configured to combine the outputs of the simple classifiers to compute the classification of the object; and outputting, by the computing system, the classification of the object as a result of the automatic visual inspection.

Abstract: A method for calibrating a camera group includes: controlling a first and second cameras to capture first and second images of a first scene, the first camera having a first field of view (FOV), the second camera having a second FOV overlapping the first FOV in a first overlap region; the first scene including a calibration target in the first overlap region; computing a first relative pose based on the first and second images; controlling the second camera and a third camera to capture third and fourth images of a second scene, the third camera having a third FOV overlapping the second FOV in a second overlap region, the second scene including a calibration target in the second overlap region; computing a second relative pose based on the third and fourth images; and computing a third relative pose based on the first and second relative poses.

Abstract: A method for classifying physical objects includes: controlling, by a processor, one or more depth cameras to capture depth images of a query object; controlling, by the processor, one or more color cameras to capture a color images of the query object; computing, by the processor, a three-dimensional (3D) model of the query object using the depth images; combining, by the processor, the color images with the 3D model; computing, by the processor, a descriptor from the 3D model and the color images, the descriptor including: a multi-dimensional shape descriptor space representation of a 3D shape of the query object; a multi-dimensional color descriptor space representation of a texture of the query object; and a one-dimensional size descriptor space representation of a size of query object; supplying, by the processor, the descriptor to a classifier to compute a classification of the query object; and outputting the classification of the query object.