Abstract: In an aspect of the disclosure, a method, a computer-readable medium, and an apparatus are provided. The apparatus may generate a binary intermediate mask model from 2D image data and 3D data obtained from a background image and a component image. Because the intermediate mask model is binary, erosion and dilation (e.g., 2D data processing) may be used to remove noise from the intermediate mask model. The augmented intermediate mask model with any erroneous and/or missing data corrected, may be applied to the second aligned model. The pixels in the second aligned model that correspond to pixels in the augmented intermediate mask model that are assigned a value of 1 may be identified as foreground pixels. Then, the vision system may generate foreground object data using the 2D image data and the 3D data in the foreground pixels from the second aligned model.

Abstract: A package scanning conveyance system that integrates a first two-dimensional image with at least a second two-dimensional image or a three-dimensional point clouds to calculate or estimate a package's physical properties, and/or determine if there are two or more packages in a pile. The captured imaging data is transformed by the inventive system to provide real-time feedback to a human operator to enable the operator to maintain an understanding of the system's performance. The imaging data may also be used to perform quality-checks on other parts of the package delivery and conveyance systems and document the condition of packages that have passed through the system.

Abstract: In an aspect of the disclosure, a method, a computer-readable medium, and an apparatus are provided. The apparatus may maintain an first dataset configured to select pick points for objects. The apparatus may receive, from a user device, a user dataset including a user selected pick point associated with at least one object and a first image of the at least one first object. The apparatus may generate a second dataset based at least in part on the first dataset and the user dataset. The apparatus may receive a second image of a second object. The apparatus may select a pick point for the second object using the second dataset and the second image of the second object. The apparatus may send information associated with the pick point selected for the second object to a robotics device for picking up the second object.

Abstract: Training images can be synthesized in order to obtain enough data to train a model (e.g., a neural network) to recognize various classifications of a type of object. Images can be synthesized by blending images of objects labeled using those classifications into selected background images. To improve results, one or more operations are performed to determine whether the synthesized images can still be used as training data, such as by verifying one or more objects of interested represented in those images is not occluded, or at least satisfies a threshold level of acceptance. The training images can be used with real world images to train the model.

Abstract: Training images can be synthesized in order to obtain enough data to train a model (e.g., a neural network) to recognize various classifications of a type of object. Images can be synthesized by blending images of objects labeled using those classifications into selected background images. To improve results, one or more operations are performed to determine whether the synthesized images can still be used as training data, such as by verifying one or more objects of interested represented in those images is not occluded, or at least satisfies a threshold level of acceptance. The training images can be used with real world images to train the model.

Abstract: Described are approaches for assigning intervention requests from robots, robotic systems, and/or other smart systems to resources (e.g., human technicians, trained systems) in order to optimize system performance along a variety of different selection criteria specifying various performant dimensions, including, but not limited to improving system efficiency, reducing robot and/or robotics systems idle time, reducing technician idle time, improving triage outcomes, reducing data processing loads, maintaining client confidentiality that may be associated with one or more robotic picking systems.

Abstract: A package scanning conveyance system that integrates a first two-dimensional image with at least a second two-dimensional image or a three-dimensional point clouds to calculate or estimate a package's physical properties, and/or determine if there are two or more packages in a pile. The captured imaging data is transformed by the inventive system to provide real-time feedback to a human operator to enable the operator to maintain an understanding of the system's performance. The imaging data may also be used to perform quality-checks on other parts of the package delivery and conveyance systems and document the condition of packages that have passed through the system.

Abstract: In an aspect of the disclosure, a method, a computer-readable medium, and an apparatus are provided. The apparatus may maintain an first dataset configured to select pick points for objects. The apparatus may receive, from a user device, a user dataset including a user selected pick point associated with at least one object and a first image of the at least one first object. The apparatus may generate a second dataset based at least in part on the first dataset and the user dataset. The apparatus may receive a second image of a second object. The apparatus may select a pick point for the second object using the second dataset and the second image of the second object. The apparatus may send information associated with the pick point selected for the second object to a robotics device for picking up the second object.

Abstract: A package scanning conveyance system that integrates a first two-dimensional image with at least a second two-dimensional image or a three-dimensional point clouds to calculate or estimate a package's physical properties, and/or determine if there are two or more packages in a pile. The captured imaging data is transformed by the inventive system to provide real-time feedback to a human operator to enable the operator to maintain an understanding of the system's performance. The imaging data may also be used to perform quality-checks on other parts of the package delivery and conveyance systems and document the condition of packages that have passed through the system.