Abstract: A system can visually track which items in a store are selected for purchase by a shopper. The system can form a virtual shopping cart by analyzing multiple images, over time, to determine which purchasable items are located with the shopper, such as in a physical shopping cart, in a basket, or held by the shopper. By analyzing multiple images, over time, the system can account for items misidentified in one or more images, or fully or partially obscured in one or more images as the shopper traverses the store. Alternatively, the system can form a virtual shopping cart by analyzing instances in which a purchasable item is removed from a shelf or placed on a shelf. Items removed from, but not returned to, a shelf can be considered to be selected for purchase. The system can include a frictionless checkout that charges the shopper for the selected items.

Abstract: An apparatus is provided that executes instructions to move an item within a scan zone to specific X-Y coordinates of the scan zone. The item is placed on a platform and is rotated 360 degrees at each X-Y coordinate within the scan zone. Item images are captured by cameras at each X-Y coordinate and for each rotation at the corresponding X-Y coordinate. The item images are labeled and retained. The item images are used as input to a Machine-Learning Model (MLM) to train the MLM to recognize item codes for the items when subsequent images are captured for the item during a checkout. In an embodiment, during a checkout unknown item images are flagged and labeled with the corresponding item code when the corresponding item's barcode is scanned during the checkout; the labeled item images are also retailed for training the MLM for item recognition.

Abstract: A single item image is captured of an item situated within a given zone of a transaction area is captured, each different zone for each given item is associated a plurality of single item images captured by different cameras at different angles and perspectives of the transaction area. The single item images are passed to an existing segmentation Machine-Learning Model (MLM) and accurate masks for the items produced by the existing MLM are retained. A background image of an empty transaction area is obtained, each retained single item image is cropped and superimposed into the background image with one or more different cropped and superimposed singe item images creating a composite multi-item image. The composite multi-item images are labeled to identify the boundaries of each single item image and the existing segmentation MLM is trained on the composite multi-item and labeled images producing an enhanced segmentation MLM.

Abstract: Multiple images of a designated area are taken. The designated area comprises multiple items that are to be identified from the images. Depth information and Red, Green, Blue (RGB) data from each image is processed to create a point cloud for each image of the designated area. The point clouds are patched together or synchronized into a single point cloud for the designated area. Known background pixels associated with backgrounds for each image are removed from the single point cloud. The depth information and RGB data for the single point cloud is clustered together and bounding boxes are placed around each item in the single point cloud. At least the RGB data for each bounding box is provided to a machine-learning model (MLM) and the MLM returns an item code for the corresponding item. The item codes are fed to a transaction manager for a transaction associated with a customer.

Abstract: A first Machine-Learning Model (MLM) is processed on multiple images of a scene, each scene comprising a different perspective view of each of a plurality of items. The first MLM produces masks for the items within each image, each mask representing a portion of a given item within a given image. Depth information associated with the images and the masks are processed to isolate each portion of each item within each image. A single scene image is generated from the images by stitching each image’s pixel data from each portion or each image into a composite item image within the single scene image. Each item’s composite item image is passed to a second MLM and the second MLM returns an item code for the corresponding item associated with the corresponding composite item image. The item codes for each item is passed to a transaction manager to process a transaction.

Abstract: Depth camera settings are adjusted based on characteristics of items presented in a scan zone and based on depth values returned for the items in depth images. Red-Green-Blue (RGB) images and depth images are captured of items within the scan zone. Quality of the depth values are accessed. Bad depth values are replaced with good known depth values. When the depth values are not replaced, one or more depth value interpolation algorithms are selectively processed to enhance the depth values. The depth values are processed to place each item within a specific location of the scan zone and map that location to pixel values in the corresponding RGB images. The pixel values from the RGB images are passed to a classification model and an item code is returned. The item codes are provided to checkout a customer without any scanning of item barcodes of the items.

Abstract: Images of a transaction area comprising items are received during a checkout. Red-Green-Blue (RGB) data and Depth data are received with each image. Pixels captured in any given image by a given camera are pre-aligned with physical locations of a transaction area. Depth data provided by each camera and that camera's pre-alignment to the area are processed to map pixels in each image taken to X-Y coordinates within the area. X-Y coordinates for each item and for each image are grouped together as a single item within the area. RGB data for each image and item is used as a set of image patches per item. For each item, the corresponding patches are passed to a classification Machine-Learning Model (MLM) that returns an item code for each patch. A particular item code is selected for each set and the item codes are used to process the checkout.

Abstract: Multiple images of multiple items are captured of a transaction area during a checkout. The Red-Green-Blue (RGB) data associated with each item image patch is collected across the images and provided as input by a Machine-Learning Model (MLM), which returns an item code for the item. When the given MLM is unable to satisfactorily predict an item code for a given set of image patches, the patches associated with the images are presented to an operator of a checkout and the operator is asked to scan an item barcode for that item. The patches are labeled within the images with the item code and additional images of the item are captured and labeled with the item code when the barcode is scanned by the operator. The labeled images are used in a subsequent training session with the MLM to improve its item recognition accuracy for the item.

Abstract: Locations of a customer's device are tracked relative to an order placed with an establishment. The establishment is instructed to begin order preparation to coincide with the customer's arrival for the order. Customer's arrival at a pickup location is detected within a geofenced area for a premises of the establishment's location. Sensor data provided for the geofenced area is processed to track a vehicle of the customer within the geofenced area and to identify a specific location within the geofenced area where the vehicle is parked. Delivery staff are notified that the customer has arrived for the order and directed to the specific location where the vehicle is parked.

Abstract: Various embodiments herein each include at least one of systems methods, software, and data structures for electronic lock control and audit. The various embodiments, although widely applicable, are well suited for retail use where higher-value and access-controlled merchandise is stored in locked cages, closets, rooms, and cabinets to prevent theft. One method embodiment includes receiving, via a network from a mobile device app, an unlock request including an employee identifier and a lock identifier to unlock a secured resource of the lock identifier. The method proceeds in processing the request by validating the employee identifier is authorized to unlock the lock of the lock identifier at a current date and time and retrieving a key-code that will unlock the lock of the lock identifier. The method then proceeds with transmitting the key-code to the mobile device app to enable unlocking of the lock.

Abstract: A system can visually track which items in a store are selected for purchase by a shopper. The system can form a virtual shopping cart by analyzing multiple images, over time, to determine which purchasable items are located with the shopper, such as in a physical shopping cart, in a basket, or held by the shopper. By analyzing multiple images, over time, the system can account for items misidentified in one or more images, or fully or partially obscured in one or more images as the shopper traverses the store. Alternatively, the system can form a virtual shopping cart by analyzing instances in which a purchasable item is removed from a shelf or placed on a shelf. Items removed from, but not returned to, a shelf can be considered to be selected for purchase. The system can include a frictionless checkout that charges the shopper for the selected items.

Abstract: Various embodiments herein each include at least one of systems methods, software, and data structures for electronic lock control and audit. The various embodiments, although widely applicable, are well suited for retail use where higher-value and access-controlled merchandise is stored in locked cages, closets, rooms, and cabinets to prevent theft. One method embodiment includes receiving, via a network from a mobile device app, an unlock request including an employee identifier and a lock identifier to unlock a secured resource of the lock identifier. The method proceeds in processing the request by validating the employee identifier is authorized to unlock the lock of the lock identifier at a current date and time and retrieving a key-code that will unlock the lock of the lock identifier. The method then proceeds with transmitting the key-code to the mobile device app to enable unlocking of the lock.

Abstract: A system can visually track which items in a store are selected for purchase by a shopper. The system can form a virtual shopping cart by analyzing multiple images, over time, to determine which purchasable items are located with the shopper, such as in a physical shopping cart, in a basket, or held by the shopper. By analyzing multiple images, over time, the system can account for items misidentified in one or more images, or fully or partially obscured in one or more images as the shopper traverses the store. Alternatively, the system can form a virtual shopping cart by analyzing instances in which a purchasable item is removed from a shelf or placed on a shelf. Items removed from, but not returned to, a shelf can be considered to be selected for purchase. The system can include a frictionless checkout that charges the shopper for the selected items.

Abstract: A system can visually track which items in a store are selected for purchase by a shopper. The system can form a virtual shopping cart by analyzing multiple images, over time, to determine which purchasable items are located with the shopper, such as in a physical shopping cart, in a basket, or held by the shopper. By analyzing multiple images, over time, the system can account for items misidentified in one or more images, or fully or partially obscured in one or more images as the shopper traverses the store. Alternatively, the system can form a virtual shopping cart by analyzing instances in which a purchasable item is removed from a shelf or placed on a shelf. Items removed from, but not returned to, a shelf can be considered to be selected for purchase. The system can include a frictionless checkout that charges the shopper for the selected items.