Abstract: A system for refining an item identification model detects a triggering event at a platform, where the triggering event corresponds to a user placing the item on a platform. The system captures images of the item. The system extracts a set of features from at least one of the images. The system identifies the item based on the set of features. The system receives an indication that the item is not identified correctly. The system receives an identifier of the item. The system identifies the item based on the identifier of the item. The system feeds the identifier of the item and the images to the item identification model. The system retrains the item identification model to learn to associate the item to the images. The system updates the set of features based on the determined association between the item and the images.

Abstract: An image sensor is positioned such that a field-of-view of the image sensor encompasses at least a portion of a rack storing items. The image sensor generates angled-view images of an object. A pixel position of a body part of a person is determined in at least a subset of the received image frames, thereby determining a set of pixel positions of the body part. An aggregated body part position is determined based on the set of pixel positions. If the aggregated body part position is determined to correspond to a position associated with the object, a trigger signal is provided indicating an interaction event has occurred.

Abstract: A system includes a sensor, a weight sensor, and a tracking subsystem. The tracking subsystem receives an image feed of top-view images generated by the sensor and weight measurements from the weight sensor. The tracking subsystem detects an event associated with an item being removed from a rack in which the weight sensor is installed. The tracking subsystem determines that a first person or a second person may be associated with the event. In response to determining that the first or second person may be associated with the event, buffer frames are stored of top-view images generated by the sensor during a time period associated with the event. The tracking subsystem then determines, using at least one of the stored buffer frames and a first action-detection algorithm, whether an action associated with the event was performed by the first person or the second person.

Abstract: A system includes a sensor, a weight sensor, and a tracking subsystem. The tracking subsystem receives an image feed of top-view images generated by the sensor and weight measurements from the weight sensor. The tracking subsystem detects an event associated with an item being removed from a rack in which the weight sensor is installed. The tracking subsystem determines that a first person or a second person may be associated with the event. In response to determining that the first or second person may be associated with the event, buffer frames are stored of top-view images generated by the sensor during a time period associated with the event. The tracking subsystem then determines, using at least one of the stored buffer frames and a first action-detection algorithm, whether an action associated with the event was performed by the first person or the second person.

Abstract: A weight sensor includes a plurality of load cells. A first load cell is configured to produce a first electric current based on a force experienced by the first load cell. A second load cell is configured to produce a second electric current based on a force experienced by the second load cell. A third load cell is configured to produce a third electric current based on a force experienced by the third load cell. And a fourth load cell is configured to produce a fourth electric current based on a force experienced by the fourth load cell.

Abstract: An object tracking system that includes a sensor and a tracking system. The sensor is configured to capture a frame of at least a portion of a rack within a global plane for a space. The tracking system is further configured to receive the frame, to determine a pixel location for the first person, and to determine a person is within the predefined zone associated with the rack. The tracking system is further configured to identify the plurality of items in a digital cart associated with the person, to identify an item from the digital cart associated with the first person, and to remove the identified item from the digital cart associated with the person.

Abstract: A system includes a first sensor configured to generate images of at least a first portion of a space. A processor of the system is configured to determine a position of a possible object in the space based on generated images.

Abstract: A device configured to detect a triggering event at a platform and to capture a depth image of items on the platform using a three-dimensional (3D) sensor. The device is further configured to determine an object pose for each item on the platform and to identify one or more cameras from among a plurality of cameras based on the object pose for each item on the platform. The device is further configured to capture one or more images of the items on the platform using the identified cameras and to identify items within the one or more images based on features of the items. The device is further configured to identify a user associated with the identified items on the platform, to identify an account that is associated with the user, and to associate the identified items with the account of the user.

Abstract: An image sensor is positioned such that a field-of-view of the sensor encompasses portion of a beverage machine. The field-of-view includes a zone associated with operating the beverage machine. A subsystem receives a signal indicating beverage is dispensed and angled-view images from the image sensor. First image(s) associated with a start of beverage being dispensed are determined by detecting a hand of a person entering the zone associated with operating the beverage machine. A first identifier is determined for the person in the first image(s). Second image(s) associated with an end of the beverage being dispensed are determined by detecting a hand of the person exiting the zone. A second identifier is determined for the person in the second image(s). If the first identifier is the same as the second identifier, the beverage is assigned to the person with the first identifier.

Abstract: An object tracking system that includes a first sensor and a second sensor that are each configured to capture frames of at least a portion of a global plane for a space. The system is configured to identify a first pixel location for a marker within a first frame and to determine an (x,y) coordinate for the marker using a first homography. The system is further configured to identify a second pixel location for the marker in the second sensor using a second homography, to identify a third pixel location using a disparity mapping, and to determine a distance difference between the second pixel location and the third pixel location. The system is further configured to compare the distance difference to a difference threshold level and to recompute the first homography and/or the second homography in response to determining that the distance difference exceeds the difference threshold level.

Abstract: A device configured to detect a triggering event at a platform and to capture a depth image of items on the platform using a three-dimensional (3D) sensor. The device is further configured to determine an object pose for each item on the platform and to identify one or more cameras from among a plurality of cameras based on the object pose for each item on the platform. The device is further configured to capture one or more images of the items on the platform using the identified cameras and to identify items within the one or more images based on features of the items. The device is further configured to identify a user associated with the identified items on the platform, to identify an account that is associated with the user, and to associate the identified items with the account of the user.

Abstract: An image sensor is positioned such that a field-of-view of the sensor encompasses portion of a beverage machine. The field-of-view includes a first zone associated with operating the beverage machine to dispense the beverage and a second zone in which a cup is placed to receive the beverage. A beverage assignment subsystem receives angled-view images from the image sensor. An event associated with an object entering one or both of the first zone and the second zone is detected. In image(s) associated with a start of the event, it is determined that both a hand of a person enters the first zone and the cup is placed in the second zone. If the cup remained in the second zone for at least a threshold time, the beverage is assigned to the person whose hand entered the first zone.

Abstract: In response to detecting a first triggering event corresponding to placement of a first item on a platform, a first image of the platform is captured. A first item identifier of the first item is identified and stored in a memory. In response to detecting a second triggering event corresponding to placement of a second item on the platform, a second image of the platform is captured. The second image is compared with the first image. Upon determining that the first item depicted in the second image overlaps with the first item depicted in the first image and the overlap equals or exceeds a threshold, the first item identifier is assigned to the first item depicted in the second image. A second item identifier of the second item is identified, and information associated with the first item identifier and the second item identifier is displayed on a user interface device.

Abstract: In response to detecting a triggering event corresponding to placement of a first item on a platform, a plurality of images of the first item are captured. For each image of the first item, a cropped image is generated including a bounding box around the first item depicted in the image. For each cropped image, a ratio is calculated between a portion of a total area within the bounding box occupied by the first item and the total area. If the ratio equals or exceeds a minimum threshold, an item identifier associated with the first item is identified based on the cropped image. On the other hand, if the ratio is below the threshold, the cropped image is discarded. A particular item identifier is selected from a set of cropped images that were not discarded.

Abstract: In response to detecting a triggering event corresponding to placement of a first item on a platform, a plurality of images are captured of the first item and a plurality of cropped images are generated based on the first images. An item identifier is identified based on each cropped image, wherein each item identifier is associated with a numerical similarity value. Each cropped image is further tagged as a front image or a back image. A particular item identifier identified for a corresponding cropped image tagged as a front image is selected and associated with the first item. An indicator of the particular item identifier is displayed on a user interface device.

Abstract: In response to detecting a first triggering event corresponding to placement of a first item on a platform, a plurality of first images are captured of the first item and a plurality of cropped first images are generated based on the first images. A first item identifier associated with the first item is identified based on the cropped first images. In response to detecting a second triggering event corresponding to placement of a second item on the platform, a plurality of second images of the first item are captured and a plurality of cropped second images are generated from the second images. In response to determining that the cropped first images match with the cropped second images, the first item identifier is assigned to the first item depicted in the second images.

Abstract: A device captures an image of a first item and generates a first encoded vector for the image. The device identifies a set of items that have at least one attribute in common with the first item. The device determines the identity of the first item based at least on attributes of the first item. The device determines that a confidence score associated with the identity of the first item is less than a threshold percentage. In response, the device determines a height of the first item. The device identifies item(s) with average heights within a threshold range from the height of the first item. The device compares the first encoded vector with a second encoded vector associated with a second item from the identified item(s). If the first encoded vector corresponds to the second encoded vector, the device determines that the first item corresponds to the second item.

Abstract: A device detects a triggering event that corresponds to a placement of an item on a platform. In response, the device captures an image of the item and generates a first encoded vector for the image. The first encoded vector describes one or more attributes of the item. The device determines that the item is associated with a first container category based on the one or more attributes of the item. The device identifies one or more items that have been identified as having placed inside a container associated with the first container category. The device displays a list of item options that comprises the one or more items on a graphical user interface (GUI). The device receives a selection of a first item from along the list of item options and identifies the first item as being inside the container.

Abstract: In response to detecting a first triggering event corresponding to placement of a first item on a platform, a plurality of first images are captured of the first item. An item identifier associated with the first item is identified based on the first images and assigned to the first item. In response to detecting a second triggering event corresponding to placement of a second item on the platform, a plurality of second images are captured of the second item, a plurality of cropped images are generated based on the second images, and a plurality of item identifiers are determined for the second item based on the cropped images. When a process for selecting a particular item identifier from the plurality of item identifiers fails, a second item identifier is assigned to the second item based on an association between the first item identifier and the second item identifier.

Abstract: A device detects a triggering event that corresponds to a placement of a first item on a platform. In response, the device captures an image of the first item and generates a first encoded vector for the image. The first encoded vector describes one or more attributes of the first item. The device determines a height of the first item. The device identifies one or more items in an encoded vector library that are associated with average heights within a threshold range from the determined height of the first item. The device compares the first encoded vector with a second encoded vector associated with a second item from among the one or more items. The device determines that the first encoded vector corresponds to the second encoded vector. In response, the device determines that the first item corresponds to the second item.