Abstract: A system includes sensors and a tracking subsystem. The subsystem receives a first image feed from a first sensor and a second image feed from a second sensor. The field-of view of the second sensor at least partially overlaps with that of the first sensor. The subsystem detects an object in a frame from the first feed. The subsystem determines a first pixel position of the object. The subsystem determines a second pixel position of the object. Based on the first pixel position and the second pixel position, a global position for the object is determined in a space.

Abstract: A scalable tracking system includes a camera subsystem, a weight subsystem, and a central server. The camera subsystem includes cameras that capture video of a space, camera clients that determine local coordinates of objects in the captured videos, and a camera server that determines the physical positions of objects in the space based on the determined local coordinates. The weight subsystem determines when items were removed from shelves. The central server determines which object in the space removed the items based on the physical positions of the objects in the space and the determination of when items were removed.

Abstract: A system for identifying items based on aggregated metadata obtains images of an item. The system extracts a set of features from images of the item. The system identifies a first value of a first feature associated with a first image of the item. The system identifies a second value of the first feature associated with a second image of the item. The system aggregates the first value and the second value. The system associates the item to the aggregated first value and the second value, where the aggregated first value and the second value represent the first feature of the item. The system adds a new entry for each image of the item to a training dataset associated with an item identification model.

Abstract: A system includes a longitudinal rack storing a plurality of packs of cigarettes, a shoe movably attached to the rack, a magnet coupled to the shoe and a longitudinal circuit board arranged along the length of the rack. The circuit board includes an array of sensors along the length of the rack, wherein spacing between each pair of sensors equals a pre-selected thickness. Each sensor generates a value depending on a position of the magnet in relation to the sensor. The circuit board further includes a memory storing values generated by the sensors, and a processor configured to determine a position of the shoe/magnet based on the values and determine a pack count of the packs based on the position of the shoe/magnet.

Abstract: An apparatus to create a virtual layout of a virtual store to emulate a physical layout of a physical store includes a memory and a processor. The processor receives a physical position and orientation associated with a physical rack located in the physical store. In response, the processor places a virtual rack at a virtual position and orientation on the virtual layout, to represent the physical position and orientation of the physical rack on the physical layout. The processor receives virtual items associated with physical items located on physical shelves of the physical rack. In response, the processor places the virtual items on virtual shelves of the virtual rack, the virtual shelves representing the physical shelves of the physical rack. The processor assigns a rack camera, which captures video that includes the physical rack, to the virtual rack and stores the virtual layout in the memory.

Abstract: A data prediction subsystem stores event data indicating amounts of items removed from locations over a previous period of time and event-to-status transition rules for each location. An event is detected at a first location. The detected event is associated with a change in status of a first item. Based on the detected event and the event-to-status transition rules, an anticipated item status is determined for the first item, indicating whether the first item is believed to be present at the first location at a time during the previous period of time of the event data. Based at least in part on the anticipated item status for the first item, a prediction value is determined that corresponds to a recommended amount of the first item to request for a future time.

Abstract: A system for capturing images for training an item identification model obtains an identifier of an item. The system detects a triggering event at a platform, where the triggering event corresponds to a user placing the item on a platform. The system causes the platform to rotate. The system causes at least one camera to capture an image of the item while the platform is rotating. The system extracts a set of features associated with the item from the image. The system associates the item to the identifier and the set of features. The system adds a new entry to a training dataset of the item identification model, where the new entry represents the item labeled with the identifier and the set of features.

Abstract: An image sensor is positioned such that a field-of-view of the image sensor encompasses at least a portion of a rack storing items. The image sensor generates images of the items stored on the rack. Over a period of time, a tracking subsystem tracks a pixel position of the wrist of a person interacting with items stored on the rack, receives image frames of the angled-view images. The tracking subsystem determines whether an item was interacted with by a person and, if so, the identified item is assigned to the person.

Abstract: A system includes sensors and a processor that tracks first and second objects in a space. Upon detecting that a tracked position of the first object is within a threshold distance of a tracked position of a second object, a top-view image of the first object is received from a first sensor. Based on this top-view image, a first descriptor is determined for the first object. The first descriptor is associated with an observable characteristic of the first object. The processor identifies the first object based at least in part upon the first descriptor.

Abstract: An object tracking system includes a first sensor, a second sensor, and a tracking system. The first sensor is configured to capture a first frame of a global plane for at least a first portion of a space. The second sensor is configured to capture a second frame of at least a second portion of the space. The tracking system is configured to determine the object is within an overlap region with the second sensor based on a first pixel location. The tracking system is further configured to determine a first coordinate in the global plane for the object, to determine a second pixel location in the second frame for the object based on the first coordinate, and to store the second pixel location with an object identifier a tracking list associated with the second sensor.

Abstract: A sensor calibration system configured to receive a first frame of one or more markers on a repositionable platform at a first location within a space from a sensor. The system is further configured to determine pixel locations in the first frame for a first marker and a second marker from among the one or more markers. The system is further configured to receive distance information that corresponds with a distance between the platform and distance measuring devices. The system is further configured to determine (x,y) coordinates for the first marker and the second marker based on the distance information. The system is further configured to generate a homography based on the (x,y) coordinates and pixel locations of the first marker and the second marker. The homography includes coefficients that translate between pixel locations in the first frame of the sensor and (x,y) coordinates in the global plane.

Abstract: An object tracking system includes a sensor and a tracking system. The sensor is configured to capture a first frame of a global plane for at least a portion of a space. The tracking system is configured to receive a first coordinate in the global plane where a first marker is located in the space and to receive a second coordinate in the global plane where a second marker is located in the space. The tracking system is further configured to identify the first marker and the second marker within the first frame, to determine a first pixel location in the first frame for the first marker, to determine a second pixel location in the first frame for the second marker, and to generate a homography based on the first coordinate, the second coordinate, the first pixel location, and the second pixel location.

Abstract: An object tracking system that includes a sensor and a tracking system. The sensor configured to capture a frame of at least a portion of a rack within a global plane for a space. The tracking system is configured to detect an item was removed from the rack. The tracking system is further configured to receive the frame of the rack, to identify a marker on an item within a predefined zone in the frame, and to identify the item associated with the identified marker. The tracking system is further configured to determine a pixel location for a person, to determine the person is within the predefined zone associated with the, and to add the identified item to a digital cart associated with the person.

Abstract: An accessory mounting apparatus and system are provided. The system includes a structural framing, an accessory mounting apparatus, and an accessory. The accessory mounting apparatus includes a first component, a second component, and a connector arm. The first component includes a first base, a first rail connector that extends from the first base, and one or more first connectors. The second component includes a second base and a second rail connector that extends from the second base. The connector arm includes a second connector and a mounting arm, and the second connector is coupled to the one or more first connectors. Further, the first rail connector and the second rail connector are configured to engage a first rail slot and a second rail slot of the structural framing, accordingly. Additionally, the accessory is coupled to the mounting arm.

Abstract: A system determines an interaction period during which a fuel dispensing operation is performed at a fuel dispensing terminal. The system determines a measured volume per unit time parameter associated with fuel dispensed from the fuel dispensing terminal by dividing the determined volume for fuel by the interaction period. The system compares the measured volume per unit time parameter with a threshold volume per unit time parameter. In response to determining that the measured volume per unit time parameter is less than the threshold volume per unit time parameter, the system retrieves a video feed that shows the fuel dispensing terminal during the fuel dispensing operation. The system creates a file for the fuel dispensing operation. The system stores the video feed in the created file.

Abstract: A sensor mounting system that includes a sensor, a mounting ring, a faceplate support, and a faceplate. The mounting ring includes a first opening and a first plurality of threads that are disposed on an interior surface of the first opening. The faceplate support is disposed within the first opening of the mounting ring. The faceplate support includes a second plurality of threads that are configured to engage the first plurality of threads of the mounting ring and a second opening. The faceplate is disposed within the second opening of the faceplate support. The faceplate is coupled to the sensor and is configured to rotate within the second opening of the faceplate support.

Abstract: An object tracking system that includes a plurality of sensors and a tracking system. A first sensor from the plurality of sensors is configured to capture a first frame of a global plane for at least a portion of the space. The tracking system is configured to determine a pixel location in the first frame for an object located in the space, and to apply a homography to the pixel location to determine a coordinate in the global plane. The homography is configured to translate between pixel locations in the first frame and coordinates in the global plane.

Abstract: An apparatus includes a display, interface, and processor. The interface receives a live camera feed from a camera directed at a first physical structure located in a physical space. The processor receives an indication of an event associated with the first physical structure and accordingly displays a first virtual structure corresponding to the first physical structure. The first virtual structure includes virtual items that emulate physical items located on the first physical structure. The processor additionally displays a recording of the live camera feed, which depicts the event associated with the first physical structure.

Abstract: An object tracking system includes a first sensor, a second sensor, and a tracking system. The tracking system is configured to determine that the first current pixel location for the shelf marker does not match a first expected pixel location for the shelf marker. The tracking system is further configured to determine a second current pixel location for the shelf marker within a second frame from the second sensor, to recalibrate the first sensor when the second current pixel location for the shelf marker matches the second pixel location for the shelf marker and to update the first pixel location with the first current pixel location and the second pixel location with the second current pixel location when the second current pixel location for the shelf marker does not match the second pixel location for the shelf marker.