Abstract: A system includes sensors and a tracking subsystem. The subsystem receives a first image feed from a first sensor and a second image feed from a second sensor. The field-of view of the second sensor at least partially overlaps with that of the first sensor. The subsystem detects an object in a frame from the first feed. The subsystem determines a first pixel position of the object. The subsystem determines a second pixel position of the object. Based on the first pixel position and the second pixel position, a global position for the object is determined in a space.

Abstract: A system for identifying items based on aggregated metadata obtains images of an item. The system extracts a set of features from images of the item. The system identifies a first value of a first feature associated with a first image of the item. The system identifies a second value of the first feature associated with a second image of the item. The system aggregates the first value and the second value. The system associates the item to the aggregated first value and the second value, where the aggregated first value and the second value represent the first feature of the item. The system adds a new entry for each image of the item to a training dataset associated with an item identification model.

Abstract: A scalable tracking system includes a camera subsystem, a weight subsystem, and a central server. The camera subsystem includes cameras that capture video of a space, camera clients that determine local coordinates of objects in the captured videos, and a camera server that determines the physical positions of objects in the space based on the determined local coordinates. The weight subsystem determines when items were removed from shelves. The central server determines which object in the space removed the items based on the physical positions of the objects in the space and the determination of when items were removed.

Abstract: A system includes a longitudinal rack storing a plurality of packs of cigarettes, a shoe movably attached to the rack, a magnet coupled to the shoe and a longitudinal circuit board arranged along the length of the rack. The circuit board includes an array of sensors along the length of the rack, wherein spacing between each pair of sensors equals a pre-selected thickness. Each sensor generates a value depending on a position of the magnet in relation to the sensor. The circuit board further includes a memory storing values generated by the sensors, and a processor configured to determine a position of the shoe/magnet based on the values and determine a pack count of the packs based on the position of the shoe/magnet.

Abstract: An image sensor is positioned such that a field-of-view of the image sensor encompasses at least a portion of a rack storing items. The image sensor generates images of the items stored on the rack. Over a period of time, a tracking subsystem tracks a pixel position of the wrist of a person interacting with items stored on the rack, receives image frames of the angled-view images. The tracking subsystem determines whether an item was interacted with by a person and, if so, the identified item is assigned to the person.

Abstract: An object tracking system includes a first sensor, a second sensor, and a tracking system. The first sensor is configured to capture a first frame of a global plane for at least a first portion of a space. The second sensor is configured to capture a second frame of at least a second portion of the space. The tracking system is configured to determine the object is within an overlap region with the second sensor based on a first pixel location. The tracking system is further configured to determine a first coordinate in the global plane for the object, to determine a second pixel location in the second frame for the object based on the first coordinate, and to store the second pixel location with an object identifier a tracking list associated with the second sensor.

Abstract: A system includes sensors and a processor that tracks first and second objects in a space. Upon detecting that a tracked position of the first object is within a threshold distance of a tracked position of a second object, a top-view image of the first object is received from a first sensor. Based on this top-view image, a first descriptor is determined for the first object. The first descriptor is associated with an observable characteristic of the first object. The processor identifies the first object based at least in part upon the first descriptor.

Abstract: An object tracking system includes a sensor and a tracking system. The sensor is configured to capture a first frame of a global plane for at least a portion of a space. The tracking system is configured to receive a first coordinate in the global plane where a first marker is located in the space and to receive a second coordinate in the global plane where a second marker is located in the space. The tracking system is further configured to identify the first marker and the second marker within the first frame, to determine a first pixel location in the first frame for the first marker, to determine a second pixel location in the first frame for the second marker, and to generate a homography based on the first coordinate, the second coordinate, the first pixel location, and the second pixel location.

Abstract: A sensor calibration system configured to receive a first frame of one or more markers on a repositionable platform at a first location within a space from a sensor. The system is further configured to determine pixel locations in the first frame for a first marker and a second marker from among the one or more markers. The system is further configured to receive distance information that corresponds with a distance between the platform and distance measuring devices. The system is further configured to determine (x,y) coordinates for the first marker and the second marker based on the distance information. The system is further configured to generate a homography based on the (x,y) coordinates and pixel locations of the first marker and the second marker. The homography includes coefficients that translate between pixel locations in the first frame of the sensor and (x,y) coordinates in the global plane.

Abstract: An object tracking system that includes a sensor and a tracking system. The sensor configured to capture a frame of at least a portion of a rack within a global plane for a space. The tracking system is configured to detect an item was removed from the rack. The tracking system is further configured to receive the frame of the rack, to identify a marker on an item within a predefined zone in the frame, and to identify the item associated with the identified marker. The tracking system is further configured to determine a pixel location for a person, to determine the person is within the predefined zone associated with the, and to add the identified item to a digital cart associated with the person.

Abstract: An object tracking system that includes a plurality of sensors and a tracking system. A first sensor from the plurality of sensors is configured to capture a first frame of a global plane for at least a portion of the space. The tracking system is configured to determine a pixel location in the first frame for an object located in the space, and to apply a homography to the pixel location to determine a coordinate in the global plane. The homography is configured to translate between pixel locations in the first frame and coordinates in the global plane.

Abstract: A sensor mounting system that includes a sensor, a mounting ring, a faceplate support, and a faceplate. The mounting ring includes a first opening and a first plurality of threads that are disposed on an interior surface of the first opening. The faceplate support is disposed within the first opening of the mounting ring. The faceplate support includes a second plurality of threads that are configured to engage the first plurality of threads of the mounting ring and a second opening. The faceplate is disposed within the second opening of the faceplate support. The faceplate is coupled to the sensor and is configured to rotate within the second opening of the faceplate support.

Abstract: A system for diagnostic analysis of a toilet over time intervals comprises a processor operable to receive a distance measurement from a sensor over a network. The processor is operable to determine an instance of a decrease in a water level in a toilet tank based on a comparison of the received distance measurement to a setpoint and to determine a plurality of instances of the decrease in the water level within a period of time. The processor is operable to calculate a ratio of the determined number of the plurality of instances of the decrease in the water level to a number of instances wherein a door changes from a first position to a second position. The processor is operable to compare the calculated ratio to a threshold ratio and to send an alert to a user device when the calculated ratio is less than the threshold ratio.

Abstract: A system for determining an ambient concentration of compositions for bathroom cleaning comprises a processor operable to receive a concentration measurement from a sensor over a network within a first period of time. The processor is operable to compare the received concentration measurement to a first threshold and to a second threshold greater than the first threshold. The processor is operable to instruct a memory communicatively coupled to the processor to store an indication that a bathroom was cleaned in response to a determination that the received concentration measurement is greater than the first threshold and less than the second threshold. The processor is operable to send an alert for display on a user device indicating either that the sensor has been tampered or that a spill event has occurred in response to a determination that the received concentration measurement is greater than the second threshold.

Abstract: A system includes a door sensor that provides a status of whether a door of a refrigeration system is open or closed, a temperature sensor that measures a temperature of a food compartment of the refrigeration system, a power sensor that measures an amount of power consumed by the refrigeration system, and a compressor sensor that provides acoustic data about a compressor of the refrigeration system. The system further includes a remote computing system configured to send an alert indicating that the refrigeration system needs servicing when the temperature of the food compartment of the refrigeration system is determined to be above a predetermined temperature while: the door of the refrigeration system is closed, the amount of power consumed by the refrigeration system is within a predetermined power range, and acoustic signals of the compressor of the refrigeration system are within a predetermined acoustic range.

Abstract: A system includes one or more memory units and a processor. The processor is configured to receive, from a food temperature probe, a first temperature associated with a first food item. The processor is further configured to receive, from the food temperature probe, a second temperature associated with a second food item. The processor is further configured to receive, from the food temperature probe, a third temperature that was measured by the food temperature probe after measuring the first temperature but before measuring the second temperature, the third temperature associated with a cleaning of the food temperature probe. The processor is further configured to send an alert for display on a user device when the third temperature is greater than the cleaning threshold temperature.

Abstract: An apparatus includes a display, interface, and processor. The interface receives a live camera feed from a camera directed at a first physical structure located in a physical space. The processor receives an indication of an event associated with the first physical structure and accordingly displays a first virtual structure corresponding to the first physical structure. The first virtual structure includes virtual items that emulate physical items located on the first physical structure. The processor additionally displays a recording of the live camera feed, which depicts the event associated with the first physical structure.

Abstract: An object tracking system includes a first sensor, a second sensor, and a tracking system. The tracking system is configured to determine that the first current pixel location for the shelf marker does not match a first expected pixel location for the shelf marker. The tracking system is further configured to determine a second current pixel location for the shelf marker within a second frame from the second sensor, to recalibrate the first sensor when the second current pixel location for the shelf marker matches the second pixel location for the shelf marker and to update the first pixel location with the first current pixel location and the second pixel location with the second current pixel location when the second current pixel location for the shelf marker does not match the second pixel location for the shelf marker.

Abstract: A system includes a first sensor and a sensor client. During an initial time interval, the sensor client receives images generated by the first sensor and detects contours in the images. The sensor client determines, based on the contours, regions of the images generated by the first sensor to exclude during object tracking. During a subsequent time interval, the sensor client receives a second image generated by the first sensor and detects a contour in the image. The sensor client determines pixel coordinates of the second contour and determines whether at least a threshold percentage of the second pixel coordinates overlap with the region to exclude during object tracking. If at least the threshold percentage of the second pixel coordinates overlap with the region to exclude, a position for tracking the second contour is not determined.

Abstract: A system includes sensors and a tracking subsystem. The subsystem receives frames of top-view images generated by the sensors. The subsystem tracks a first and second object, based on received frames. The subsystem detects that the first object is within a threshold distance of the second object. In response, the subsystem determines a probability that the first object switched identifiers with the second object and updates candidate lists accordingly for the first and second objects. The updated first candidate list includes a probability that the first object is associated with a first identifier and a probability that the first object is associated with a second identifier.