Abstract: Described is a system for counting stacked items using image analysis. In one implementation, an image of an inventory location with stacked items is obtained and processed to determine the number of items stacked at the inventory location. In some instances, the item closest to the camera that obtains the image may be the only item viewable in the image. Using image analysis, such as depth mapping or Histogram of Oriented Gradients (HOG) algorithms, the distance of the item from the camera and the shelf of the inventory location can be determined. Using this information, and known dimension information for the item, a count of the number of items stacked at an inventory location may be determined.

Abstract: Described are systems and techniques configured to authenticate a user upon entry to a facility. Prior to entry, the user may log in to a secure website with valid credentials, whereupon a login image of the user at the time of login is acquired. In one implementation, optically encoded data is generated which includes data representative of the login image, an acquisition timestamp, and an identifier value. At entry of the user to the facility, an entry image of the user's face, an image of the optically encoded data as presented on a display of a computing device in possession of the user, and an entry timestamp are acquired. By determining the timestamp is within a valid range of time and the data representative of the login image corresponds to the entry image, the user is authenticated to the identifier value.

Abstract: Described is a multiple-camera system and process for determining an item involved in an event. For example, when a user picks an item or places an item at an inventory location, image information for the item may be obtained and processed to identify the item involved in the event and associate that item with the user.

Abstract: Sensors in a facility generate sensor data associated with a region of the facility, which can be used to determine a 3D location of an object in the facility. Some sensors may sense overlapping regions of the facility. For example, a first sensor may generate data associated with a first region of the facility, while a second sensor may generate data associated with a second region of the facility that partially overlaps the first region. Sensors may fail at times as determined from sensor output data or status data. In response to identifying a failed sensor, an undetected region corresponding to the failed sensor is identified, as well as a substitute sensor that partially senses the undetected region. Sensor data from the substitute sensor, such as 2D data, is acquired and used to estimate a 3D location of an object in the undetected region.

Abstract: Point-of-sale systems may include stations having interactive monitors mounted at specific heights and angles that permit such monitors to be viewed and interacted with by an associate or a customer. Some point-of-sale systems may include two stations, each having a monitor aligned in opposite directions, a user of one monitor may not view the other monitor, and vice versa. The point-of-sale systems may also include instrument readers (e.g., credit card readers or NFC readers) for recognizing payment instruments of customers and identifying the customers based on the payment instruments. Each of the monitors and instrument readers may be linked by cables to computer devices that are securely housed in a chamber above which the monitors are mounted. The monitors and other components are installed in a modular fashion, and may be independently installed or replaced without requiring an installation or replacement of the entire point-of-sale system.

Abstract: This disclosure describes a system for assisting users in locating items from inventory locations and/or obtaining additional information about items. In some instances, a user may experience difficulty in locating an inventory item in a materials handling facility. By detecting one or more expressions presented by the user, an inventory management system may determine that assistance is to be provided to the user, determine and provide the appropriate assistance to the user.

Abstract: Described is a multiple-camera system and process for detecting a user within a materials handling facility and tracking a position of the user as the user moves through the materials handling facility. In one implementation, a plurality of depth sensing cameras are positioned above a surface of the materials handling facility and oriented to obtain a top-down view of the surface of the materials handling facility, along with any objects (e.g., users) on the surface of the materials handling facility. The depth information from the cameras may be utilized to detect objects on the surface of the materials handling facility, track a movement of those objects and determine if those objects are users.

Abstract: An item stowed at an inventory location may rest or be supported by a surface, such as a shelf, that includes an optical sensor array. The optical sensor array comprises a plurality of optical sensors that detect light intensity values. When a light source illuminates the item resting on the surface, a footprint or shadow is cast by the item onto the surface. Such a shadow is detected by the light intensity values at the optical sensors in the optical sensor array. Once the shadow is detected, information about the area, shape, and perimeter of the shadow can be determined and saved as footprint data for a single item. Such a process can be performed at intake of the item to the facility and later accessed to determine a quantity of the item on a shelf of a facility.

Abstract: Described is a multiple-camera system and process for determining an item involved in an event. For example, when a user picks an item or places an item at an inventory location, image information for the item may be obtained and processed to identify the item involved in the event and associate that item with the user.

Abstract: Described is a multiple-camera system for use in capturing images of users within a materials handling facility and processing those images to monitor the movement of users. For large materials handling facilities, a large number of cameras may be required to monitor the facility. Processing of the data generated from a large number of cameras becomes difficult. The implementations described herein include a hierarchy that allows image data from any number of cameras within a materials handling facility to be processed without substantially increasing the processing time needed or sacrificing processing capabilities.

Abstract: This disclosure describes an item drop location for placing items that have been picked from an inventory location within a material handling facility but have not yet been transitioned from the materials handling facility and a return location for returning items that have been transitioned from the materials handling facility. Likewise, described is a system and method for identifying an item placed at a drop location or an item placed at a return location, processing the placed item and providing confirmation to a user that placed the item and facilitating a return of the item or a removal of the item from an item identifier list associated with the user.

Abstract: During operation, a facility may utilize many sensors, such as cameras, to generate sensor data. The sensor data may be processed by an inventory management system to track objects, determine the occurrence of events at the facility, and so forth. At any given time, some of these sensors may fail to provide timely data, may fail to provide any data, may generate inaccurate data, and so forth. Described are techniques to determine failure of sensors and adjust operation of the inventory management system to maintain operability during sensor failure.

Abstract: Described is a system for counting stacked items using image analysis. In one implementation, an image of an inventory location with stacked items is obtained and processed to determine the number of items stacked at the inventory location. In some instances, the item closest to the camera that obtains the image may be the only item viewable in the image. Using image analysis, such as depth mapping or Histogram of Oriented Gradients (HOG) algorithms, the distance of the item from the camera and the shelf of the inventory location can be determined. Using this information, and known dimension information for the item, a count of the number of items stacked at an inventory location may be determined.

Abstract: Described is a system for counting stacked items using image analysis. In one implementation, an image of an inventory location with stacked items is obtained and processed to determine the number of items stacked at the inventory location. In some instances, the item closest to the camera that obtains the image may be the only item viewable in the image. Using image analysis, such as depth mapping or Histogram of Oriented Gradients (HOG) algorithms, the distance of the item from the camera and the shelf of the inventory location can be determined. Using this information, and known dimension information for the item, a count of the number of items stacked at an inventory location may be determined.

Abstract: Described is a multiple-camera system and process for determining an item involved in an event. For example, when a user picks an item or places an item at an inventory location, image information for the item may be obtained and processed to identify the item involved in the event and associate that item with the user.

Abstract: An item stowed at an inventory location may rest on a surface such as a shelf or may be supported above the surface. The item may exhibit a footprint that is representative of a physical perimeter of the item. For example, the footprint may be an edge of a shadow cast by the item. Information about a size and shape of a footprint associated with a particular item may be stored. An optical sensor array may acquire sensor image data indicative of the footprint of one or more of the items stored at an inventory location. A quantity of items at the inventory location may be determined by comparing the sensor image data with the stored data.

Abstract: Frames of sensor data may be obtained from many sensors arranged throughout a facility. These frames may be time synchronized to support further processing. For example, frames containing image data obtained at about the same time from many cameras within the facility may be used to create an aggregate or “stitched” view of the facility at that time. The synchronization may involve storing the frames from several sensors in buffers. A time window may be specified and used in conjunction with timestamps of the frames to select a set of sensor data from the buffers that are deemed to be synchronized data. The synchronized data may then be used for further processing.

Abstract: Described is a multiple-camera system for use in capturing images of users within a materials handling facility and processing those images to monitor the movement of users. For large materials handling facilities, a large number of cameras may be required to monitor the facility. Processing of the data generated from a large number of cameras becomes difficult. The implementations described herein include a hierarchy that allows image data from any number of cameras within a materials handling facility to be processed without substantially increasing the processing time needed or sacrificing processing capabilities.

Abstract: This disclosure describes an item drop location for placing items that have been picked from an inventory location within a material handling facility but have not yet been transitioned from the materials handling facility and a return location for returning items that have been transitioned from the materials handling facility. Likewise, described is a system and method for identifying an item placed at a drop location or an item placed at a return location, processing the placed item and providing confirmation to a user that placed the item and facilitating a return of the item or a removal of the item from an item identifier list associated with the user.

Abstract: This disclosure describes a system for assisting users in locating items from inventory locations and/or obtaining additional information about items. In some instances, a user may experience difficulty in locating an inventory item in a materials handling facility. By detecting one or more expressions presented by the user, an inventory management system may determine that assistance is to be provided to the user, determine and provide the appropriate assistance to the user.