Abstract: This disclosure describes a system for disambiguating between multiple potential users that may have performed an item action (e.g., item removal or item placement) at an inventory location. For example, if there are three picking agents (users) standing near an inventory location and one of the agents removes an item (item action) from the inventory location, the example systems and processes described herein may utilize various inputs to disambiguate between the users and determine which of the potential users performed the item action.

Abstract: Users in a facility may move about and their authentication status may change accordingly. For example, upon entering a facility, a user may present identification data. At that point, the user is considered an authenticated user with persistent profile data. However, the identification of a user may not be presented at entry or may be unreliable, which causes the user to be considered an unauthenticated user with temporary profile data. In other scenarios, the identification of authenticated users may become unreliable based on their location or their proximity to other users. In cases where users are crowded at a location, the profile data for such users may be aggregated and may be based on common settings of the set of possible users in the group. A user interface may be presented to a user based on their designated profile data.

Abstract: Described is a multiple-camera system and process for determining an item involved in an event. For example, when a user picks an item or places an item at an inventory location, image information for the item may be obtained and processed to identify the item involved in the event and associate that item with the user.

Abstract: Described is a system and method for collecting item and user information and utilizing that information to determine materials handling facility patterns, item trends and inventory location trends. User monitoring data for users located in a materials handling facility may include information identifying inventory locations approached by users, gaze directions of users, user dwell times, an identification of items picked by users, an identification of items placed by users, and/or in-transit times for items. This information may be aggregated and processed to determine materials handling facility patterns, item trends and/or inventory location trends.

Abstract: Described is a multiple-camera system and process for re-identifying a user located in a materials handling facility based on user patterns and/or descriptors representative of the user. In one implementation, a user pattern and/or a plurality of descriptors representative of a user are maintained as a position of a user is tracked through a materials handling facility. If the tracking of the user is lost, the last known position is stored with the user pattern and/or descriptors. If a new object is detected and confirmed to be a user, a user pattern and/or descriptors of the new object are compared with the stored user pattern and/or descriptors to determine if the new object is the user.

Abstract: This disclosure describes a system for disambiguating between multiple potential users that may have performed an item action (e.g., item removal or item placement) at an inventory location. For example, if there are three picking agents (users) standing near an inventory location and one of the agents removes an item (item action) from the inventory location, the example systems and processes described herein may utilize various inputs to disambiguate between the users and determine which of the potential users performed the item action.

Abstract: Described are systems and techniques configured to authenticate a user upon entry to a facility. Prior to entry, the user may log in to a secure website with valid credentials, whereupon a login image of the user at the time of login is acquired. In one implementation, optically encoded data is generated which includes data representative of the login image, an acquisition timestamp, and an identifier value. At entry of the user to the facility, an entry image of the user's face, an image of the optically encoded data as presented on a display of a computing device in possession of the user, and an entry timestamp are acquired. By determining the timestamp is within a valid range of time and the data representative of the login image corresponds to the entry image, the user is authenticated to the identifier value.

Abstract: Described is a multiple-camera system and process for determining an item involved in an event. For example, when a user picks an item or places an item at an inventory location, image information for the item may be obtained and processed to identify the item involved in the event and associate that item with the user.

Abstract: Markers may be presented on different objects in a facility, such as shelves or totes. A marker can use color, placement of elements, blending effects, or infrared light layers to encode data about the object. During operation, a camera within the facility may acquire an image, which includes an image of the marker as presented on the object. The marker can be analyzed to detect marker data encoded therein. By decoding the marker data, details about the marker can be extracted, such as an identification of the object. In addition, using details about the marker location within the image and location data associated with the camera, a location of the object relative to the camera can be determined, as well as an orientation of the object relative to the camera. As the object moves within the facility, the object can be tracked based on this location and orientation data.

Abstract: Described are systems and techniques configured to provide a user interface for an unauthenticated user of a materials handling facility. A transient profile indicative of one or more user preferences may be created and associated with the unauthenticated user. As the unauthenticated user interacts with the facility, preferences may be determined and included in the transient profile. Subsequent operation of the facility may take into account the transient profile. As the unauthenticated user moves throughout the facility, the transient profile may “follow” them, providing an ongoing user experience. Should the unauthenticated user later be authenticated, the transient preferences may be incorporated into a persistent profile.

Abstract: This disclosure describes a system for disambiguating between multiple potential users that may have performed an item action (e.g., item removal or item placement) at an inventory location. For example, if there are three picking agents (users) standing near an inventory location and one of the agents removes an item (item action) from the inventory location, the example systems and processes described herein may utilize various inputs to disambiguate between the users and determine which of the potential users performed the item action.

Abstract: This disclosure describes a system for assisting users in locating items from inventory locations and/or obtaining additional information about items. In some instances, a user may experience difficulty in locating an inventory item in a materials handling facility. By detecting one or more expressions presented by the user, an inventory management system may determine that assistance is to be provided to the user, determine and provide the appropriate assistance to the user.

Abstract: Described is a multiple-camera system and process for detecting a user within a materials handling facility and tracking a position of the user as the user moves through the materials handling facility. In one implementation, a plurality of depth sensing cameras are positioned above a surface of the materials handling facility and oriented to obtain a top-down view of the surface of the materials handling facility, along with any objects (e.g., users) on the surface of the materials handling facility. The depth information from the cameras may be utilized to detect objects on the surface of the materials handling facility, track a movement of those objects and determine if those objects are users.

Abstract: Described is a multiple-camera system and process for determining an item involved in an event. For example, when a user picks an item or places an item at an inventory location, image information for the item may be obtained and processed to identify the item involved in the event and associate that item with the user.

Abstract: Access to items stored within an inventory location of a facility may be controlled using physical access control mechanisms. A user within a facility is detected by sensors, such as imaging sensors. Context data for the user is generated based on the sensor data. The context data includes permission data indicative of portions of the inventory location that are accessible or inaccessible to the user. In addition, a predicted path of the user may also be determined based on historical data of the user or other users of the facility. Using the permission data and the predicted path of the user, configuration data may be generated to specify the level of access control to be applied to the different portions of the inventory location. The configuration data is sent to access control mechanisms of the inventory location to prevent or allow access to such portions of the inventory location.

Abstract: Machine-readable optical markers may be presented on a surface of a shelf, on a display device, or on a structure. Markers are presented as an array of graphical elements arranged in rows and columns. The graphical elements in the array of the mark utilize color and placement to encode marker data. In addition, a source image graphic may also be blended with a portion of the graphical elements in the array to create a blended image. In other embodiments, the marker may be presented with one or more borders surrounding the perimeter of the graphical elements in the array. The marker data may be presented using infrared light with a visible light layer presented over the array of graphical elements.

Abstract: Described is a multiple-camera system and process for re-identifying a user located in a materials handling facility based on user patterns and/or descriptors representative of the user. In one implementation, a user pattern and/or a plurality of descriptors representative of a user are maintained as a position of a user is tracked through a materials handling facility. If the tracking of the user is lost, the last known position is stored with the user pattern and/or descriptors. If a new object is detected and confirmed to be a user, a user pattern and/or descriptors of the new object are compared with the stored user pattern and/or descriptors to determine if the new object is the user.

Abstract: This disclosure describes a system for identifying users and/or their companions, utilizing the behavior and gestures of a user's companion to assist the user, and developing user paths based on user and/or companion preferences. A companion profile may be established to identify the companion and associated the companion with the user. Likewise, a user pattern that includes both the user and the companion may be established and used to track the location of the user and/or companion while in the materials handling facility.

Abstract: Described is a multiple-camera system and process for re-identifying a user located in a materials handling facility based on user patterns and/or descriptors representative of the user. In one implementation, a user pattern and/or a plurality of descriptors representative of a user are maintained as a position of a user is tracked through a materials handling facility. If the tracking of the user is lost, the last known position is stored with the user pattern and/or descriptors. If a new object is detected and confirmed to be a user, a user pattern and/or descriptors of the new object are compared with the stored user pattern and/or descriptors to determine if the new object is the user.

Abstract: This disclosure describes a system for disambiguating between multiple potential users that may have performed an item action (e.g., item removal or item placement) at an inventory location. For example, if there are three picking agents (users) standing near an inventory location and one of the agents removes an item (item action) from the inventory location, the example systems and processes described herein may utilize various inputs to disambiguate between the users and determine which of the potential users performed the item action.