Abstract: An application program installed in a hand held computing device such as a tablet computer presents a graphical user interface (GUI) on a touch screen display and receives touch input signals from the touch screen display. When an unintentional touch event is detected, the application switches from an active mode to a configuration mode. In the configuration mode, graphical tools are displayed on the touch screen display to enable a user to define or adjust the active zone of the touch screen display so as to exclude the area of the touch screen display touched by the hand that is grasping the hand held device. Interactive elements in the GUI are then rearranged so that the interactive elements are within the newly defined active zone.

Abstract: A user is enabled to use a mobile device to electronically acknowledge information relating to a sign encountered by the user within the user's environment. The mobile device detects a signal transmitted by an electronic source placed on or near the sign and register with a remote server. The registration may include an identifier of the electronic source and an identifier of the mobile device. In response to the registration, the mobile device receives content associated with the electronic source, and displays that content in a notification on a display of the mobile device. The user may then acknowledge the notification via a prompt on the display. The mobile device receives input from the user acknowledging the notification, and sends an acknowledgement message to the remote server.

Abstract: A user is enabled to use a mobile device to electronically acknowledge information relating to a sign encountered by the user within the user's environment. The mobile device detects a signal transmitted by an electronic source placed on or near the sign and register with a remote server. The registration may include an identifier of the electronic source and an identifier of the mobile device. In response to the registration, the mobile device receives content associated with the electronic source, and displays that content in a notification on a display of the mobile device. The user may then acknowledge the notification via a prompt on the display. The mobile device receives input from the user acknowledging the notification, and sends an acknowledgement message to the remote server.

Abstract: A computing device is communicatively coupled to an optical scanner and redeems coupons by receiving data produced by an optical scan of a product code associated with a coupon. The product code encodes a primary processing action to be performed by the computing device when processing the coupon and a modifier identifying a remote storage location. The remote storage location stores instructions defining a secondary processing action to be performed by the computing device when processing the coupon. The computing device detects a predetermined trigger event associated with processing the coupon, and in response, retrieves the instructions defining the secondary processing action from the remote storage location. The computing device executes the instructions to redeem the coupon according to the secondary processing action.

Abstract: POS apparatus, control method, and system thereof for outputting receipt image for a camera of a personal computing device. According to an aspect, a POS apparatus includes a computing device including a CPU and a memory, where the computing device is configured to execute a commodity registration process and a settlement processing, and a receipt image output device coupled to the computing device is configured to output a receipt image for camera image capture.

Abstract: Systems, methods, and computer program products to perform an operation comprising: calculating a first duration of time of a first interaction between a first person and an object, detecting a second interaction between the first person and a second person based on at least one of: a proximity between the first person and the second person, the proximity being detected by a proximity detection module, and a second duration of time during which the first person and the second person remain in the proximity, and upon determining that the first person has purchased the object: computing, by operation of one or more processors, an award to apply to the second person; wherein the processors compute the award on the basis of one or more rules that take as inputs the first interaction and the second interaction.

Abstract: A mobile device is configured to use metadata describing attributes of a packaged product to help the customer or sales associate locate the packaged product stored in inventory. The metadata may, for example, describe the size of the package, color of the package, product number, or placement of text and/or graphics on the package. In one embodiment, the user can use an image capture device on the mobile device to scan and capture images of packaged products stored in inventory. The mobile device uses the metadata to process the digital image and to detect the desired product in the captured image. The mobile device can output a modified image to a display that visually indicates the package product to the display of the mobile device. For example, the mobile device may highlight the packaged product in a digital image or add an icon to the digital image to indicate the packaged product.

Abstract: A method, computer program product, and system for providing a security check of items being purchased by a consumer. A digital image of items for purchase arranged on a scale is captured. An estimated total weight and a cumulative center of mass of the items are estimated. An actual total weight and cumulative center of mass of the items are measured using the scale. If the estimated total weight of the items differs from the actual total weight by more than a first threshold amount and/or if the estimated cumulative center of mass of the items differs from the measured cumulative center of mass by more than a second threshold amount, an alert can be output. The alert can include an instruction for the customer or a store employee to rearrange the items on the scale to attempt to resolve the discrepancy.

Abstract: Method, computer program product, and system of providing rewards to a person based on item interactions during a transaction in an environment, where the person is associated with a personal profile. The method includes generating, based on information in the personal profile, one or more tasks for the person to complete during the transaction, each task including at least one item interaction. The method further includes presenting, using an output device within the environment, the one or more tasks to the person, analyzing image information acquired by one or more visual sensors within the environment to evaluate the person's performance of the one or more tasks, and awarding, based on the evaluation, an amount of rewards to the person.

Abstract: Method, computer program product, and system to provide an extended vision within an environment having a plurality of items, where the extended vision is based on a field of view of a person determined using a first visual sensor, and is further based on at least a second visual sensor disposed within the environment. Image information from the first and second visual sensors is associated to produce combined image information. Selected portions of the combined image information are displayed based on input provided through a user interface.

Abstract: Method, computer program product, and system of visual identification of an item selected by a person during a transaction within an environment having a plurality of items. The method includes acquiring, using a visual sensor disposed within the environment, image information that includes at least a portion of the selected item, and analyzing the image information to determine a set of possible items for classifying the selected item. The method further includes selecting, based on personal profile information associated with the person, one of the set of possible items to thereby identify the selected item.

Abstract: Methods, computer program products, and systems for operating a retail environment using unmanned vehicles are provided. The methods include observing a person interacting with one or more items with a camera carried by an unmanned vehicle, identifying the one or more items based on data received from the unmanned vehicle, and adding each identified item to a transaction for the person. The methods can further include charging the person for the transaction, presenting promotions, retrieving a desired item, answering questions, following a person, guiding a customer to a location, and showing images of inventory items.

Abstract: Method, computer program product, and system to influence a person within an environment having a plurality of items for selection. The method includes capturing, using a first visual sensor disposed within the environment, field of view information for the person, performing analysis on the field of view information using a computing device, and identifying, based on the analysis, one or more first items of the plurality of items that are included within the field of view of the person. The method further includes selecting, based on the identified one or more items, at least one second item of the plurality of items for presentation to the person; and presenting information related to the at least one second item to the person.

Abstract: Method, computer program product, and system to provide assistance to at least a first person during a transaction within an environment having a plurality of items. The method includes identifying the first person within the environment, and analyzing acquired image information to determine at least one item interaction of the transaction and thereby associate the identified first person with the transaction. The method further includes determining whether the first person is associated with a personal profile that includes information related to the environment, the information including at least one of personal preferences and personal historical data reflecting one or more previous transactions of the first person. When the first person is determined to be associated with a personal profile, the method further includes determining, based on the information in the personal profile, an amount of assistance to provide to the first person during the transaction.

Abstract: Method, computer program product, and system to trigger one or more events during an interaction of a person with an item and within an environment having a plurality of items. The method includes acquiring, using a first visual sensor disposed within the environment, image information including the item and identifying the item using the image information. The method further includes acquiring, using a second visual sensor disposed within the environment, behavior information for the person relative to the identified item, analyzing the behavior information to identify at least a first behavior of the person, and classifying the first behavior into one of a number of predefined behavior types. The method further includes performing, based on the identified item and the classified first behavior, one or more predefined events.

Abstract: Method, computer program product, and system to facilitate an audit of a checkout transaction, where the checkout transaction is associated with a virtual transaction record reflecting interactions of a person with a first set of one or more items of a plurality of items within an environment. The method includes acquiring image information including a shopping receptacle associated with the checkout transaction, and identifying a second set of one or more items of the plurality of items that are included in the shopping receptacle using the acquired image information. The method further includes comparing the first and second sets of items, and determining, based on the comparison, whether to perform an audit of the checkout transaction.

Abstract: A method, computer program product, and system to identify one or more items in a transaction are provided. The method includes capturing images of the items, determining a set of possible identifications for each item based on the images, determining information regarding the transaction, selecting an identification for each item from the sets of possible identifications, based on the determined information, and adding the selected identifications to the transaction. Identifications for items may be selected based on confidence factors, price thresholds, and customer information.

Abstract: A method, computer program product, and system to perform a sale transaction are provided. The method includes identifying each item of a plurality of items, based on at least one image of the plurality of items, determining a cost for each item, optionally identifying a person based on an image of the person, adding each of the items and each of the costs to a sale transaction, and charging the person for the sale transaction.

Abstract: Method, computer program product, and system to influence a person within an environment having a plurality of items for selection. The method includes determining, using a first visual sensor disposed within the environment, field of view (FOV) information for the person, and analyzing the FOV information to identify one or more first items within the FOV of the person. The method further includes determining, using a second visual sensor disposed within the environment, behavior information for the person and analyzing the behavior information to classify a behavior of the person into one of a number of predefined behavior types. The method further includes selecting, based on the identified one or more first items and the classified behavior, at least a second item for presentation to the person, and presenting information related to the second item to the person.

Abstract: Method, computer program product, and system of visual identification of an item selected by a person during a transaction within an environment having a plurality of items. The method includes acquiring, using a visual sensor disposed within the environment, image information that includes at least a portion of the selected item, and analyzing the image information to determine a set of possible items for classifying the selected item. The method further includes selecting, based on personal profile information associated with the person, one of the set of possible items to thereby identify the selected item.