Abstract: A self-service checkout terminal for vision-based checkout includes a computing device having a processor and a memory. A camera coupled to the computing device has a predefined field of view focused on a scan zone and provides a video output signal of the scan zone to the computing device. A checkout tray has a tactile surface formed from a predefined number of rows and a predefined number of columns of raised dot. The checkout tray is positioned within the scan zone. The processor processes the video output signal from the camera to attempt to identify an item placed on the checkout tray by a user during a transaction, provides a description of the item to the user via the user interface when the item is identified, and provides the user of an indication of a location of the item via a user interface when the item is not identified.

Abstract: Three-dimensional (3D) model images for menu item are maintained in a content delivery network (CDN) along with codes. The codes are printed/affixed to menus adjacent to the menu items. The menus include an anchor object that is sized in proportion to plates that serve the menu items. A user operates an augmented reality (AR)-enabled application (app) and uses a gesture to identify a code associated with a menu item from a menu. The code is decoded to contact the CDN and obtain the 3D model image corresponding to the menu item. The user centers a view-finder over the anchor object on the menu and the 3D model image is rendered on the anchor object in a scaled size and a scaled proportion for what will be provided to the user. The user may spin the 3D model to inspect proportions and ingredients of the menu item through the app.

Abstract: A depth image of items on a scale are captured. Depth information for the depth image is processed to produce a three-dimensional (3D) map of the depth information. The items are identified as blobs within the 3D map. A plane is generated and projected into the 3D map and each separate blob that intersects the plane is counted to determine an item quantity for the items depicted in the original depth image. The item quantity is provided back to a terminal for item quantity verification of the items during a checkout transaction at the terminal. In an embodiment, the plane is projected onto the 3D map and animated to move from a top of the 3D map to a bottom of the 3D map while the separate blobs are counted for the item quantity determination as the plane moves.

Abstract: An indoor location is mapped into a grid comprising grid cells, each cell associated with items or objects detected as being present in the corresponding cell. The grid, grid cells, and linked items and/or objects are generated and updated using an Augmented Reality (AR) algorithm that maps a physical environment into cells and measures distances and directions within the environment relative to each cell. Walking paths (routes) to the items within the indoor location are generated using the grid information. As a user walks a path, the user's position within the indoor location is mapped and tracked to the cells and the path revised based on the user's actual position. A user device provides video via an AR application to track the user's position; a rendering of the position and path are superimposed within the video being viewed by the user on the user-operated device.

Abstract: Items are identified from one or more catalogues and images of the items are obtained. A dynamically rendered Virtual Reality (VR) store is constructed from the images and from images of objects/structures associated with a store. The item images that populate the VR store can be customized to a given customer and/or a given store. A VR session is established with a customer within the VR store, the item images can be selected, examined, and purchased during the session by the customer as the customer navigates through the VR store. Specialized rooms during the VR session allow the customer to interact in real time with other customers shopping via other VR sessions. The customer and other customers are rendered as avatars within the specialized room. A designated avatar or automated chatbot provides automated and real time assistance to the customer during the VR session.

Abstract: At least one image of a produce item on a scale of a terminal is captured during a transaction at the terminal. A machine learning model provides a classification for the item based on the image. The classification indicates whether the item is bagged or unbagged. When the item is in a bag, a tare weight for the bag is subtracted from the weight recorded by the scale to calculate a price for the item. When the item is unbagged, the weight recorded by the scale is used to calculate the price. In an embodiment, the model provides a classification that indicates whether the item is organic or non-organic. When the item is organic, a transaction interface is automatically populated with an organic produce selection and presented to an operator of the terminal for confirmation.

Abstract: Objects associated with a self-checkout area are identified and tracked through transaction data comprised of transaction details, device statuses, transaction interrupts/events, and video feeds during transactions on Self-Service Terminals (SSTs). Selective objects and selective transaction data are correlated together in a group for each transaction. Actions required of an attendant who is managing the transactions are identified for each group. An Augmented Reality (AR) interface is provided on an attendant-operated device that visually and uniquely identifies the actions, each group requiring a given action, and each object of each group that is to be the subject of the given action. In an embodiment, remote verification, audit, and override actions are processed through gestures made by the attendant and detected by the AR interface.

Abstract: An indoor location is mapped into a grid comprising grid cells, each cell associated with items or objects detected as being present in the corresponding cell. The grid, grid cells, and linked items and/or objects are generated and updated using an Augmented Reality (AR) algorithm that maps a physical environment into cells and measures distances and directions within the environment relative to each cell. Walking paths (routes) to the items within the indoor location are generated using the grid information. As a user walks a path, the user's position within the indoor location is mapped and tracked to the cells and the path revised based on the user's actual position. A user device provides video via an AR application to track the user's position; a rendering of the position and path are superimposed within the video being viewed by the user on the user-operated device.

Abstract: A base transaction User Interface (UI) is provided that provides transaction processing for transactions at transaction terminals. The base UI can be customized through independent and decoupled customization/extension files, which provide specific UI customizations for UI screen content, UI screen styles, UI screen views, UI screen workflows, and UI screen resource functionality. Customizations or extensions are achieved without modifying the base UI. The customizations or extensions are dynamically obtained during execution of the base UI from the corresponding files and processed by the base UI as user-defined custom overrides.

Abstract: Self-Service Terminals (SSTs) are enhanced to invoke remote online retailers' transaction systems. Remote transaction interfaces for the systems are hosted by remote servers and rendered on the SSTs. The remote interfaces notify the SSTs when payment is needed to complete transactions on the SSTs. The SSTs activate the appropriate payment peripherals of the SSTs and provide card data for card payments or verifications for cash payments back to the remote interfaces. When cash payments are received, the SSTs send the corresponding amounts and retailer identifiers for the retailers to a cloud-based reconciliation server. In an embodiment, the SSTs are located in a store associated with a retailer that is different from retailers associated with the remote interfaces. In an embodiment, the SSTs are standalone SSTs located outdoors.

Abstract: A consumer links a cryptocurrency wallet to their loyalty account and creates a profile that includes a default fiat currency amount to add to transaction totals during transactions at a terminals. During a transaction, the wallet and profile are obtained using the loyalty account of a registered consumer. When the consumer selects an option to pay for their transaction, an overlaid screen is presented to the consumer on the display of the terminal requesting that the consumer confirm the fiat currency amount. When the consumer confirms, the transaction total for the transaction is rounded up by the fiat currency amount. A background workflow is automatically initiated after payment is confirmed on behalf of the user. The workflow uses the fiat currency amount to purchase and transfer an equivalent amount of cryptocurrency into the consumer's wallet over the blockchain.

Abstract: Items are identified from one or more catalogues and images of the items are obtained. A dynamically rendered Virtual Reality (VR) store is constructed from the images and from images of objects/structures associated with a store. The item images that populate the VR store can be customized to a given customer and/or a given store. A VR session is established with a customer within the VR store, the item images can be selected, examined, and purchased during the session by the customer as the customer navigates through the VR store. Specialized rooms during the VR session allow the customer to interact in real time with other customers shopping via other VR sessions. The customer and other customers are rendered as avatars within the specialized room. A designated avatar or automated chatbot provides automated and real time assistance to the customer during the VR session.

Abstract: A payment code is generated for a transaction. The payment code includes a substring of information that identifies the code as a payment token for a frictionless payment of the transaction. The substring of information includes a payment token identifier that identifies the payment code as being representative of a payment request. The substring of information, when captured in an image taken of a transaction area for the transaction or when scanned, causes the terminal to enter a payment state during which payment details are obtained from the payment code and a payment service is contacted with the payment details based on the payment type. The terminal processes a frictionless payment for the transaction through the payment service to complete the transaction.

Abstract: A donation workflow with donation screens is integrated into a transaction workflow of a transaction terminal. The donation workflow is independent and separate from the transaction workflow. When a customer enters a donation into a donation entry screen, an agent on the terminal provides the donation amount to a transaction manager of the terminal. The donation amount is added as a line item to the transaction total. After payment, the fiat currency associated with the donation amount is used to purchase an equivalent amount in cryptocurrency over a blockchain and held in a store wallet of a store. The equivalent amount in cryptocurrency is subsequently transferred over the blockchain from the store wallet to a charity's wallet associated with the charity that is to receive the donation amount from the customer.

Abstract: Real-time video is captured of a pickup area for orders at a store. The images are analyzed and tracked for unique orders being placed in the pickup area and orders being removed from the pickup area. A customer-operated device is operated by a customer to identify the store where the customer placed an order in a remote location from the pickup area. Images of the orders that are present within the pickup area and order identifying information for the orders are provided to the customer via the customer-operated device.

Abstract: An interface is rendered on a user-operated device. Selections are made with respect to a first set of options by the user operating the interface. A list of potential food dishes for further selection by the user is presented within the interface based on the selections. A food dish selection is received from the user through the interface. A recipe for the selected food dish is generated and presented within the interface based on the food dish selection and a list of ingredients needed for the recipe are generated as a shopping list for the user to obtain at a store. In an embodiment, a navigation route to obtain the ingredients within the store is provided to the user when the user is at the store, allowing the user to traverse the route within the store and obtain each of the ingredients.

Abstract: A user interface of a terminal is enhanced to provide a screen depicting suggested items for purchasing by a customer before completing a transaction at the terminal. The suggested items can include items likely to have been forgotten by the customer based on the current basket of items in the transaction and/or items that are otherwise related to the current basket of items. Any suggested item selected by the customer for adding to the transaction is communicated to a server. The server maintains a data structure for transactions that require items to be picked up and current statuses for item picking transactions. Store-operated devices allow in-store pickers to select items that need to be picked from the store for the transactions identified in the data structure. When a picker acquires the items from store shelves, the items are delivered to a designated area of the store and the customer retrieves the items from that area.

Abstract: A viewing height of a rendered transaction interface screen on a transaction display is controlled by or automatically adjusted for a customer performing a transaction at a transaction terminal. The display can physically be raised and lowered along a post to achieve a desired viewing height or only a portion of the viewable surface area for the display is occupied by a transaction interface screen for the transaction with the location of the portion controlled by or auto adjusted on behalf of the customer. In an embodiment, another portion of the viewable surface area not currently occupied by the transaction interface screen can be used to render additional information such as advertisements and the advertisement portions can be dynamically changed based on changes made to the location of the transaction interface screen.

Abstract: Cameras capture images of vehicles and customers in drive-through lanes of a store. The images are processed to identify a type of vehicle, if any, and determine whether a given customer is in a proper lane associated with cars or a proper lane associated with walkups or non cars. Customers in improper lanes are instructed to move to the proper lane to place an order. The images are further processed to generate a written description of the vehicle, if any, and a written description of the customer. The written description is linked to the customer's order and is accessible to store staff for verification when collecting payment for the order and when providing the ordered items to the customer.

Abstract: Various embodiments herein each include at least one of systems, methods, software, apps, and visualizations for floorspace management. In particular, some embodiments leverage mobile shopping and other technologies to identify when and where a customer selects items within a retail space and completes the purchase. This data is then stored and visualizations are generated from this data for areas and periods. Such embodiments enable identification of well-performing and under-performing areas of retail space based on criteria pertinent to the particular user.