Abstract: In one aspect, a retail store includes a multitude of cameras, including a plurality of 3D cameras, and a plurality of other cameras. Certain of the cameras provide imagery from which a shopper's track through the store is monitored, and certain of the cameras are positioned to detect removal of items from store shelves. The store also includes a computer system that provides a database of information about store layout, indicating stock locations of different items. The computer system receives imagery from the cameras (or information derived from such imagery) and uses this data, together with information from the database and information derived from other sensors in the store, to produce a probabilistic tally of items selected by a store shopper. This tally includes an item bearing a barcode, but is produced without reading the barcode. Each item on the tally is associated with a confidence score that meets a computer system-determined threshold.

Abstract: In accordance with one aspect of the technology, handwritten works (e.g., notes) produced using computer devices are encoded with digital information that is persistently bound with such works, even after conversion into analog form. In accordance with another aspect of the technology, strokes of artwork or handwriting, or glyphs of computer-rendered text, are encoded in a form that permits any alteration of such work to be detected. A variety of other features and arrangements are also detailed.

Abstract: A plastic item, such as a beverage bottle, can convey two distinct digital watermarks, encoded using two distinct signaling protocols. A first, printed label watermark conveys a retailing payload, including a Global Trade Item Number (GTIN) used by a point-of-sale scanner in a retail store to identify and price the item when presented for checkout. A second, plastic texture watermark may convey a recycling payload, including data identifying the composition of the plastic. The use of two different signaling protocols assures that a point-of-sale scanner will not spend its limited time and computational resources working to decode the recycling watermark, which may lack data needed for retail checkout. In some embodiments, a recycling apparatus makes advantageous use of both types of watermarks to identify the plastic composition of the item (e.g., relating GTIN to plastic type using an associated database), thereby increasing the fraction of items that are correctly identified for sorting and recycling.

Abstract: The parameters of an optical code are optimized to achieve improved signal robustness, reliability, capacity and/or visual quality. An optimization program can determine spatial density, dot distance, dot size and signal component priority to optimize robustness. An optical code generator employs these parameters to produce an optical code at the desired spatial density and robustness. The optical code is merged into a host image, such as imagery, text and graphics of a package or label, or it may be printed by itself, e.g., on an otherwise blank label or carton. A great number of other features and arrangements are also detailed.

Abstract: Two stages of a convolutional neural network are linked by an interconnect that effects a spatial transposition of array data. The spatial transposition can include rotation, scaling, or translation (e.g., in x- or y-directions). A parameter characterizing the transposition (e.g., a parameter identifying rotation angle) can be learned by the same training process that is also used to learn other network parameters, such as layer coefficients. Additionally, or alternatively, data input to a neural network comprises—for each pixel in a patch of imagery—plural data that each indicates a relationship between the value of the pixel, and the value of a neighboring pixel. Some such neural networks can be trained to indicate the presence of a digital watermark signal in the patch of imagery—or a parameter characterizing such a digital watermark signal. Other features and arrangements are also detailed.

Abstract: Watermarking is used to track and identify digital images. One claim includes acts of: processing obtained imagery to yield local image information, the local image information being inadequate to reveal a subject depicted in said obtained imagery, using the local image information, resolving geometric distortion of the imagery, the geometric distortion comprising scale and rotation, said resolving yielding geometrically resolved imagery, and detecting the encoded signal from the geometrically resolved imagery using secret detecting information. A great variety of other features and arrangements are also detailed.

Abstract: Images depicting items in a waste flow on a conveyor belt are provided to two analysis systems. The first system processes images to decode digital watermark payload data found on certain of the items (e.g., plastic containers). This payload data is used to look up corresponding attribute metadata for the items in a database, such as the type of plastic in each item, and whether the item was used as a food container or not. The second analysis system can be a spectroscopy system that determines the type of plastic in each item by its absorption characteristics. When the two systems conflict in identifying the plastic type, a sorting logic processor applies a rule set to arbitrate the conflict and determine which plastic type is most likely. The item is then sorted into one of several different bins depending on a combination of the final plastic identification, and whether the item was used as a food container or not. A variety of other features and arrangements are also detailed.

Abstract: Mobile phones and other portable devices are equipped with a variety of technologies by which existing functionality can be improved, and new functionality can be provided. Some aspects relate to visual search capabilities, and determining appropriate actions responsive to different image inputs. Others relate to processing of image data. Still others concern metadata generation, processing, and representation. Yet others concern user interface improvements. Other aspects relate to imaging architectures, in which a mobile phone's image sensor is one in a chain of stages that successively act on packetized instructions/data, to capture and later process imagery. Still other aspects relate to distribution of processing tasks between the mobile device and remote resources (“the cloud”). Elemental image processing (e.g., simple filtering and edge detection) can be performed on the mobile phone, while other operations can be referred out to remote service providers.

Abstract: In some arrangements, product packaging is digitally watermarked over most of its extent to facilitate high-throughput item identification at retail checkouts. Imagery captured by conventional or plenoptic cameras can be processed (e.g., by GPUs) to derive several different perspective-transformed views—further minimizing the need to manually reposition items for identification. Crinkles and other deformations in product packaging can be optically sensed, allowing such surfaces to be virtually flattened to aid identification. Piles of items can be 3D-modelled and virtually segmented into geometric primitives to aid identification, and to discover locations of obscured items. Other data (e.g., including data from sensors in aisles, shelves and carts, and gaze tracking for clues about visual saliency) can be used in assessing identification hypotheses about an item. Logos may be identified and used—or ignored—in product identification. A great variety of other features and arrangements are also detailed.

Abstract: In some arrangements, product packaging is digitally watermarked over most of its extent to facilitate high-throughput item identification at retail checkouts. Imagery captured by conventional or plenoptic cameras can be processed (e.g., by GPUs) to derive several different perspective-transformed views—further minimizing the need to manually reposition items for identification. Crinkles and other deformations in product packaging can be optically sensed, allowing such surfaces to be virtually flattened to aid identification. Piles of items can be 3D-modelled and virtually segmented into geometric primitives to aid identification, and to discover locations of obscured items. Other data (e.g., including data from sensors in aisles, shelves and carts, and gaze tracking for clues about visual saliency) can be used in assessing identification hypotheses about an item. Logos may be identified and used—or ignored—in product identification. A great variety of other features and arrangements are also detailed.

Abstract: The geometric pose of a patch of watermark data is estimated based on the position of a similar, but non-identical, patch of information within a data structure. The information in the data structure corresponds to a tiled array of calibration patterns that is sampled along at least three non-parallel paths. In a particular embodiment, the calibration patterns are sampled so that edges are globally-curved, yet locally-flat. Use of such information in the data structure enables enhanced pose estimation, e.g., speeding up operation, enabling pose estimation from smaller patches of watermark signals, and/or enabling pose estimation from weaker watermark signals. A great variety of other features and arrangements are also detailed.

Abstract: An object (e.g., a driver's license) is tested for authenticity using imagery captured by a consumer device (e.g., a mobile phone camera). Corresponding data is sent from the consumer device to a remote system, which has secret knowledge about features indicating object authenticity. The phone, or the remote system, discerns the pose of the object relative to the camera from the captured imagery. The remote system tests the received data for the authentication features, and issues an output signal indicating whether the object is authentic. This testing involves modeling the image data that would be captured by the consumer device from an authentic object—based on the object's discerned pose (and optionally based on information about the camera optics), and then comparing this modeled data with the data sent from the consumer device. A great variety of other features and arrangements are also detailed.

Abstract: A smart phone senses audio, imagery, and/or other stimulus from a user's environment, and acts autonomously to fulfill inferred or anticipated user desires. In one aspect, the detailed technology concerns phone-based cognition of a scene viewed by the phone's camera. The image processing tasks applied to the scene can be selected from among various alternatives by reference to resource costs, resource constraints, other stimulus information (e.g., audio), task substitutability, etc. The phone can apply more or less resources to an image processing task depending on how successfully the task is proceeding, or based on the user's apparent interest in the task. In some arrangements, data may be referred to the cloud for analysis, or for gleaning. Cognition, and identification of appropriate device response(s), can be aided by collateral information, such as context. A great number of other features and arrangements are also detailed.

Abstract: Arrangements involving portable devices (e.g., smartphones and tablet computers) are disclosed. One arrangement enables a content creator to select software with which that creator's content should be rendered—assuring continuity between artistic intention and delivery. Another utilizes a device camera to identify nearby subjects, and take actions based thereon. Others rely on near field chip (RFID) identification of objects, or on identification of audio streams (e.g., music, voice). Some technologies concern improvements to the user interfaces associated with such devices. For example, some arrangements enable discovery of both audio and visual content, without any user requirement to switch modes. Other technologies involve use of these devices in connection with shopping, text entry, and vision-based discovery. Still other improvements are architectural in nature, e.g., relating to evidence-based state machines, and blackboard systems. Yet other technologies concern computational photography.

Abstract: In some arrangements, product packaging is digitally watermarked over most of its extent to facilitate high-throughput item identification at retail checkouts. Imagery captured by conventional or plenoptic cameras can be processed (e.g., by GPUs) to derive several different perspective-transformed views—further minimizing the need to manually reposition items for identification. Crinkles and other deformations in product packaging can be optically sensed, allowing such surfaces to be virtually flattened to aid identification. Piles of items can be 3D-modelled and virtually segmented into geometric primitives to aid identification, and to discover locations of obscured items. Other data (e.g., including data from sensors in aisles, shelves and carts, and gaze tracking for clues about visual saliency) can be used in assessing identification hypotheses about an item. Logos may be identified and used—or ignored—in product identification. A great variety of other features and arrangements are also detailed.

Abstract: Methods and arrangements involving portable user devices such smartphones and wearable electronic devices are disclosed, as well as other devices and sensors distributed within an ambient environment. Some arrangements enable a user to perform an object recognition process in a computationally- and time-efficient manner. Other arrangements enable users and other entities to, either individually or cooperatively, register or enroll physical objects into one or more object registries on which an object recognition process can be performed. Still other arrangements enable users and other entities to, either individually or cooperatively, associate registered or enrolled objects with one or more items of metadata. A great variety of other features and arrangements are also detailed.

Abstract: An illustrative implementation of the technology includes three primary components: a desktop application, a mobile phone application, and connections to retailer inventory and pricing APIs (e.g., for Walmart and/or Best Buy). The experience begins with the consumer going to an online retailer's website (e.g., Amazon) to search for a product. The desktop application automatically searches for the same product using the APIs of Walmart and/or Best Buy. If matches and near-matches of the product are found, the product name, model, price, and local availability at affiliate locations are shown. With a mobile phone camera-scan of the product page, relevant information is transferred to the consumer's phone. From there, the consumer can interact with the options on the mobile phone to be directed to the nearby brick and mortar store of choice carrying that product at the price they want. Along the way, the retailer can present offers and additional product information directly to the consumer.

Abstract: A decade from now, a visit to the supermarket will be a very different experience than the familiar experiences of decades past. Product packaging will come alive with interactivity—each object a portal into a rich tapestry of experiences, with contributions authored by the product brand, by the store selling the product, and by other shoppers. The present technology concerns arrangements for authoring and delivering such experiences. A great variety of other features and technologies are also detailed.

Abstract: Mobile phones and other portable devices are equipped with a variety of technologies by which existing functionality can be improved, and new functionality can be provided. Some aspects relate to visual search capabilities, and determining appropriate actions responsive to different image inputs. Others relate to processing of image data. Still others concern metadata generation, processing, and representation. Yet others concern user interface improvements. Other aspects relate to imaging architectures, in which a mobile phone's image sensor is one in a chain of stages that successively act on packetized instructions/data, to capture and later process imagery. Still other aspects relate to distribution of processing tasks between the mobile device and remote resources (“the cloud”). Elemental image processing (e.g., simple filtering and edge detection) can be performed on the mobile phone, while other operations can be referred out to remote service providers.

Abstract: The parameters of an optical code are optimized to achieve improved signal robustness, reliability, capacity and/or visual quality. An optimization program can determine spatial density, dot distance, dot size and signal component priority to optimize robustness. An optical code generator employs these parameters to produce an optical code at the desired spatial density and robustness. The optical code is merged into a host image, such as imagery, text and graphics of a package or label, or it may be printed by itself, e.g., on an otherwise blank label or carton. A great number of other features and arrangements are also detailed.