Abstract: Content objects are associated with metadata via content identifiers that are derived from sensed signals captured by requesting mobile devices. In response to a content based query from a mobile device, content fingerprints and extracted digital codes decoded from the sensed signals are issued to a network based router system. This system determines identification priority, metadata responses associated with different forms of identification, and priority of metadata responses to the query.

Abstract: In one particular aspect, a portable computing device (e.g., a tablet or smartphone) senses audio and/or image content from a user's environment, and initiates one or more recognition agents (e.g., performing image watermark recognition, image recognition, object recognition, facial recognition, barcode recognition, optical character recognition, audio watermark recognition, speech recognition, speaker recognition, or music recognition). Resource allocation to a recognition agent can be varied based on (a) progress of the recognition agent to achieve its recognition goal, and (b) user interest data indicating user interest in the output of the recognition agent. A second candidate recognition agent can be evaluated for possible launch, based on a relevance score, and a cost score. In some embodiments, the device adapts its operation to changing context, by terminating a first recognition agent in favor of a second recognition agent, without express user instruction to do so.

Abstract: A user with a cell phone interacts, in a personalized session, with an electronic sign system. In some embodiments, the user's location relative to the sign is discerned from camera imagery—either imagery captured by the cell phone (i.e., of the sign), or captured by the sign system (i.e., of the user). Demographic information about the user can be estimated from imagery captured acquired by the sign system, or can be accessed from stored profile data associated with the user. The sign system can transmit payoffs (e.g., digital coupons or other response data) to viewers—customized per user demographics. In some arrangements, the payoff data is represented by digital watermark data encoded in the signage content. The encoding can take into account the user's location relative to the sign—allowing geometrical targeting of different payoffs to differently-located viewers. Other embodiments allow a user to engage an electronic sign system for interactive game play, using the cell phone as a controller.

Abstract: Digital watermark encoding—and associated registry transactions—are made transparent to consumers—performed as built-in features of common image processing operations, such as taking a picture, or printing a picture. In one arrangement, a user particularly defines network experiences that a hardcopy image is to invoke. The user may interact with buttons and other controls of a graphical user interface on the touchscreen of a printer to author specific experiences that should be triggered by a hardcopy image—such as launching a related video, playing a recorded audio clip, displaying other images in a story narrative to which the hardcopy image relates, etc. These choices can be made at the time of printing, or the printer can be used as an interface to establish or adjust such network experiences after printing. The printer then attends to interactions with network infrastructure components needed to give the hardcopy print the user-desired functionality.

Abstract: In some arrangements, product packaging is digitally watermarked over most of its extent to facilitate high-throughput item identification at retail checkouts. Imagery captured by conventional or plenoptic cameras can be processed (e.g., by GPUs) to derive several different perspective-transformed views—further minimizing the need to manually reposition items for identification. Crinkles and other deformations in product packaging can be optically sensed, allowing such surfaces to be virtually flattened to aid identification. Piles of items can be 3D-modelled and virtually segmented into geometric primitives to aid identification, and to discover locations of obscured items. Other data (e.g., including data from sensors in aisles, shelves and carts, and gaze tracking for clues about visual saliency) can be used in assessing identification hypotheses about an item. A great variety of other features and arrangements are also detailed.

Abstract: This patent document relates generally to encoded information and digital watermarking. One claim recites an image capture device comprising: an optical system; an image sensor on a substrate for capturing imagery provided by the optical system, in which captured imagery includes encoded information, and in which the captured imagery comprises first color information, second color information and third color information; means for compressing the captured imagery captured by said image sensor; means for detecting the encoded information from the captured imagery, in which said detecting utilizes different color information weightings so that at least the first color information and the third color information are weighted differently than one another for detection of the encoded information; and means for providing the encoded information for output or display, once the encoded information is detected. Of course, other claims and combinations are provided as well.

Abstract: This patent document relates generally to steganography and digital watermarking. One claim recites an apparatus comprising: electronic memory for buffering samples corresponding to a digital image; means for analyzing a digital image relative to an expected workflow process, the expected workflow process comprising optical capture of a printed version of the digital image, the digital image comprising data representing process colors CMY; means for applying tone correction to the digital image, said means for applying yielding an altered digital image; means for transforming the altered digital image with digital watermarking, the digital watermarking conveying a plural-bit message; and a processor configured for providing the transformed, altered digital image. Of course, other claims and combinations are provided too.

Abstract: Reference imagery of dermatological conditions is compiled in a crowd-sourced database (contributed by clinicians and/or the lay public), together with associated diagnosis information. A user later submits a query image to the system (e.g., captured with a smartphone). Image-based derivatives for the query image are determined (e.g., color histograms, FFT-based metrics, etc.), and are compared against similar derivatives computed from the reference imagery. This comparison identifies diseases that are not consistent with the query image, and such information is reported to the user. Depending on the size of the database, and the specificity of the data, 90% or more of candidate conditions may be effectively ruled-out, possibly sparing the user from expensive and painful biopsy procedures, and granting some peace of mind (e.g., knowledge that an emerging pattern of small lesions on a forearm is probably not caused by shingles, bedbugs, malaria or AIDS).

Abstract: Methods and systems permit a user to decide what different responses are triggered when different visual stimuli are presented to the user's wireless communications device.

Abstract: Arrangements involving portable devices (e.g., smartphones and tablet computers) are disclosed. One arrangement enables a content creator to select software with which that creator's content should be rendered—assuring continuity between artistic intention and delivery. Another utilizes a device camera to identify nearby subjects, and take actions based thereon. Others rely on near field chip (RFID) identification of objects, or on identification of audio streams (e.g., music, voice). Some technologies concern improvements to the user interfaces associated with such devices. Others involve use of these devices in connection with shopping, text entry, sign language interpretation, and vision-based discovery. Still other improvements are architectural in nature, e.g., relating to evidence-based state machines, and blackboard systems. Yet other technologies concern use of linked data in portable devices—some of which exploit GPU capabilities. Still other technologies concern computational photography.

Abstract: The present disclosure relates generally to mobile devices and content recognition. One claim recites a mobile device comprising: a sensor; a display screen; memory storing instructions for execution by a processor; and one or more processors programmed with said instructions for: obtaining information from the sensor; selecting a user profile from among a plurality of different user profiles based on the information; and selecting—based on a selected user profile—an image or graphic for display on the display screen, the image or graphic being associated with the selected user profile. Other claims and combinations are provided as well.

Abstract: In one arrangement, a first device presents a display that is based on context data, derived from one or more of its sensors. This display is imaged by a camera in a second device. The second device uses context data from its own sensors to assess the information in the captured imagery, and makes a determination about the first device. In another arrangement, social network friend requests are automatically issued, or accepted, based on contextual similarity. In yet another arrangement, delivery of a message is triggered by a contextual circumstance other than (or in addition to) location. In still another arrangement, two or more devices automatically establish an ad hoc network (e.g., Bluetooth pairing) based on contextual parallels. In still another arrangement, historical context information is archived and used in transactions with other devices, e.g., in challenge-response authentication. A great number of other features and arrangements—many involving head-mounted displays—are also detailed.

Abstract: The present technology concerns cell phones and similar devices, and their use in conjunction with media content (electronic and physical) and other systems (e.g., televisions, digital video recorders, and electronic program directories). Some aspects of the technology particularly concern “second screen” applications that sense a television program being watched by a user, and present menus of complementary content on the phone touchscreen from which the user can select. This complementary content can include other video content, associated web pages, opportunities to buy merchandise related to the program, etc. This complementary content can be identified by a provider of the television program, or can be identified otherwise (e.g., by crowd-sourcing). In some embodiments, the phone instructs a remote DVR to record content of interest for later viewing. The technology also provides features for making TV watching a social experience—involving remote friends.

Abstract: A user with a cell phone interacts, in a personalized session, with an electronic sign system. In some embodiments, the user's location relative to the sign is discerned from camera imagery—either imagery captured by the cell phone (i.e., of the sign), or captured by the sign system (i.e., of the user). Demographic information about the user can be estimated from imagery captured acquired by the sign system, or can be accessed from stored profile data associated with the user. The sign system can transmit payoffs (e.g., digital coupons or other response data) to viewers—customized per user demographics. In some arrangements, the payoff data is represented by digital watermark data encoded in the signage content. The encoding can take into account the user's location relative to the sign—allowing geometrical targeting of different payoffs to differently-located viewers. Other embodiments allow a user to engage an electronic sign system for interactive game play, using the cell phone as a controller.

Abstract: A smart phone senses audio, imagery, and/or other stimulus from a user's environment, and acts autonomously to fulfill inferred or anticipated user desires. In one aspect, the detailed technology concerns phone-based cognition of a scene viewed by the phone's camera. The image processing tasks applied to the scene can be selected from among various alternatives by reference to resource costs, resource constraints, other stimulus information (e.g., audio), task substitutability, etc. The phone can apply more or less resources to an image processing task depending on how successfully the task is proceeding, or based on the user's apparent interest in the task. In some arrangements, data may be referred to the cloud for analysis, or for gleaning. Cognition, and identification of appropriate device response(s), can be aided by collateral information, such as context. A great number of other features and arrangements are also detailed.

Abstract: The present disclosure relates to signal processing such as digital watermarking and data hiding. A sparse or dense digital watermark signal can be conveyed with a narrow-band absorption material corresponding to a center wavelength of a Point of Sale (POS) barcode scanner. The POS barcode scanner typically captures 2D imagery. Since the narrow-band absorption material absorbs over a narrow-band it is relatively imperceptible to the Human Visual System (HVS) but can be seen by the POS scanner.

Abstract: Wireless beacons, such as short range Bluetooth beacons, are combined with other technologies—including audio and image recognition technologies (e.g., fingerprint- or digital watermark-based)—to provide a variety of enhanced capabilities and services.

Abstract: Audio sounds are captured from a subject's body, e.g., using a smartphone or a worn array of microphones. Plural features are derived from the captured audio, and serve as fingerprint information. One such feature may be a time interval over which a threshold part of spectral energy in the audio is expressed. Another may be a frequency bandwidth within which a second threshold part of the spectral energy is expressed. Such fingerprint information is provided to a knowledge base that contains reference fingerprint data and associated metadata. The knowledge base matches the fingerprint with reference fingerprint data, and provides associated metadata in return—which can comprise diagnostic information related to the captured sounds. In some arrangements, an audio signal or pressure waveform stimulates the body at one location, and is sensed at another, to discern information about the intervening transmission medium. A great variety of other features and arrangements are also detailed.

Abstract: In one aspect, assembly of multi-part food packaging is checked by reference to payloads of steganographically-encoded digital watermarks printed across plural components of the packaging. Marking all surfaces of the packaging components allows arbitrary orientation of feed stock in assembly equipment, and wide latitude in placement of inspection cameras along the packaging line. In another aspect, a scanner at a retail checkout station is alert to any gap detected in steganographic encoding on retail product packaging and, if found, alerts an operator to possible presence of an adhesive label with a misleading barcode. A great variety of others features and arrangements are also detailed.

Abstract: Supplemental network services are synchronized with a program using the program's audio signal. A synchronization method employs local caching of portions of a fingerprint database to manage network services for identifying which programs a user's mobile device is exposed to and the timing of events within the program. The system enables background recognition and synchronization of network services in a way that consumes less device power and bandwidth.