Abstract: A system for tagging an image comprises a processor and a memory. The processor is configured to analyze an image associated with an image query using one or more computer vision analysis types to determine zero or more computer vision matches. Each computer vision match has one or more associated computer vision tags. In the event that it is determined that there are zero computer vision matches, the processor is further configured to analyze the image associated with the image query using a human vision analysis system to determine zero or more human vision matches. Each human vision match has one or more associated human vision tags. A memory coupled to the processor and configured to provide the processor with instructions.

Abstract: Respective models of visual weight in images are determined. An image query is generated from a determined visual weight distribution. At least one of the images is retrieved from a database based on comparisons of the image query with respective ones of the visual weight models.

Abstract: Processing and analyzing hyper-spectral image data and information via dynamic database updating. (a) processing/analyzing representations of objects within a sub set of the hyper spectral image data and information, using a first reference database of hyper spectral image data, information, and parameters, and, a second reference database of biological, chemical, or/and physical data, information, and parameters. Identifying objects of non-interest, and objects of potential interest, from the data/information sub-set. (b) processing/analyzing identified objects of potential interest, by further using first and second reference databases. Determining absence or presence of objects of interest, additional objects of non-interest, and non-classifiable objects of potential interest, from the data/information sub set. (c) updating first and second reference databases, using results of (a) and (b), for forming updated first and second reference databases.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for clustering images. In one aspect a system includes one or more computers configured to, for each of a plurality of digital images, associate extrinsic image-related information with each individual image, the extrinsic image-related information including text information and co-click data for the individual image, assign images from the plurality of images to one or more of the clusters of images based on the extrinsic information associated with each of the plurality of images, receive in the search system a user query from a user device, identify by operation of the search system one or more clusters of images that match the query, and provide one or more cluster results, where each cluster result provides information about an identified cluster.

Abstract: Despite intense research activities in the field of computer-aided diagnosis methods of computer vision, automated classification or comparable algorithmic solutions are not regularly used and even less regularly trusted by physicians. According to an exemplary embodiment of the present invention, a confidence interval of the performed diagnosis is visualized and a standardized feedback mechanism is provided which allows for an interactive improvement of the method.

Abstract: Techniques for indexing multimedia data simultaneous with its capture to convert a real world event into an accessible database in real time are provided. The present invention introduces a new paradigm of converting a real world event in real time into a rich multimedia database by processing data from multiple cameras observing the event. Real time analysis of the camera data, coupled with domain knowledge, results in instant indexing of multimedia data at capture time itself. This yields the semantic information to answer complex queries about the content, and the ability to extract portions of data that correspond to complex actions performed in the real world.

Abstract: Methods and apparatus to generate templates from web images for searching an image database are described. In one embodiment, one or more retrieved images (e.g., from the Web) may be used to generate one or more templates. The templates may be used to search an image database based on features commonly shared between sub-images of the retrieved images. Other embodiments are also described.

Abstract: Techniques described herein enable searching for multimedia content and for downloading or scheduling the recording of the multimedia content. The multimedia content may have been previously stored on one or more databases. The client device may download or schedule the recording of multimedia content in one step, for example, in one touch. When desired multimedia content is not available, the multimedia content is added to the client device's wish list. When the client device's does not have a wish list, the client device's wish list may be created on the spot. During the scheduling of the recording, a tag associated with the multimedia content is checked to determine whether the multimedia content is live or delayed. When the tag indicates the multimedia content is live or delayed, the client device prompts with a suggestion to add extra time to the end of the recording of the multimedia content.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for adjusting confidence scores of image labels for images. In one aspect, a method includes accessing images stored in an image data store, the images being associated with respective sets of labels, the labels describing content depicted in the image and having a respective confidence score that is a measure of confidence that the label accurately describes the content depicted in the image; selecting a first image from the images and determining for each of the other images and independent of the labels, a proximity score that is a measure of a relatedness of the other image to the first image; and adjusting the set of labels associated with the first image based on the respective proximity scores of the other images and the confidence scores of the labels of the other images.

Abstract: A system and method for transacting retrieval of inventory data, such as real estate property listing(s), over an information network and dynamically transmitting the listing(s), in near or real time, to one or more subwindows of a web browser window. The listings contain customized rendering instructions that are encoded into an inventory data string and sent to an ad server that renders the listings in the subwindow according to the customized rendering instructions.

Abstract: In accordance with an example embodiment of the invention, an apparatus comprising a processor configured to receive information related to a media object, and automatically select at least one supplemental media object based at least in part on a competency of a user related to the media object is disclosed.

Abstract: Described herein is an image-based system for retrieving information about a deceased person or animal and an image-based method of retrieving information about a deceased person or animal. The systems disclosed herein are characterized by the absence of a visible identifier indicating the availability of the information, such as a tag, bar code, and the like.

Abstract: A voice tagging system includes a client computing device that includes a media object capture device and a voice capture device and runs a client application that associates media objects to voice samples. The system also includes a communications network coupled to the client computing device, a voice tagging system coupled to the communications network and receiving at least one association between a first media object and a first voice sample, and a database coupled to the voice tagging system, the database including one or more voice tags, each voice tag being coupled to one or more voice samples.

Abstract: A MMR system for newspaper publishing comprises a plurality of mobile devices, an MMR gateway, an MMR matching unit and an MMR publisher. The MMR matching unit receives an image query from the MMR gateway and sends it to one or more of the recognition units to identify a result including a document, the page and the location on the page. The MMR system also includes a quality predictor as a plug-in installed on the mobile device to filter images before they are included as part of a retrieval request or as part of the MMR matching unit. The quality predictor comprises an input for receiving recognition algorithm information, a vector calculator, a score generator and a scoring module. The quality predictor receives as inputs an image query, context information and device parameters, and generates an outputs a recognizability score. The present invention also includes a method for generating robustness features.

Abstract: A method for enabling a user to submit proposed photos of the user, remotely, and in confidence, to a peer user to have the peer user review and rank each of the photos in order of preference, and to receive the results of the review and ranking made by the peer user. The peer user feedback may be then considered in assisting the user in determining which photos the user should upload to a given social media website to portray the user.

Abstract: The saving device for image sharing includes an image acquiring unit configured to acquire the images offered by a sharer of the images, a sharee information storing unit configured to store sharee information with respect to at least one sharee, a subject assessing unit configured to assess whether or not a person subject is included in the acquired images, an image associating unit configured to associate the images assessed as not including a person subject with the images assessed as including a person subject, based on the sharee information, and a shared image determining unit configured to determine the images to be shared with the sharee or sharees from among the associated images and the images assessed as including a person subject, based on the sharee information. The image sharing system and an image sharing method use such a device.

Abstract: Methods, systems, and articles of manufacture for the automatic determining of calls to action in a webpage are disclosed. These include, rendering a web page in a browser, capturing the rendered web page as an image, filtering the image using one or more image filters, and identifying the calls to action in the filtered image using at least one call to action selection criteria.

Abstract: Method and system for building a support vector machine binary tree for fast object search. An appearance model can be generated for objects in a database and computed on regions detected in an image frame. A covariance matrix can be utilized for representing the appearance model of the detected regions. The covariance matrix appearance model can be preprocessed and/or transferred into a vector-based format. The data in the vector-based format can be added with a class label to form labeled data. A support vector machine (SVM) can be utilized on the labeled data to generate a classifier with an optimal hyperplane and a margin area in order to hierarchically build a balanced SVM binary tree. A query appearance model can be searched rapidly utilizing the SVM binary tree during a search phase.

Abstract: This specification relates to presenting image search results. In general, one aspect of the subject matter described in this specification can be embodied in methods that include the actions of receiving an image query, the image query being a query for image search results; receiving ranked image search results responsive to the image query, the image search results each including an identification of a corresponding image resource; generating a similarity matrix for images identified by the image search results; generating a hierarchical grouping of the images using the similarity matrix; identifying a canonical image for each group in the hierarchical grouping using a ranking measure; and presenting a visual representation of the image search results based on the hierarchical grouping and the identified canonical images.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for automatically extracting logos from images. Methods include generating a query list including a plurality of logo search queries, for each logo search query of the plurality of logo search queries: generating a plurality of image search results, each image search result including image data, and clustering the plurality of image search results into a plurality of clusters, each cluster including a plurality of images of the plurality of image search results, extracting, for each cluster of the plurality of clusters, a representative image to provide a plurality of representative images, and a name corresponding to the representative image to provide a plurality of names, and providing the plurality of representative images and the plurality of names to a logo index, the logo index being accessible to identify one or more logo images in a query image.

Abstract: When a search keyword is characteristically used in an image, it is detected more easily.

Abstract: An object identification apparatus includes an image data input unit configured to input captured image data including an object, an object identification data generation unit configured to generate data for identifying the object by extracting a feature vector from a partial area of the input image data to convert the feature vector according to the partial area, an object dictionary data storage unit configured to store object dictionary data generated from previously recorded image data, and an object identification unit configured to identify a class to which the object belongs, which is included in the image data input by the image data input unit, based on the data for identifying the object and the object dictionary data.

Abstract: Suggestions can be automatically provided to a user to enable a user to tag various electronic files or objects without having to think up or manually enter the tags. A tag suggestion algorithm can analyze various types of information, such as location, time of day, objects or persons associated with the file, and tags generated by other users for that type of file. A user can be presented with a list of suggested tags, and can select one or more tags to apply to the file. Once at least one tag is applied to a file, a user can perform a tag-inclusive search to locate that file.

Abstract: Images created by one or more image acquisition devices are initially stored in remote data bases at one or more remote or satellite locations and copies of the images are subsequently transferred to a central server at a central storage location over a network and stored in a central data base. A common catalog listing local image files stored at the central data base and remote image files stored at one or more remote data bases is stored at the central location and is accessed by users to search for images. User requests for images associated with local image files result in transfer of the requested images by the central server to the user. User requests for images associated with remote image files are relayed by the central server to the associated remote location, and the requested images are then relayed to the user from the remote location via the central server.

Abstract: A content-based image retrieval technique for sharing image information between images. In the present image information sharing technique digital photographs containing relevant comments and links to web pages are supplied by a set of authors. A user of the image information sharing technique takes a digital picture of something that interests them, such as, for example, a poster, a product, a painting, and uploads it to an image information sharing server. The image information sharing technique then matches the photo to an image in an image information sharing database. The comments and web links associated with the matched photo are subsequently sent to the user.

Abstract: This invention relates to building a landmark database from web data. In one embodiment, a computer-implemented method builds a landmark database. Web data including a web page is received from one or more websites via one or more networks. The web data is interpreted using at least one processor to determine landmark data describing a landmark. At least a portion of the landmark data identifies a landmark. Finally, a visual model is generated using the landmark data. A computing device is able to recognize the landmark in an image based on the visual model.

Abstract: A tagging method and apparatus of a portable terminal in which, if particular content is edited, only second tag information corresponding to the edited content is extracted and then automatically tagged to the edited content. The second tag information is part of the first tag information corresponding to a photography subject contained in the particular content.

Abstract: A method, apparatus, article of manufacture, and a memory structure for presenting a program guide for a video-on-demand system describing a plurality of media programs, each media program having a plurality of video frames. In one embodiment, the method comprises the steps of accepting a search request from a user, the search request comprising a search parameter having a search value; searching the media program database for the search value, the media program database having first metadata associated with a first individual video frame of the media program; and providing the program guide comprising a thumbnail depicting the first individual video frame of the media program associated with the first metadata to the user if the first metadata includes the search value.

Abstract: An apparatus and method of setting a background screen of a mobile terminal are provided. The method includes receiving a selection of background screen set menu, generating a tag information list by using at least one tag information which classifies a plurality of images stored in the mobile terminal by related image, displaying the generated tag information list, receiving a selection of at least one tag information from among the displayed tag information list, and configuring a background screen with at least one image classified as the at least one selected tag information.

Abstract: Aspects of the subject matter described herein relate to functions used for retrieving image results based on search queries. More specifically, image search queries can be pre-grouped or classified based on visual and semantic similarity. For example, a pairwise image similarity value for a pair of queries can be computed based on one or more of the sum of all of the overlapping the image results, the sum of the image distances between all of the pairs of images in the image results, and the rank of each of the images in the image results. The pairwise image similarity values can then be used to generate image query clusters. Each image query clusters can include a set of queries with high pairwise image similarity values. In some examples, a distance function can be determined for each image query cluster. This data can be used to provide image results.

Abstract: The present invention provides a method and system for image matching. The method includes receiving a query image at a query-server. Further, the method includes, sending a request to one or more image-matching servers of a set of distributed image-matching servers to conduct an image-search corresponding to the query image. Furthermore, the method includes receiving at the query-server, a list of identified matches from the image-matching servers corresponding to the query image, wherein the list of matches is identified based on the image-search at the image-matching servers. Moreover, the method includes selecting one or more matches from the list of identified matches based on a score corresponding to the identified matches.

Abstract: The present invention relates to a multimedia data decoding method and apparatus. The decoding method includes receiving multimedia data including a data area including a plurality of media data areas each corresponding to a plurality of media data; and a media information area including a plurality of track areas each corresponding to the plurality of media data areas; reading the media information area; extracting timing information for sequentially reproducing the media data comprised in the media data area, from the track area; and reproducing the media data, using the media data of the data area and the extracted timing information. According to the present invention, the multimedia data decoding method and apparatus has an effect of being capable of constructing a slide show by only a small amount of multimedia data. Thus, a time taken to process and transmit the multimedia data can reduce.

Abstract: Methods (105), apparatuses (600), and computer readable storage mediums for processing captured images having geolocations related to the captured images at the time of capture are disclosed. A representative geolocation is associated (110) with each group of images previously captured at the same location. For each representative geolocation, based on at least the timestamp of the images associated with the representative geolocation, the probability is determined (120) that a further image will be captured at or near the representative geolocation. For representative geolocations with a determined probability above a predetermined threshold, the respective representative geolocation is associated (130) with at least one personal place.

Abstract: A printing method and apparatus, a print control method, and a multimedia apparatus are provided. The printing method includes receiving a multimedia file or additional information of the multimedia file from a multimedia apparatus; interpreting the multimedia file or the additional information of the multimedia and obtaining at least one item included in the additional information; and printing the obtained at least one item.

Abstract: Context data can be used to determine the current context and/or to predict the future context of a user. When the disclosed technology knows of the user's likely context, it can prepare for object recognition (e.g., image recognition, speech recognition, etc.) by (downloading and) locally storing (i.e., holding) object data related to the context. This allows for the object recognition to be performed locally and for any additional information about the object to be provided without communication over a network, thereby reducing resources such as time, cost, and processing power. If, however, the object data related to the context is not available locally, such object data can still be downloaded from a server/cloud. In some embodiments, if a likely future context is predicted and the object data related to that future context is not available locally, the object data can be downloaded from a server/cloud prior to the future context.

Abstract: A search apparatus may include the following elements. A provisional search condition inputting unit inputs character string information as a provisional search condition. A character string/position correspondence information holding unit holds character string/position correspondence information including a correspondence between character string information and position information. A position information obtaining unit obtains position information corresponding to the character string information input as the provisional search condition from the character string/position correspondence information. A search object information storage unit stores search object information with additional information including at least position information.

Abstract: An MMR system for processing image queries across index tables with unequal priority comprises a plurality of mobile devices, a pre-processing server or MMR gateway, and an MMR matching unit, and may include an MMR publisher. The MMR matching unit receives an image query from the pre-processing server or MMR gateway and sends it to one or more of the recognition units to identify a result including a document, the page, and the location on the page. The MMR matching unit includes a dispatcher, a plurality of recognition units, and index tables, as well as an image registration unit. In one embodiment, the system includes an MMR matching plug-in installed on the mobile device. The present invention also includes methods for processing image queries across index tables of unequal priority and updating a high priority index based on received or projected image queries.

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for clustering images. In one aspect a system includes one or more computers configured to, for each of a plurality of digital images, associate extrinsic image-related information with each individual image, the extrinsic image-related information including text information and co-click data for the individual image, assign images from the plurality of images to one or more of the clusters of images based on the extrinsic information associated with each of the plurality of images, receive in the search system a user query from a user device, identify by operation of the search system one or more clusters of images that match the query, and provide one or more cluster results, where each cluster result provides information about an identified cluster.

Abstract: A method and apparatus for enabling virtual tags is described. The method may include receiving a first digital image data and virtual tag data to be associated with a real-world object in the first digital image data, wherein the first digital image data is captured by a first mobile device, and the virtual tag data includes metadata received from a user of the first mobile device. The method may also include generating a first digital signature from the first digital image data that describes the real-world object, and in response to the generation, inserting in substantially real-time the first digital signature into a searchable index of digital images. The method may also include storing, in a tag database, the virtual tag data and an association between the virtual tag data and the first digital signature inserted into the index of digital images.

Abstract: A method for organizing images from multiple image capture devices includes allowing the determination of an offset between image capture times recorded in a first image capture device and image capture times recorded in a second image capture device, adjusting the image capture times recorded in the second image capture device by the offset to produce adjusted image capture times by a computer processor, and sequencing images taken by the first image capture device and the second image capture device in an chronological order. The sequencing is based on the image capture times for the images captured by the first image capture device and the adjusted image capture times for the images captured by the second image capture device.

Abstract: In an embodiment, a computer-implemented method uses one or more search references to identify media items that correspond with the one or more search references and one or more individuals associated with each media item. The method of one embodiment provides a searching and identification service that uses one or more images as one or more search key inputs to identify relevant images of a media collection, including associating information of any depicted individuals with search key inputs. In one embodiment, a computing system operates to provide an association, reporting, and/or display service as part of managing an asset by using one or more search references to search through an image collection as part of determining how a product or service is being used by characterizing an association between each individual associated with the image and the one or more search references.

Abstract: In response to a query of discernable facial attributes, the locations of distinct and different facial regions are estimated from face image data, each relevant to different attributes. Different features are extracted from the estimated facial regions from database facial images, which are ranked in base layer rankings by matching feature vectors to a base layer ranking sequence as a function of edge weights. Second-layer rankings define second-layer attribute vectors as combinations of the base-layer feature vectors and associated base layer parameter vectors for common attributes, which are matched to a second-layer ranking sequence as a function of edge weights. The images are thus ranked for relevance to the query as a function of the second-layer rankings.

Abstract: Search queries for images are received from users. An original order of responsive images to the query is determined. Duplicate images and words associated with the duplicate images are identified for each of the responsive images. Common words associated with the duplicate images are identified. The responsive images are annotated with the common words and an annotated order is determined. A re-ranked order is determined based on the original order and the annotated order. Responsive images are presented to the user in the re-ranked order.

Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for affinity based ranking and display of digital photographs. In one aspect, a method includes receiving an identifier that identifies a first user; accessing data defining relationships of the first user to second users; accessing digital photographs; determining digital photographs that are each associated with one or more of the first user and the second users; for each digital photograph, generating a photograph score based on the association with one or more of the first user and the second users and corresponding affinity scores representing the relationships of the first user to the second users; ordering the digital photographs according photograph scores; and providing one or more of the digital photographs to a user device of the first user according to the order.

Abstract: A method and apparatus for performing object modifications by using change-specific executable files comprises accessing at least one modification stub associated with an object file, wherein the modification stub comprises an instruction for modifying the object file, wherein the instruction identifies an element in the object file and defines instructions for modifying the identified element; applying a selected modification stub to the object file; and modifying the object file per the instruction contained in the modification stub.

Abstract: Generating smart tags that allow a user to locate any portion of image content without viewing the image content is disclosed. Image-based processing is performed on image content to find an event of interest that is an occurrence captured by the image content. Thus, metadata is derived from analyzing the image content. The metadata is then analyzed. Different types of characteristics associated with portions of the image content as indicated by the metadata are detected. Responsive to this, tags are created, and different types of tags are applied to the portions of image content to categorize the portions into classes. Thus, a tag is associated with each portion of the image content including the event of interest. The tag describes a characteristic of that portion of the image content. Display of the different types of tags is initiated for selective viewing of the portions of the image content.

Abstract: Image data are each related to identification information on an image-capturing location and an image-capturing apparatus, and a CPU, upon issuance of an image data transfer instruction, determines a non-image-capturing location on the basis of the image-capturing location information for image data captured by a specific image-capturing apparatus and stored in a recording medium. Then, from among image data captured by other image-capturing apparatuses and stored in other recording medium, image data captured in the non-image-capturing location is extracted, so that a user of the specific image-capturing apparatus can easily obtain image data captured by the other apparatuses in a location that the specific image-capturing apparatus did not capture images of.

Abstract: Suggestions can be automatically provided to a user to enable a user to tag various electronic files or objects without having to think up or manually enter the tags. A tag suggestion algorithm can analyze various types of information, such as location, time of day, objects or persons associated with the file, and tags generated by other users for that type of file. A user can be presented with a list of suggested tags, and can select one or more tags to apply to the file. Once at least one tag is applied to a file, a user can perform a tag-inclusive search to locate that file.

Abstract: An information processing system and method for gathering and interpreting information includes capturing information from at least one of a plurality of information streams/sensors wherein the information includes video, audio, seismic, radio frequency (RF), and/or text then applying a standardized tag to an event at a predetermined time or over a predetermined period of time and storing the standardized tag in a repository which can be interrogated rapidly for situation/scene understanding. The information processing system and method include providing a plurality of segmentation algorithms, determining the type of information to be processed and selecting one or more of the segmentation algorithms to process the information based upon the type of information to be processed.

Abstract: An apparatus and method for generating additional information about moving picture content, including: comparing image feature information about each image frame in moving picture content with image feature information about each image frame in web information, searching for an image frame in the moving picture content, the image frame matching the image frame in the web information, determining location information about the found image frame in the moving picture content, and generating additional information by use of the determined location information and the web information.