Abstract: A system includes an image analysis module that is configured to programmatically analyze individual images in a collection of images in order to determine information about each image in the collection. The system may also include a manual interface that is configured to (i) interface with one or more human editors, and (ii) displays a plurality of panels concurrently. Individual panels may be provided for one or more analyzed images, and individual panels may be configured to display information that is at least indicative of the one or more images of that panel and/or of the information determined from the one or more images.

Abstract: The present application discloses devices and methods for providing entry into and enabling interaction with a visual representation of an environment. In some implementations, a method is disclosed that includes obtaining an estimated global pose of a device in an environment. The method further includes providing on the device a user-interface including a visual representation of the environment that corresponds to the estimated global pose. The method still further includes receiving first data indicating an object in the visual representation, receiving second data indicating an action relating to the object, and applying the action in the visual representation. In other implementations, a head-mounted device is disclosed that includes a processor and data storage including logic executable by the processor to carry out the method described above.

Abstract: A hierarchy of clusters is determined, where each leave of the hierarchy corresponds to one of the images in a group, and each cluster in the hierarchy identifies images in the group that are deemed similar to one another. The hierarchy identifies a similarity between each of the plurality of clusters.

Abstract: A method and apparatus for surfacing content during a photo sharing process is described. The method may include detecting the initiation of a social networking photo sharing process for a digital image. The method may also include transmitting digital image data corresponding to the digital image to a content surfacing server to locate content relevant to the digital image. The method may also include receiving one or more items of data relevant to the digital image from the content surfacing server. Furthermore, the method may include presenting a notification, before the digital image is uploaded to a social networking system by the social networking photo sharing process, to a user to indicate that content relevant to the digital image has been received.

Abstract: Embodiments enable searching of portions of objects in images, including programmatically analyzing each image in a collection in order to determine image data that, for individual images in the collection, represents one or more visual characteristics of a portion of an object shown in that image. A user is enabled to specify one or more search criteria that includes image data, and a search result may be determined based on one or more images in the collection that show a corresponding object that has a portion that satisfies a threshold. The threshold is defined at least in part by the one or more search criteria.

Abstract: A similarity search may be performed on the image of a person, using visual characteristics and information that is known about the person. The search identifies images of other persons that are similar in appearance to the person in the image.

Abstract: In one aspect, a system and method is provided that matches images that are associated with street addresses with images that are associated with locations that are stored with respect to another reference system, such as latitude/longitude. If the images match, the street address is associated with the location. In a further aspect, text contained in the images is extracted and associated with the street address as well.

Abstract: The present application discloses systems and methods for estimating a global pose of a device. In some implementations, a method is disclosed that includes causing a detector on a device to record an image of a view from the device, sending to a server a query based on the image, and receiving from the server an estimated global pose of the device. The method further includes determining an updated estimated global pose of the device by causing the detector to record an updated image of an updated view from the device, causing at least one sensor on the device to determine at least one sensor reading corresponding to movement of the device, determining a relative pose of the device based on the updated image and the at least one sensor reading, and, based on the relative pose and the estimated global pose, determining the updated estimated global pose.

Abstract: An embodiment provides for enabling retrieval of a collection of captured images that form at least a portion of a library of images. For each image in the collection, a captured image may be analyzed to recognize information from image data contained in the captured image, and an index may be generated, where the index data is based on the recognized information. Using the index, functionality such as search and retrieval is enabled. Various recognition techniques, including those that use the face, clothing, apparel, and combinations of characteristics may be utilized. Recognition may be performed on, among other things, persons and text carried on objects.

Abstract: An embodiment provides for enabling retrieval of a collection of captured images that form at least a portion of a library of images. For each image in the collection, a captured image may be analyzed to recognize information from image data contained in the captured image, and an index may be generated, where the index data is based on the recognized information. Using the index, functionality such as search and retrieval is enabled. Various recognition techniques, including those that use the face, clothing, apparel, and combinations of characteristics may be utilized. Recognition may be performed on, among other things, persons and text carried on objects.

Abstract: Methods and systems permit automatic matching of videos with images from dense image-based geographic information systems. In some embodiments, video data including image frames is accessed. The video data may be segmented to determine a first image frame of a segment of the video data. Data representing information from the first image frame may be automatically compared with data representing information from a plurality of image frames of an image-based geographic information data system. Such a comparison may, for example, involve a search for a best match between geometric features, histograms, color data, texture data, etc. of the compared images. Based on the automatic comparing, an association between the video and one or more images of the image-based geographic information data system may be generated. The association may represent a geographic correlation between selected images of the system and the video data.

Abstract: Initial trajectory data that provides an initial description of an approximate trajectory of a device during a time period, and correction data that indicates a location of the device outside the approximate trajectory of the device within the time period, are received. A modified trajectory data that provides a modified description of a corrected trajectory of the device is generated. In particular, terms to express (i) location constraints that limit deformation of the approximate trajectory of the device and (ii) a modification constraint that limits departure of the corrected trajectory of the device from the location indicated by the correction data are generated, and the initial description of the approximate trajectory of the device is modified using the generated terms.

Abstract: A system and method are presented for estimating the orientation of a panoramic camera mounted on a vehicle relative to the vehicle coordinate frame. An initial pose estimate of the vehicle is determined based on global positioning system data, inertial measurement unit data, and wheel odometry data of the vehicle. Image data from images captured by the camera is processed to obtain one or more tracks, each track including a sequence of matched feature points stemming from a same three-dimensional location. A correction parameter determined from the initial pose estimate and tracks can then be used to correct the orientations of the images captured by the camera. The correction parameter can be optimized by deriving a correction parameter for each of a multitude of distinct subsequences of one or more runs. Statistical analysis can be performed on the determined correction parameters to produce robust estimates.

Abstract: Aspects of the disclosure pertain to matching a selected image/photograph against a database of reference images having location information. The image of interest may include some location information itself, such as latitude/longitude coordinates and orientation. This location information may be based on information obtained when the user's device interacts with base stations or other access points in a wireless communication network, such as signal strength information. The location information is used as an estimated location. The image of interest and the estimated location are used to select one or more cells to match the image against. Each cell may have multiple images and an index. The image is compared against specific cells, and if a match is found, a front end server identifies the correct location and orientation of the received image, and may correct errors in the estimated location of the user device.

Abstract: Embodiments described herein provide a system and method for providing merchandise items at a network site. According to an embodiment, an image of a merchandise item is obtained. The image is programmatically analyzed to determine information about the merchandise item. The information is used to generate a presentation that includes the merchandise item.

Abstract: A method and apparatus for enabling virtual tags is described. The method may include receiving a first digital image data and virtual tag data to be associated with a real-world object in the first digital image data, wherein the first digital image data is captured by a first mobile device, and the virtual tag data includes metadata received from a user of the first mobile device. The method may also include generating a first digital signature from the first digital image data that describes the real-world object, and in response to the generation, inserting in substantially real-time the first digital signature into a searchable index of digital images. The method may also include storing, in a tag database, the virtual tag data and an association between the virtual tag data and the first digital signature inserted into the index of digital images.

Abstract: In one aspect, a system and method is provided that matches images that are associated with street addresses with images that are associated with locations that are stored with respect to another reference system, such as latitude/longitude. If the images match, the street address is associated with the location. In a further aspect, text contained in the images is extracted and associated with the street address as well.

Abstract: An embodiment provides for enabling retrieval of a collection of captured images that form at least a portion of a library of images. For each image in the collection, a captured image may be analyzed to recognize information from image data contained in the captured image, and an index may be generated, where the index data is based on the recognized information. Using the index, functionality such as search and retrieval is enabled. Various recognition techniques, including those that use the face, clothing, apparel, and combinations of characteristics may be utilized. Recognition may be performed on, among other things, persons and text carried on objects.

Abstract: An embodiment provides for enabling retrieval of a collection of captured images that form at least a portion of a library of images. For each image in the collection, a captured image may be analyzed to recognize information from image data contained in the captured image, and an index may be generated, where the index data is based on the recognized information. Using the index, functionality such as search and retrieval is enabled. Various recognition techniques, including those that use the face, clothing, apparel, and combinations of characteristics may be utilized. Recognition may be performed on, among other things, persons and text carried on objects.

Abstract: Embodiments described herein facilitate or enhance the implementation of image recognition processes which can perform recognition on images to identify objects and/or faces by class or by people.