Patents by Inventor Sergey Ioffe

Sergey Ioffe has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 9063954
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for determining image search results. One of the methods includes generating a plurality of feature vectors for each image in a collection of images, wherein each feature vector is associated with an image tile of an image, wherein each feature vector corresponds to one of a plurality of predetermined visual words. All images in the collection of images that share at least a threshold number of matching visual words associated with matching image tiles are classified as near-duplicate images.
    Type: Grant
    Filed: March 15, 2013
    Date of Patent: June 23, 2015
    Assignee: Google Inc.
    Inventors: Sergey Ioffe, Mohamed Aly, Charles J. Rosenberg
  • Publication number: 20150169646
    Abstract: A method and apparatus are provided for performing an image search based on a search query having a portion P1 and a portion P2. Based on the first search query, a second search query is generated that includes a portion P3 and the portion P2 such that the second search query is broader in scope than the first search query, while still retaining the portion P2 of the first query. A first image search is then performed for the first search query to obtain a first set of search results and a second image search is performed for the second search query to obtain a second set of search results. Consequently, an image from the first set of search results is selected for presentation to a user, wherein the selection is based on content of the second set of search results.
    Type: Application
    Filed: April 30, 2014
    Publication date: June 18, 2015
    Applicant: Google Inc.
    Inventor: Sergey Ioffe
  • Publication number: 20150169633
    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for training an image ranking model to rank images based on hashes of their contents using a lookup table. An image training set is received. An image ranking model is trained with the training set by generating an image hash for each image of the ordered pair of images based on one or more features extracted from the image, computing a first score for a first image hash of a first image of the pair and a second score for a second image hash of a second image of the pair using the image ranking model, determining whether to update the image ranking model based on the first score and the second score, and updating the image ranking model using an update value based on the first score and the second score.
    Type: Application
    Filed: March 3, 2011
    Publication date: June 18, 2015
    Inventors: Yangli Hector Yee, Sergey Ioffe, Samy Bengio
  • Publication number: 20150169992
    Abstract: A system and method is provided that determines whether objects in one image are visually similar to objects in another image by replacing the images' backgrounds with other images, such as a solid color or an image with texture, and comparing the resulting histograms.
    Type: Application
    Filed: August 15, 2012
    Publication date: June 18, 2015
    Applicant: GOOGLE INC.
    Inventors: Sergey Ioffe, Troy Chinen
  • Publication number: 20150154743
    Abstract: A method, computer program product, and computer system for identifying a first portion of a facial image in a first image, wherein the first portion includes noise. A corresponding portion of the facial image is identified in a second image, wherein the corresponding portion includes less noise than the first portion. One or more filter parameters of the first portion are determined based upon, at least in part, the first portion and the corresponding portion. At least a portion of the noise from the first portion is smoothed based upon, at least in part, the one or more filter parameters. At least a portion of face specific details from the corresponding portion is added to the first portion.
    Type: Application
    Filed: February 5, 2015
    Publication date: June 4, 2015
    Applicant: Google Inc.
    Inventors: Sergey Ioffe, Troy Chinen, Vivek Kwatra, Hui Fang, Yichang Shih
  • Patent number: 9043316
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for generating image search results. One of the methods includes receiving first image search results responsive to a text query, each first image search result associated with a respective first score indicating a relevance of an image represented by the first image search result to the text query. Second image search results responsive to a query image are received, each second image search result associated with a respective second score indicating a measure of similarity between an image represented by the second image search result and the query image. A set of final image search results is selected including combining first scores and second scores of the selected first image search results. The final image search results are ordered by similarity to the query image.
    Type: Grant
    Filed: March 28, 2012
    Date of Patent: May 26, 2015
    Assignee: Google Inc.
    Inventors: Erik Murphy-Chutorian, Charles J. Rosenberg, Nemanja Petrovic, Sergey Ioffe, Sean O'Malley
  • Patent number: 9025811
    Abstract: Image similarity operations are performed in which a seed image is analyzed, and a set of semantic classifications are determined from analyzing the seed image. The set of semantic classifications can include multiple positive semantic classifications. A distance measure is determined that is specific to the set of semantic classifications. The seed image is compared to a collection of images using the distance measure. A set of similar images is determined from comparing the seed image to the collection of images.
    Type: Grant
    Filed: January 2, 2013
    Date of Patent: May 5, 2015
    Assignee: Google Inc.
    Inventors: Sergey Ioffe, Yushi Jing, Stephen Holiday
  • Patent number: 8983941
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for generating image search results. One of the methods includes receiving first image search results responsive to a text query, each first image search result associated with a respective first score indicating a relevance of an image represented by the first image search result to the text query. Second image search results responsive to a query image are received, each second image search result associated with a respective second score indicating a measure of similarity between an image represented by the second image search result and the query image. A set of final image search results is selected including combining first scores and second scores of the selected first image search results. The final image search results are ordered by similarity to the query image.
    Type: Grant
    Filed: September 15, 2012
    Date of Patent: March 17, 2015
    Assignee: Google Inc.
    Inventors: Erik Murphy-Chutorian, Charles J. Rosenberg, Nemanja Petrovic, Sergey Ioffe, Sean O'Malley
  • Patent number: 8977012
    Abstract: A method, computer program product, and computer system for identifying a first portion of a facial image in a first image, wherein the first portion includes noise. A corresponding portion of the facial image is identified in a second image, wherein the corresponding portion includes less noise than the first portion. One or more filter parameters of the first portion are determined based upon, at least in part, the first portion and the corresponding portion. At least a portion of the noise from the first portion is smoothed based upon, at least in part, the one or more filter parameters. At least a portion of face specific details from the corresponding portion is added to the first portion.
    Type: Grant
    Filed: October 31, 2012
    Date of Patent: March 10, 2015
    Assignee: Google Inc.
    Inventors: Sergey Ioffe, Troy Chinen, Vivek Kwatra, Hui Fang, Yichang Shih
  • Patent number: 8965891
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for training scoring models. One method includes storing data identifying a plurality of positive and a plurality of negative training images for a query. The method further includes selecting a first image from either the positive group of images or the negative group of images, and applying a scoring model to the first image. The method further includes selecting a plurality of candidate images from the other group of images, applying the scoring model to each of the candidate images, and then selecting a second image from the candidate images according to scores for the images. The method further includes determining that the scores for the first image and the second image fail to satisfy a criterion, updating the scoring model, and storing the updated scoring model.
    Type: Grant
    Filed: November 18, 2013
    Date of Patent: February 24, 2015
    Assignee: Google Inc.
    Inventors: Samy Bengio, Gal Chechik, Sergey Ioffe, Jay Yagnik
  • Patent number: 8965859
    Abstract: A robust hashing method is applied to media data (e.g., video, image, and/or audio data), producing a hash output that is robust with respect to at least one attribute of the media data. A histogram is generated for the media data and the histogram is hashed using a weighted hashing procedure. The histogram can be derived from a plurality of randomized versions of the media file, each randomized version of the media file altered to a random extent with respect to the attribute. The histogram can also be derived from a plurality of feature descriptors computed for the media data that are coarsely encoded with respect to the attribute. The weighted hashing procedure includes assigning a weight to components of the histogram and applying a plurality of hash functions to a number of versions of each component, the number of versions based on the assigned weight.
    Type: Grant
    Filed: September 12, 2012
    Date of Patent: February 24, 2015
    Assignee: Google Inc.
    Inventor: Sergey Ioffe
  • Patent number: 8953811
    Abstract: Systems and methods are provided herein relating to audio matching. A compact digest can be generated based on sets of triples, where triples are groupings of three interest points that meet threshold criteria. The compact digest can be used in identifying a potential audio match. A full digest can then be used in verifying the potential match. By using a compact digest to perform audio matching, the audio matching system can be scaled to encompass millions or billions of reference audio samples while still using the full digest to maintain accuracy.
    Type: Grant
    Filed: April 18, 2012
    Date of Patent: February 10, 2015
    Assignee: Google Inc.
    Inventors: Matthew Sharifi, Gheorghe Postelnicu, Sergey Ioffe
  • Patent number: 8947595
    Abstract: A combined fingerprint is generated for a video that can match two near-identical videos that differ only in their aspect ratios or formats. A transformation strategy is selected by selecting a first and a second aspect correction method. A first transformed video is generated by applying the first aspect correction method to the video. A second transformed video is generated by applying the second aspect correction method to the video. A first fingerprint is generated using the first transformed video. A second fingerprint is generated using the second transformed video. The combined fingerprint is generated by combining the first half of the first fingerprint with the second half of the second fingerprint.
    Type: Grant
    Filed: December 9, 2010
    Date of Patent: February 3, 2015
    Assignee: Google Inc.
    Inventors: Richard Tucker, Henrik Rydgard, Gheorghe Postelnicu, Jasmine Kent, Michele Covell, Sergey Ioffe
  • Patent number: 8938119
    Abstract: An image comprising color pixels with varying illumination is selected. Instances of a repeating pattern in the image are determined. Illumination values for illuminated pixels at locations within instances of the repeating pattern are calculated based on pixel intensities of non-illuminated pixels at corresponding locations in other instances of the repeating pattern. The illumination variation is removed from the illuminated pixels based on the calculated illumination values to produce enhanced pixels. Color from the non-illuminated pixels at the corresponding locations in other instances of the repeating pattern is propagated to the enhanced pixels.
    Type: Grant
    Filed: May 1, 2012
    Date of Patent: January 20, 2015
    Assignee: Google Inc.
    Inventors: Mei Han, Vivek Kwatra, Shengyang Dai, Sergey Ioffe
  • Patent number: 8934734
    Abstract: Proprietary rights logos are detected in a video. The video is divided into a plurality of regions that are analyzed for generic proprietary rights logo features. A confidence mask is generated that comprises a plurality of scaling factors, each scaling factor corresponding to a region of the video and indicating a likelihood that the corresponding region of the video includes a proprietary rights logo. The scaling factors of the confidence mask are applied to the video data to generate an altered video. The altered video is analyzed to determine a confidence measure that the video includes a reference proprietary rights logo.
    Type: Grant
    Filed: March 28, 2012
    Date of Patent: January 13, 2015
    Assignee: Google Inc.
    Inventors: Sergey Ioffe, Krzysztof Kulewski
  • Patent number: 8897487
    Abstract: Systems and methods for facilitating combining media fingerprinters are provided. In one implementation, a system can include a memory and a microprocessor. The system can also include: a communication component that receives media; a wavelet-based hash generation component that generates a plurality of hashes based on wavelet descriptors associated with the media; a local features information generation component that generates local descriptors associated with the media; a grouping component that groups the plurality of hashes into two or more subgroups, and generates a combined group of descriptors. The combined group of descriptors can include quantized local descriptors and groups of hashes. The system can also include a hash generation component that hashes the combined group of descriptors.
    Type: Grant
    Filed: April 25, 2014
    Date of Patent: November 25, 2014
    Assignee: Google Inc.
    Inventor: Sergey Ioffe
  • Patent number: 8880899
    Abstract: Systems and methods for facilitating media fingerprinting are provided. In one aspect, a system can include: a memory, a microprocessor, a communication component that receives media; and a media fingerprinting component that fingerprints the media. The media fingerprinting component employs a fingerprint generation component stored in the memory and includes: a first hash generation component that generates sets of hashes corresponding to versions of the media; and a second hash generation component that computes a final hash based, at least, on hashing the sets of hashes. In some aspects, the media fingerprinting component can generate a flip-resistant fingerprint based, at least, on the final hash. In some aspects, the flip-resistant fingerprint is the final hash.
    Type: Grant
    Filed: April 26, 2012
    Date of Patent: November 4, 2014
    Assignee: Google Inc.
    Inventor: Sergey Ioffe
  • Patent number: 8842920
    Abstract: Systems and methods for facilitating video fingerprinting are provided. In one embodiment, a system can include: a memory, a microprocessor, a communication component that receives the media; and a media fingerprinting component that fingerprints the media. The media fingerprinting component employs a fingerprint generation component stored in the memory and includes: a wavelet transform generation component that computes a wavelet transform, and identifies a set of largest coefficients for, the frame information; a coefficient encoder component that encodes the largest coefficients by mapping the largest coefficients to a tuple of integers; an aggregation component that aggregates the tuples of integers, and records a count of the tuples. The MFC can also include: a weighted set generation component that generates a weighted set of the tuples of integers; and a hash generation component that generates a hash based on the weighted set of the tuples of integers.
    Type: Grant
    Filed: March 29, 2012
    Date of Patent: September 23, 2014
    Assignee: Google Inc.
    Inventor: Sergey Ioffe
  • Patent number: 8805090
    Abstract: Systems and methods for measuring consistency between two objects based upon a rank of object elements instead of based upon the values of those object elements. Objects being compared can be represented by d-dimension feature vectors, U and V, where each dimension includes an associated value. U and V can be converted to rank vectors, P and Q, where values of U and V dimensions are replaced by an ordered rank or a function thereof. Analysis directed to the consistency between U and V can be accomplished by determining consistency between P and Q, which can be more efficient and more accurate, particularly with regard to illumination-invariant comparisons.
    Type: Grant
    Filed: February 7, 2012
    Date of Patent: August 12, 2014
    Assignee: Google Inc.
    Inventors: Jay Yagnik, Sergey Ioffe
  • Publication number: 20140198178
    Abstract: Examples of methods and systems for creating swivel views from handheld video are described. In some examples, a method may be performed by a handheld device to receive or capture a video of a target object and the video may include a plurality of frames and content of the target object from a plurality of viewpoints. The device may determine one or more approximately corresponding frames of the video including content of the target object from a substantially matching viewpoint and may align the approximately corresponding frames of the video based on one or more feature points of the target object to generate an aligned video. The device may provide sampled frames from multiple viewpoints from the aligned video, configured for viewing the target object in a rotatable manner, such as in a swivel view format.
    Type: Application
    Filed: January 17, 2013
    Publication date: July 17, 2014
    Inventors: Sergey Ioffe, Christian Frueh