Patents by Inventor Sergey Ioffe

Sergey Ioffe has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 8489613
    Abstract: A set of reference videos is indexed to a reference index in order to facilitate matching of video content. An indexing module receives a set of reference fingerprints representing a set of reference videos and identifies keys contained in the reference fingerprints. Reference identifiers for the reference videos are stored in bins of the reference index associated with the identified keys. The bins in the reference index are sub-sampled to limit the number of reference identifiers stored in a given bin.
    Type: Grant
    Filed: October 20, 2011
    Date of Patent: July 16, 2013
    Assignee: Google Inc.
    Inventors: Sergey Ioffe, Michele Covell
  • Patent number: 8447032
    Abstract: A computer-implemented method is disclosed for generating a signature representing an input bit vector. A signature generator generates a primary min-hash value based on a primary permutation from a sequence of permutation blocks. If the primary min-hash value is lower than a threshold value, a secondary min-hash value is generated based on a secondary permutation from the same permutation block. The signature generator then determines one or more signature values based on the primary min-hash value, the secondary min-hash value or both. The one or more signature values are stored as elements of the signature.
    Type: Grant
    Filed: March 4, 2008
    Date of Patent: May 21, 2013
    Assignee: Google Inc.
    Inventors: Michele Covell, Sergey Ioffe, Shumeet Baluja
  • Patent number: 8429212
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for training scoring models. One method includes storing data identifying a plurality of positive and a plurality of negative training images for a query. The method further includes selecting a first image from either the positive group of images or the negative group of images, and applying a scoring model to the first image. The method further includes selecting a plurality of candidate images from the other group of images, applying the scoring model to each of the candidate images, and then selecting a second image from the candidate images according to scores for the images. The method further includes determining that the scores for the first image and the second image fail to satisfy a criterion, updating the scoring model, and storing the updated scoring model.
    Type: Grant
    Filed: January 3, 2012
    Date of Patent: April 23, 2013
    Assignee: Google Inc.
    Inventors: Samy Bengio, Gal Chechik, Sergey Ioffe, Jay Yagnik
  • Patent number: 8392427
    Abstract: A set of reference videos is indexed to a reference index in order to facilitate matching of video content. An indexing module receives a set of reference fingerprints representing a set of reference videos and identifies keys contained in the reference fingerprints. Reference identifiers for the reference videos are stored in bins of the reference index associated with the identified keys. The bins in the reference index are sub-sampled to limit the number of reference identifiers stored in a given bin.
    Type: Grant
    Filed: September 29, 2011
    Date of Patent: March 5, 2013
    Assignee: Google Inc.
    Inventors: Sergey Ioffe, Michele Covell
  • Patent number: 8340449
    Abstract: A method and system generates and compares fingerprints for videos in a video library. The video fingerprints provide a compact representation of the spatial and sequential characteristics of the video that can be used to quickly and efficiently identify video content. Because the fingerprints are based on spatial and sequential characteristics rather than exact bit sequences, visual content of videos can be effectively compared even when there are small differences between the videos in compression factors, source resolutions, start and stop times, frame rates, and so on. Comparison of video fingerprints can be used, for example, to search for and remove copyright protected videos from a video library. Further, duplicate videos can be detected and discarded in order to preserve storage space.
    Type: Grant
    Filed: September 30, 2011
    Date of Patent: December 25, 2012
    Assignee: Google Inc.
    Inventors: Jay Yagnik, Henry A. Rowley, Sergey Ioffe
  • Patent number: 8290918
    Abstract: A robust hashing method is applied to media data (e.g., video, image, and/or audio data), producing a hash output that is robust with respect to at least one attribute of the media data. A histogram is generated for the media data and the histogram is hashed using a weighted hashing procedure. The histogram can be derived from a plurality of randomized versions of the media file, each randomized version of the media file altered to a random extent with respect to the attribute. The histogram can also be derived from a plurality of feature descriptors computed for the media data that are coarsely encoded with respect to the attribute. The weighted hashing procedure includes assigning a weight to components of the histogram and applying a plurality of hash functions to a number of versions of each component, the number of versions based on the assigned weight.
    Type: Grant
    Filed: September 29, 2009
    Date of Patent: October 16, 2012
    Assignee: Google Inc.
    Inventor: Sergey Ioffe
  • Patent number: 8229219
    Abstract: A full-length fingerprint is generated for a video that represents characteristics of the entire duration of the video in a small amount of data. A plurality of subfingerprints for the video, each subfingerprint encoding features of a corresponding segment of the video, is accessed. A plurality of subhistograms is generated for the video, each subhistogram encoding a frequency of subfingerprint features for subfingerprints included in a subset of the plurality of accessed subfingerprints. A master histogram for the video is generated that encodes a frequency of subhistogram features for the plurality of generated subhistograms for the video. A hashing procedure is applied to the master histogram to produce the full-length fingerprint. Clustering can be performed on full-length video fingerprints for videos in a database to detect near-duplicate videos.
    Type: Grant
    Filed: August 6, 2009
    Date of Patent: July 24, 2012
    Assignee: Google Inc.
    Inventor: Sergey Ioffe
  • Patent number: 8184953
    Abstract: Videos are received and indexed based on fingerprints generated for the videos, using lookup keys which correspond to sub portions of the reference fingerprints. Specifically, a set of lookup keys is selected such that the number of reference fingerprints such that the clumping associated with the associated each of the lookup keys is minimized. Clumping occurs when a number of reference identifiers associated with a lookup key exceeds a maximum value.
    Type: Grant
    Filed: February 23, 2009
    Date of Patent: May 22, 2012
    Assignee: Google Inc.
    Inventors: Michele Covell, Sergey Ioffe, Shumeet Baluja, David Marwood
  • Patent number: 8175413
    Abstract: Proprietary rights logos are detected in a video. The video is divided into a plurality of regions that are analyzed for generic proprietary rights logo features. A confidence mask is generated that comprises a plurality of scaling factors, each scaling factor corresponding to a region of the video and indicating a likelihood that the corresponding region of the video includes a proprietary rights logo. The scaling factors of the confidence mask are applied to the video data to generate an altered video. The altered video is analyzed to determine a confidence measure that the video includes a reference proprietary rights logo.
    Type: Grant
    Filed: March 5, 2009
    Date of Patent: May 8, 2012
    Assignee: Google Inc.
    Inventors: Sergey Ioffe, Krzysztof Kulewski
  • Publication number: 20120070042
    Abstract: A method and system of identity masking to obscure identities corresponding to face regions in an image is disclosed. A face detector is applied to detect a set of possible face regions in the image. Then an identity masker is used to process the detected face regions by identity masking techniques in order to obscure identities corresponding to the regions. For example, a detected face region can be blurred as if it is in motion by a motion blur algorithm, such that the blurred region can not be recognized as the original identity. Or the detected face region can be replaced by a substitute facial image by a face replacement algorithm to obscure the corresponding identity.
    Type: Application
    Filed: November 22, 2011
    Publication date: March 22, 2012
    Applicant: Google Inc.
    Inventors: Sergey IOFFE, Lance Williams, Dennis Strelow, Andrea Frome, Luc Vincent
  • Patent number: 8131786
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for training scoring models. One method includes storing data identifying a plurality of positive and a plurality of negative training images for a query. The method further includes selecting a first image from either the positive group of images or the negative group of images, and applying a scoring model to the first image. The method further includes selecting a plurality of candidate images from the other group of images, applying the scoring model to each of the candidate images, and then selecting a second image from the candidate images according to scores for the images. The method further includes determining that the scores for the first image and the second image fail to satisfy a criterion, updating the scoring model, and storing the updated scoring model.
    Type: Grant
    Filed: November 23, 2009
    Date of Patent: March 6, 2012
    Assignee: Google Inc.
    Inventors: Samy Bengio, Gal Chechik, Sergey Ioffe, Jay Yagnik
  • Patent number: 8098904
    Abstract: A method and system of identity masking to obscure identities corresponding to face regions in an image is disclosed. A face detector is applied to detect a set of possible face regions in the image. Then an identity masker is used to process the detected face regions by identity masking techniques in order to obscure identities corresponding to the regions. For example, a detected face region can be blurred as if it is in motion by a motion blur algorithm, such that the blurred region can not be recognized as the original identity. Or the detected face region can be replaced by a substitute facial image by a face replacement algorithm to obscure the corresponding identity.
    Type: Grant
    Filed: March 31, 2008
    Date of Patent: January 17, 2012
    Assignee: Google Inc.
    Inventors: Sergey Ioffe, Lance Williams, Dennis Strelow, Andrea Frome, Luc Vincent
  • Patent number: 8094872
    Abstract: A method and system generates and compares fingerprints for videos in a video library. The video fingerprints provide a compact representation of the spatial and sequential characteristics of the video that can be used to quickly and efficiently identify video content. Because the fingerprints are based on spatial and sequential characteristics rather than exact bit sequences, visual content of videos can be effectively compared even when there are small differences between the videos in compression factors, source resolutions, start and stop times, frame rates, and so on. Comparison of video fingerprints can be used, for example, to search for and remove copyright protected videos from a video library. Further, duplicate videos can be detected and discarded in order to preserve storage space.
    Type: Grant
    Filed: May 9, 2007
    Date of Patent: January 10, 2012
    Assignee: Google Inc.
    Inventors: Jay Yagnik, Henry A. Rowley, Sergey Ioffe
  • Patent number: 8069176
    Abstract: A set of reference videos is indexed to a reference index in order to facilitate matching of video content. An indexing module receives a set of reference fingerprints representing a set of reference videos and identifies keys contained in the reference fingerprints. Reference identifiers for the reference videos are stored in bins of the reference index associated with the identified keys. The bins in the reference index are sub-sampled to limit the number of reference identifiers stored in a given bin.
    Type: Grant
    Filed: September 25, 2008
    Date of Patent: November 29, 2011
    Assignee: Google Inc.
    Inventors: Sergey Ioffe, Michele Covell
  • Patent number: 7957555
    Abstract: A method and an apparatus localize an object part location in a digital image. The method according to one embodiment accesses digital image data containing an object part; obtains an initial position estimate for object part location of the object part; extracts a sub-image window around the initial position estimate of the object part location; calculates feature values based on pixel values within the sub-image window; and determines an updated position estimate for the object part location based on the calculated feature values.
    Type: Grant
    Filed: February 8, 2006
    Date of Patent: June 7, 2011
    Assignee: Fujifilm Corporation
    Inventor: Sergey Ioffe
  • Patent number: 7702131
    Abstract: A sequence of images depicts a foreground object in motion. A base image is selected, and the other images in the sequence are co-registered with the base image in order to align the images to a common coordinate system. A background image and a binary foreground mask are generated from the sequence of aligned images. By applying the foreground mask to a chosen one of the aligned images, a representation of the moving object is extracted. After blurring the background image, the extracted representation may be superimposed onto the blurred background image to produce a new image.
    Type: Grant
    Filed: October 13, 2005
    Date of Patent: April 20, 2010
    Assignee: Fujifilm Corporation
    Inventors: Troy Chinen, Sergey Ioffe, Thomas Leung, Yang Song
  • Patent number: 7684594
    Abstract: A method and an apparatus estimate an object part location in a digital image using feature value analysis. The method according to one embodiment accesses digital image data representing a region including an object part of a digital image; accesses reference data including class data of classes relating to predetermined positions of the object part in predetermined regions, and features that discriminate among the classes; calculates feature values for the features in the region using pixel values within the region; and determines a location estimate of the object part using the feature values and the reference data.
    Type: Grant
    Filed: February 8, 2006
    Date of Patent: March 23, 2010
    Assignee: Fujifilm Corporation
    Inventor: Sergey Ioffe
  • Publication number: 20090262987
    Abstract: A method and system of identity masking to obscure identities corresponding to face regions in an image is disclosed. A face detector is applied to detect a set of possible face regions in the image. Then an identity masker is used to process the detected face regions by identity masking techniques in order to obscure identities corresponding to the regions. For example, a detected face region can be blurred as if it is in motion by a motion blur algorithm, such that the blurred region can not be recognized as the original identity. Or the detected face region can be replaced by a substitute facial image by a face replacement algorithm to obscure the corresponding identity.
    Type: Application
    Filed: March 31, 2008
    Publication date: October 22, 2009
    Applicant: Google Inc.
    Inventors: Sergey Ioffe, Lance Williams, Dennis Strelow, Andrea Frome, Luc Vincent
  • Patent number: 7596247
    Abstract: A method and an apparatus automatically recognize or verify objects in a digital image using probability models. According to a first aspect, a method and apparatus automatically recognize or verify objects in a digital image by: accessing digital image data including an object of interest therein; detecting an object of interest in the image; normalizing the object to generate a normalized object representation; extracting a plurality of features from the normalized object representation; and applying each feature to a previously-determined additive probability model to determine the likelihood that the object of interest belongs to an existing class. In one embodiment, the previously-determined additive probability model is an Additive Gaussian Model.
    Type: Grant
    Filed: December 15, 2003
    Date of Patent: September 29, 2009
    Assignee: Fujifilm Corporation
    Inventor: Sergey Ioffe
  • Patent number: 7343028
    Abstract: A method and an apparatus automatically detect red-eye regions in a photographic image. The method according to one embodiment accesses digital image data representing a color photographic image; detects red-eye candidate regions in the photographic image by processing the digital image data, the step of detecting red-eye candidate regions including calculating feature values for multiple positions of the photographic image, and identifying red-eye candidate regions based on the calculated feature values resulting from the calculating step; and performs face detection to determine whether an identified red-eye candidate region is associated with a face.
    Type: Grant
    Filed: May 19, 2003
    Date of Patent: March 11, 2008
    Assignee: Fujifilm Corporation
    Inventors: Sergey Ioffe, Troy T. Chinen