Patents by Inventor Sergey Ioffe

Sergey Ioffe has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 8781154
    Abstract: Systems and methods facilitating random number generation of hashes for video and/or audio are provided. In one embodiment, a system can include: a memory, and a microprocessor that executes computer executable components. The components can include a weighted distribution generation component that can generate a sampling distribution of a weighted combination of uniform distributions, and obtain a sample value from the sampling distribution. In one embodiment, horizontal regions of substantially equal area can be identified. The sample value can be obtained by selecting one of the horizontal regions, and uniformly selecting a coordinate from the horizontal region. The coordinate can correspond to a value on a horizontal axis of the sampling distribution, and the value can be equal to a sample value. The sample value can be employed to compute a hash employed in video and/or audio fingerprinting and/or in computing image descriptors for video.
    Type: Grant
    Filed: January 21, 2012
    Date of Patent: July 15, 2014
    Assignee: Google Inc.
    Inventor: Sergey Ioffe
  • Patent number: 8750562
    Abstract: Systems and methods for facilitating combining media fingerprinters are provided. In one implementation, a system can include a memory and a microprocessor. The system can also include: a communication component that receives media; a wavelet-based hash generation component that generates a plurality of hashes based on wavelet descriptors associated with the media; a local features information generation component that generates local descriptors associated with the media; a grouping component that groups the plurality of hashes into two or more subgroups, and generates a combined group of descriptors. The combined group of descriptors can include quantized local descriptors and groups of hashes. The system can also include a hash generation component that hashes the combined group of descriptors.
    Type: Grant
    Filed: April 26, 2012
    Date of Patent: June 10, 2014
    Assignee: Google Inc.
    Inventor: Sergey Ioffe
  • Patent number: 8751530
    Abstract: A method and apparatus are provided for performing an image search based on a search query having a portion P1 and a portion P2. Based on the first search query, a second search query is generated that includes a portion P3 and the portion P2, such that the second search query is broader in scope than the first search query, while still retaining the portion P2 of the first query. A first image search is then performed for the first search query to obtain a first set of search results and a second image search is performed for the second search query to obtain a second set of search results. Consequently, an image from the first set of search results is selected for presentation to a user, wherein the selection is based on content of the second set of search results.
    Type: Grant
    Filed: August 2, 2012
    Date of Patent: June 10, 2014
    Assignee: Google Inc.
    Inventor: Sergey Ioffe
  • Patent number: 8738633
    Abstract: This disclosure relates to transformation invariant media matching. A fingerprinting component can generate a transformation invariant identifier for media content by adaptively encoding the relative ordering of interest points in media content. The interest points can be grouped into subsets, and stretch invariant descriptors can be generated for the subsets based on ratios of coordinates of interest points included in the subsets. The stretch invariant descriptors can be aggregated into a transformation invariant identifier. An identification component compares the identifier against a set of identifiers for known media content, and the media content can be matched or identified as a function of the comparison.
    Type: Grant
    Filed: January 31, 2012
    Date of Patent: May 27, 2014
    Assignee: Google Inc.
    Inventors: Matthew Sharifi, Sergey Ioffe, Jay Yagnik, Gheorghe Postelnicu, Dominik Roblek, George Tzanetakis
  • Publication number: 20140118390
    Abstract: A computer-implemented method, computer program product, and computing system is provided for interacting with images having similar content. In an embodiment, a method may include identifying a plurality of photographs as including a common characteristic. The method may also include generating a flipbook media item including the plurality of photographs. The method may further include associating one or more interactive control features with the flipbook media item.
    Type: Application
    Filed: October 26, 2012
    Publication date: May 1, 2014
    Applicant: GOOGLE INC.
    Inventors: Sergey Ioffe, Vivek Kwatra, Matthias Grundmann
  • Publication number: 20140119664
    Abstract: A method, computer program product, and computer system for identifying a first portion of a facial image in a first image, wherein the first portion includes noise. A corresponding portion of the facial image is identified in a second image, wherein the corresponding portion includes less noise than the first portion. One or more filter parameters of the first portion are determined based upon, at least in part, the first portion and the corresponding portion. At least a portion of the noise from the first portion is smoothed based upon, at least in part, the one or more filter parameters. At least a portion of face specific details from the corresponding portion is added to the first portion.
    Type: Application
    Filed: October 31, 2012
    Publication date: May 1, 2014
    Inventors: Sergey Ioffe, Troy Chinen, Vivek Kwatra, Hui Fang, Yichang Shih
  • Publication number: 20140119672
    Abstract: Systems, methods and computer readable media for image enhancement using learned non-photorealistic effects. In some implementations, a method can include obtaining an original image. The method can also include analyzing the original image to determine one or more characteristics of the original image. The method can further include selecting one or more filters based on the one or more characteristics and applying the one or more filters to the original image to generate a modified image. The method can include causing the modified image to be displayed.
    Type: Application
    Filed: November 1, 2012
    Publication date: May 1, 2014
    Inventors: Sergey Ioffe, Hui Fang
  • Patent number: 8712216
    Abstract: Videos are received and indexed based on fingerprints generated for the videos, using lookup keys which correspond to sub portions of the reference fingerprints. Specifically, a set of lookup keys is selected such that the number of reference fingerprints such that the clumping associated with the associated each of the lookup keys is minimized. Clumping occurs when a number of reference identifiers associated with a lookup key exceeds a maximum value.
    Type: Grant
    Filed: May 21, 2012
    Date of Patent: April 29, 2014
    Assignee: Google Inc.
    Inventors: Michele Covell, Sergey Ioffe, Shumeet Baluja, David Marwood
  • Publication number: 20140105505
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for determining image search results. One of the methods includes generating a plurality of feature vectors for each image in a collection of images, wherein each feature vector is associated with an image tile of an image, wherein each feature vector corresponds to one of a plurality of predetermined visual words. All images in the collection of images that share at least a threshold number of matching visual words associated with matching image tiles are classified as near-duplicate images.
    Type: Application
    Filed: March 15, 2013
    Publication date: April 17, 2014
    Inventors: Sergey Ioffe, Mohamed Aly, Charles J. Rosenberg
  • Patent number: 8660296
    Abstract: Systems and methods for facilitating video fingerprinting are provided. In one embodiment, a system can include: a memory, a microprocessor, a communication component that receives a video, and a video fingerprinting component that fingerprints the video with a subfingerprint (SFP). The video fingerprinting component can employ an SFP component stored in the memory and that comprises: a feature extraction component that determines local descriptors for at least one frame of a video; and a quantization component that quantizes the local descriptors to generate first frame information including a set of values for the at least one frame. The SFP component can also include: an accumulation component that accumulates first frame information over a snippet of the video; and an SFP generation component that computes the SFP associated with the snippet. The SFP can be computed based on a hash based on the accumulated first frame information over the snippet.
    Type: Grant
    Filed: January 10, 2012
    Date of Patent: February 25, 2014
    Assignee: Google Inc.
    Inventor: Sergey Ioffe
  • Publication number: 20140032583
    Abstract: The specification relates to providing an image space. The image space represents a first sampling of images in increasing distance from a seed image. The first sampling shows a number of images an initial distance value from the seed image and representative images of image groups a distance value that is different from the initial distance value from the seed image. The system is capable of browsing and modifying the image space responsive to at least one input. When modified, the system provides a second sampling of the images in increasing distance from an image related to a target image. The second sampling shows a number of images a certain distance value from the image related to the target image and representative images of image groups a distance value that is different from the certain distance value from the image related to the target image.
    Type: Application
    Filed: July 27, 2012
    Publication date: January 30, 2014
    Inventors: Sergey Ioffe, Yushi Jing
  • Publication number: 20140016706
    Abstract: This disclosure relates to transformation invariant media matching. A fingerprinting component can generate a transformation invariant identifier for media content by adaptively encoding the relative ordering of signal markers in media content. The signal markers can be adaptively encoded via reference point geometry, or ratio histograms. An identification component compares the identifier against a set of identifiers for known media content, and the media content can be matched or identified as a function of the comparison.
    Type: Application
    Filed: September 12, 2013
    Publication date: January 16, 2014
    Applicant: Google Inc.
    Inventors: Jay Yagnik, Sergey Ioffe
  • Patent number: 8611689
    Abstract: A method and system generates and compares fingerprints for videos in a video library. The video fingerprints provide a compact representation of the spatial and sequential characteristics of the video that can be used to quickly and efficiently identify video content. Because the fingerprints are based on spatial and sequential characteristics rather than exact bit sequences, visual content of videos can be effectively compared even when there are small differences between the videos in compression factors, source resolutions, start and stop times, frame rates, and so on. Comparison of video fingerprints can be used, for example, to search for and remove copyright protected videos from a video library. Further, duplicate videos can be detected and discarded in order to preserve storage space.
    Type: Grant
    Filed: December 15, 2010
    Date of Patent: December 17, 2013
    Assignee: Google Inc.
    Inventors: Jay Yagnik, Henry A. Rowley, Sergey Ioffe
  • Patent number: 8611422
    Abstract: A method and system generates and compares fingerprints for videos in a video library. The video fingerprints provide a compact representation of the temporal locations of discontinuities in the video that can be used to quickly and efficiently identify video content. Discontinuities can be, for example, shot boundaries in the video frame sequence or silent points in the audio stream. Because the fingerprints are based on structural discontinuity characteristics rather than exact bit sequences, visual content of videos can be effectively compared even when there are small differences between the videos in compression factors, source resolutions, start and stop times, frame rates, and so on. Comparison of video fingerprints can be used, for example, to search for and remove copyright protected videos from a video library. Furthermore, duplicate videos can be detected and discarded in order to preserve storage space.
    Type: Grant
    Filed: June 19, 2007
    Date of Patent: December 17, 2013
    Assignee: Google Inc.
    Inventors: Jay Yagnik, Henry A. Rowley, Sergey Ioffe
  • Patent number: 8589457
    Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for training scoring models. One method includes storing data identifying a plurality of positive and a plurality of negative training images for a query. The method further includes selecting a first image from either the positive group of images or the negative group of images, and applying a scoring model to the first image. The method further includes selecting a plurality of candidate images from the other group of images, applying the scoring model to each of the candidate images, and then selecting a second image from the candidate images according to scores for the images. The method further includes determining that the scores for the first image and the second image fail to satisfy a criterion, updating the scoring model, and storing the updated scoring model.
    Type: Grant
    Filed: September 14, 2012
    Date of Patent: November 19, 2013
    Assignee: Google Inc.
    Inventors: Samy Bengio, Gal Chechik, Sergey Ioffe, Jay Yagnik
  • Patent number: 8588525
    Abstract: This disclosure relates to transformation invariant media matching. A fingerprinting component can generate a transformation invariant identifier for media content by adaptively encoding the relative ordering of signal markers in media content. The signal markers can be adaptively encoded via reference point geometry, or ratio histograms. An identification component compares the identifier against a set of identifiers for known media content, and the media content can be matched or identified as a function of the comparison.
    Type: Grant
    Filed: November 17, 2011
    Date of Patent: November 19, 2013
    Assignee: Google Inc.
    Inventors: Jay Yagnik, Sergey Ioffe
  • Patent number: 8582872
    Abstract: Methods, systems, and articles of manufacture for detecting placeholder images are disclosed. These include, accessing a collection of digital images, clustering the digital images to generate at least one of a plurality of exact-duplicate image clusters and a plurality of near-duplicate image clusters, and selecting one or more placeholder image clusters from at least one of the plurality of exact-duplicate image clusters or the plurality of near-duplicate image clusters.
    Type: Grant
    Filed: June 30, 2011
    Date of Patent: November 12, 2013
    Assignee: Google Inc.
    Inventors: Sergey Ioffe, Samy Bengio, Troy Chinen, Olivier Bousquet
  • Patent number: 8532382
    Abstract: A full-length fingerprint is generated for a video that represents characteristics of the entire duration of the video in a small amount of data. A plurality of subfingerprints for the video, each subfingerprint encoding features of a corresponding segment of the video, is accessed. A plurality of subhistograms is generated for the video, each subhistogram encoding a frequency of subfingerprint features for subfingerprints included in a subset of the plurality of accessed subfingerprints. A master histogram for the video is generated that encodes a frequency of subhistogram features for the plurality of generated subhistograms for the video. A hashing procedure is applied to the master histogram to produce the full-length fingerprint. Clustering can be performed on full-length video fingerprints for videos in a database to detect near-duplicate videos.
    Type: Grant
    Filed: June 21, 2012
    Date of Patent: September 10, 2013
    Assignee: Google Inc.
    Inventor: Sergey Ioffe
  • Patent number: 8509499
    Abstract: A method and system of identity masking to obscure identities corresponding to face regions in an image is disclosed. A face detector is applied to detect a set of possible face regions in the image. Then an identity masker is used to process the detected face regions by identity masking techniques in order to obscure identities corresponding to the regions. For example, a detected face region can be blurred as if it is in motion by a motion blur algorithm, such that the blurred region can not be recognized as the original identity. Or the detected face region can be replaced by a substitute facial image by a face replacement algorithm to obscure the corresponding identity.
    Type: Grant
    Filed: November 22, 2011
    Date of Patent: August 13, 2013
    Assignee: Google Inc.
    Inventors: Sergey Ioffe, Lance Williams, Dennis Strelow, Andrea Frome, Luc Vincent
  • Publication number: 20130204905
    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for receiving a hash vector r, a vector of locality-sensitive hash values, each hash value being an element of the hash vector r, each element having an index position; and generating a compact vector v corresponding to the hash vector r, wherein the compact vector v is a vector of compact elements each having an index position, wherein each compact element corresponds to the element of the hash vector r having the same index position, and wherein each compact element is a b-bit integer selected from the set of all b-bit integers {0, 1, . . . , 2b?1} based on the corresponding hash element.
    Type: Application
    Filed: February 7, 2012
    Publication date: August 8, 2013
    Applicant: GOOGLE INC.
    Inventor: Sergey Ioffe