Patents by Inventor Vincent Vanhoucke

Vincent Vanhoucke has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 9240184
    Abstract: A method and system for frame-level merging of HMM state predictions determined by different techniques is disclosed. An audio input signal may be transformed into a first and second sequence of feature vector, the sequences corresponding to each other and to a temporal sequence of frames of the audio input signal on a frame-by-frame basis. The first sequence may be processed by a neural network (NN) to determine NN-based state predictions, and the second sequence may be processed by a Gaussian mixture model (GMM) to determine GMM-based state predictions. The NN-based and GMM-based state predictions may be merged as weighted sums for each of a plurality of HMM state on a frame-by-frame basis to determine merged state predictions. The merged state predictions may then be applied to the HMMs to speech content of the audio input signal.
    Type: Grant
    Filed: February 12, 2013
    Date of Patent: January 19, 2016
    Assignee: Google Inc.
    Inventors: Hui Lin, Xin Lei, Vincent Vanhoucke
  • Patent number: 9171013
    Abstract: An embodiment provides for enabling retrieval of a collection of captured images that form at least a portion of a library of images. For each image in the collection, a captured image may be analyzed to recognize information from image data contained in the captured image, and an index may be generated, where the index data is based on the recognized information. Using the index, functionality such as search and retrieval is enabled. Various recognition techniques, including those that use the face, clothing, apparel, and combinations of characteristics may be utilized. Recognition may be performed on, among other things, persons and text carried on objects.
    Type: Grant
    Filed: January 13, 2014
    Date of Patent: October 27, 2015
    Assignee: Google Inc.
    Inventors: Salih Burak Gokturk, Dragomir Anguelov, Vincent Vanhoucke, Kuang-chih Lee, Diem Vu, Danny Yang, Munjal Shah, Azhar Khan
  • Patent number: 9082162
    Abstract: A system includes an image analysis module that is configured to programmatically analyze individual images in a collection of images in order to determine information about each image in the collection. The system may also include a manual interface that is configured to (i) interface with one or more human editors, and (ii) displays a plurality of panels concurrently. Individual panels may be provided for one or more analyzed images, and individual panels may be configured to display information that is at least indicative of the one or more images of that panel and/or of the information determined from the one or more images.
    Type: Grant
    Filed: September 14, 2012
    Date of Patent: July 14, 2015
    Assignee: Google Inc.
    Inventors: Salih Burak Gokturk, Baris Sumengen, Diem Vu, Navneet Dalal, Danny Yang, Xiaofan Lin, Azhar Khan, Munjal Shah, Dragomir Anguelov, Lorenzo Torresani, Vincent Vanhoucke
  • Patent number: 9047654
    Abstract: An image-based content item is analyzed to determine one or more interests of a viewer of the content item. The analysis may include performing image analysis on the content item to determine geographic information that is relevant to an image of the content item. The one or more interests may be determined based on an assumption or probabilistic conclusion about a subject of the content item. Further, the one or more interests may be determined by applying one or more rules that utilize the geographic information. For some embodiments, a supplemental content item may be provided to the viewer based on the one or more interests.
    Type: Grant
    Filed: April 8, 2013
    Date of Patent: June 2, 2015
    Assignee: Google Inc.
    Inventors: Vincent Vanhoucke, Salih Burak Gokturk, Munjal Shah, Julie Baumgartner
  • Patent number: 9008435
    Abstract: Embodiments enable searching of portions of objects in images, including programmatically analyzing each image in a collection in order to determine image data that, for individual images in the collection, represents one or more visual characteristics of a portion of an object shown in that image. A user is enabled to specify one or more search criteria that includes image data, and a search result may be determined based on one or more images in the collection that show a corresponding object that has a portion that satisfies a threshold. The threshold is defined at least in part by the one or more search criteria.
    Type: Grant
    Filed: September 14, 2012
    Date of Patent: April 14, 2015
    Assignee: Google Inc.
    Inventors: Salih Burak Gokturk, Baris Sumengen, Diem Vu, Navneet Dalal, Danny Yang, Xiaofan Lin, Azhar Khan, Munjal Shah, Dragomir Anguelov, Lorenzo Torresani, Vincent Vanhoucke
  • Patent number: 8989451
    Abstract: A similarity search may be performed on the image of a person, using visual characteristics and information that is known about the person. The search identifies images of other persons that are similar in appearance to the person in the image.
    Type: Grant
    Filed: September 14, 2012
    Date of Patent: March 24, 2015
    Assignee: Google Inc.
    Inventors: Vincent Vanhoucke, Salih Burak Gokturk, Dragomir Anguelov, Kuang-chih Lee, Munjal Shah, Ashwin Tengli
  • Publication number: 20140369626
    Abstract: An embodiment provides for enabling retrieval of a collection of captured images that form at least a portion of a library of images. For each image in the collection, a captured image may be analyzed to recognize information from image data contained in the captured image, and an index may be generated, where the index data is based on the recognized information. Using the index, functionality such as search and retrieval is enabled. Various recognition techniques, including those that use the face, clothing, apparel, and combinations of characteristics may be utilized. Recognition may be performed on, among other things, persons and text carried on objects.
    Type: Application
    Filed: January 13, 2014
    Publication date: December 18, 2014
    Inventors: Salih Burak Gokturk, Dragomir Anguelov, Vincent Vanhoucke, Kuang-chih Lee, Diem Vu, Danny Yang, Munjal Shah, Azhar Khan
  • Patent number: 8897505
    Abstract: An embodiment provides for enabling retrieval of a collection of captured images that form at least a portion of a library of images. For each image in the collection, a captured image may be analyzed to recognize information from image data contained in the captured image, and an index may be generated, where the index data is based on the recognized information. Using the index, functionality such as search and retrieval is enabled. Various recognition techniques, including those that use the face, clothing, apparel, and combinations of characteristics may be utilized. Recognition may be performed on, among other things, persons and text carried on objects.
    Type: Grant
    Filed: September 13, 2012
    Date of Patent: November 25, 2014
    Assignee: Google Inc.
    Inventors: Salih Burak Gokturk, Dragomir Anguelov, Vincent Vanhoucke, Kuang-Chih Lee, Diem Vu, Danny Yang, Munjal Shah, Azhar Khan
  • Patent number: 8732025
    Abstract: Images are analyzed by programmatic mechanisms for assessing one or more remote web pages to retrieve content on display at remote web pages. The retrieved images may be analyzed to determine information about an object shown in a corresponding images of the content on display. At least a portion of the object shown in the corresponding image of the content on display may be made selectable and associated with the determined information. This determined information may subsequently be used, in for example, search applications.
    Type: Grant
    Filed: July 13, 2007
    Date of Patent: May 20, 2014
    Assignee: Google Inc.
    Inventors: Salih Burak Gokturk, Dan Chiao, Jacquie Phillips, Mark Moran, Vincent Vanhoucke, Azhar Khan, Xiaofan Lin, Munjal Shah, Andrew Miller, Navneet Dalal, Diem Vu
  • Patent number: 8732030
    Abstract: Embodiments described herein provide a system and method for providing merchandise items at a network site. According to an embodiment, an image of a merchandise item is obtained. The image is programmatically analyzed to determine information about the merchandise item. The information is used to generate a presentation that includes the merchandise item.
    Type: Grant
    Filed: February 16, 2012
    Date of Patent: May 20, 2014
    Assignee: Google Inc.
    Inventors: Salih Burak Gokturk, Baris Sumengen, Diem Vu, Navneet Dalal, Danny Yang, Xiaofan Lin, Azhar Khan, Munjal Shah, Dragomir Anguelov, Lorenzo Torresani, Vincent Vanhoucke
  • Patent number: 8712862
    Abstract: Images are analyzed by programmatic mechanisms for accessing one or more remote web pages to retrieve content on display at the remote web pages. The retrieved images may be analyzed to determine information about an object shown in a corresponding image of the content on display. At least a portion of the object shown in the corresponding image of the content on display may be made selectable and associated with the determined information. This determined information may subsequently be used, in for example, search applications.
    Type: Grant
    Filed: September 14, 2012
    Date of Patent: April 29, 2014
    Assignee: Google Inc.
    Inventors: Salih Burak Gokturk, Dan Chiao, Jacquie Phillips, Mark Moran, Vincent Vanhoucke, Azhar Khan, Xiaofan Lin, Munjal Shah, Andrew Miller, Navneet Dalal, Diem Vu
  • Patent number: 8649572
    Abstract: An embodiment provides for enabling retrieval of a collection of captured images that form at least a portion of a library of images. For each image in the collection, a captured image may be analyzed to recognize information from image data contained in the captured image, and an index may be generated, where the index data is based on the recognized information. Using the index, functionality such as search and retrieval is enabled. Various recognition techniques, including those that use the face, clothing, apparel, and combinations of characteristics may be utilized. Recognition may be performed on, among other things, persons and text carried on objects.
    Type: Grant
    Filed: February 27, 2009
    Date of Patent: February 11, 2014
    Assignee: Google Inc.
    Inventors: Salih Burak Gokturk, Dragomir Anguelov, Vincent Vanhoucke, Kuang-Chih Lee, Diem Vu, Danny Yang, Munjal Shah, Azhar Khan
  • Patent number: 8630493
    Abstract: Embodiments described herein facilitate or enhance the implementation of image recognition processes which can perform recognition on images to identify objects and/or faces by class or by people.
    Type: Grant
    Filed: December 7, 2010
    Date of Patent: January 14, 2014
    Assignee: Google Inc.
    Inventors: Salih Burak Gokturk, Dragomir Anguelov, Lorenzo Torresani, Vincent Vanhoucke, Munjal Shah, Diem Vu, Kuang-Chih Lee
  • Patent number: 8630513
    Abstract: An embodiment provides for enabling retrieval of a collection of captured images that form at least a portion of a library of images. For each image in the collection, a captured image may be analyzed to recognize information from image data contained in the captured image, and an index may be generated, where the index data is based on the recognized information. Using the index, functionality such as search and retrieval is enabled. Various recognition techniques, including those that use the face, clothing, apparel, and combinations of characteristics may be utilized. Recognition may be performed on, among other things, persons and text carried on objects.
    Type: Grant
    Filed: February 10, 2012
    Date of Patent: January 14, 2014
    Assignee: Google Inc.
    Inventors: Salih Burak Gokturk, Dragomir Anguelov, Vincent Vanhoucke, Kuang-Chih Lee, Diem Vu, Danny Yang, Munjal Shah, Azhar Khan
  • Patent number: 8571272
    Abstract: Embodiments described herein facilitate or enhance the implementation of image recognition processes which can perform recognition on images to identify objects and/or faces by class or by people.
    Type: Grant
    Filed: March 12, 2007
    Date of Patent: October 29, 2013
    Assignee: Google Inc.
    Inventors: Salih Burak Gokturk, Dragomir Anguelov, Lorenzo Torresani, Vincent Vanhoucke, Munjal Shah, Diem Vu, Kuang-Chih Lee
  • Patent number: 8484022
    Abstract: A method and system for adaptive auto-encoders is disclosed. An input audio training signal may be transformed into a sequence of feature vectors, each bearing quantitative measures of acoustic properties of the input audio training signal. An auto-encoder may process the feature vectors to generate an encoded form of the quantitative measures, and a recovered form of the quantitative measures based on an inverse operation by the auto-encoder on the encoded form of the quantitative measures. A duplicate copy of the sequence of feature vectors may be normalized to form a normalized signal in which supra-phonetic acoustic properties are reduced in comparison with phonetic acoustic properties of the input audio training signal. The auto-encoder may then be trained to compensate for supra-phonetic features by reducing the magnitude of an error signal corresponding to a difference between the normalized signal and the recovered form of the quantitative measures.
    Type: Grant
    Filed: July 27, 2012
    Date of Patent: July 9, 2013
    Assignee: Google Inc.
    Inventor: Vincent Vanhoucke
  • Publication number: 20130136319
    Abstract: A similarity search may be performed on the image of a person, using visual characteristics and information that is known about the person. The search identifies images of other persons that are similar in appearance to the person in the image.
    Type: Application
    Filed: September 14, 2012
    Publication date: May 30, 2013
    Inventors: Vincent Vanhoucke, Salih Burak Gokturk, Dragomir Anguelov, Kuang-chih Lee, Munjal Shah, Ashwin Tengli
  • Publication number: 20130132236
    Abstract: Images are analyzed by programmatic mechanisms for accessing one or more remote web pages to retrieve content on display at the remote web pages. The retrieved images may be analyzed to determine information about an object shown in a corresponding image of the content on display. At least a portion of the object shown in the corresponding image of the content on display may be made selectable and associated with the determined information. This determined information may subsequently be used, in for example, search applications.
    Type: Application
    Filed: September 14, 2012
    Publication date: May 23, 2013
    Inventors: Salih Burak Gokturk, Dan Chiao, Jacquie Phillips, Mark Moran, Vincent Vanhoucke, Azhar Khan, Xiaofan Lin, Munjal Shah, Andrew Miller, Navneet Dalal, Diem Vu
  • Publication number: 20130127893
    Abstract: A system includes an image analysis module that is configured to programmatically analyze individual images in a collection of images in order to determine information about each image in the collection. The system may also include a manual interface that is configured to (i) interface with one or more human editors, and (ii) displays a plurality of panels concurrently. Individual panels may be provided for one or more analyzed images, and individual panels may be configured to display information that is at least indicative of the one or more images of that panel and/or of the information determined from the one or more images.
    Type: Application
    Filed: September 14, 2012
    Publication date: May 23, 2013
    Inventors: Salih Burak Gokturk, Baris Sumengen, Diem Vu, Navneet Dalal, Danny Yang, Xiaofan Lin, Azhar Khan, Munjal Shah, Dragomir Anguelov, Lorenzo Torresani, Vincent Vanhoucke
  • Publication number: 20130121571
    Abstract: Embodiments enable searching of portions of objects in images, including programmatically analyzing each image in a collection in order to determine image data that, for individual images in the collection, represents one or more visual characteristics of a portion of an object shown in that image. A user is enabled to specify one or more search criteria that includes image data, and a search result may be determined based on one or more images in the collection that show a corresponding object that has a portion that satisfies a threshold. The threshold is defined at least in part by the one or more search criteria.
    Type: Application
    Filed: September 14, 2012
    Publication date: May 16, 2013
    Inventors: Salih Burak Gokturk, Baris Sumengen, Diem Vu, Navneet Dalal, Danny Yang, Xiaofan Lin, Azhar Khan, Munjal Shah, Dragomir Anguelov, Lorenzo Torresani, Vincent Vanhoucke