Patents by Inventor Andrew E. Rubin

Andrew E. Rubin has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11741970
    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for determining hotword suitability. In one aspect, a method includes receiving speech data that encodes a candidate hotword spoken by a user, evaluating the speech data or a transcription of the candidate hotword, using one or more predetermined criteria, generating a hotword suitability score for the candidate hotword based on evaluating the speech data or a transcription of the candidate hotword, using one or more predetermined criteria, and providing a representation of the hotword suitability score for display to the user.
    Type: Grant
    Filed: January 6, 2022
    Date of Patent: August 29, 2023
    Assignee: Google LLC
    Inventors: Andrew E. Rubin, Johan Schalkwyk, Maria Carolina Parada San Martin
  • Publication number: 20220130399
    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for determining hotword suitability. In one aspect, a method includes receiving speech data that encodes a candidate hotword spoken by a user, evaluating the speech data or a transcription of the candidate hotword, using one or more predetermined criteria, generating a hotword suitability score for the candidate hotword based on evaluating the speech data or a transcription of the candidate hotword, using one or more predetermined criteria, and providing a representation of the hotword suitability score for display to the user.
    Type: Application
    Filed: January 6, 2022
    Publication date: April 28, 2022
    Applicant: Google LLC
    Inventors: Andrew E. Rubin, Johan Schalkwyk, Maria Carolina Parada San Martin
  • Patent number: 11227611
    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for determining hotword suitability. In one aspect, a method includes receiving speech data that encodes a candidate hotword spoken by a user, evaluating the speech data or a transcription of the candidate hotword, using one or more predetermined criteria, generating a hotword suitability score for the candidate hotword based on evaluating the speech data or a transcription of the candidate hotword, using one or more predetermined criteria, and providing a representation of the hotword suitability score for display to the user.
    Type: Grant
    Filed: June 3, 2020
    Date of Patent: January 18, 2022
    Assignee: Google LLC
    Inventors: Andrew E. Rubin, Johan Schalkwyk, Maria Carolin Parada San Martin
  • Patent number: 11204621
    Abstract: Certain aspects of the technology disclosed herein integrate a camera with an electronic display. An electronic display includes several layers, such as a cover layer, a color filter layer, a display layer including light emitting diodes or organic light emitting diodes, a thin film transistor layer, etc. The camera can include a plurality of noncontiguous pixel regions disposed beneath the display layer and be configured to capture a plurality of images corresponding to the plurality of noncontiguous pixel regions. In some embodiments, the plurality of images can form a composite image with depth.
    Type: Grant
    Filed: May 17, 2021
    Date of Patent: December 21, 2021
    Assignee: Essential Products, Inc.
    Inventors: David John Evans, V, Xinrui Jiang, Andrew E. Rubin, Matthew Hershenson, Xiaoyu Miao, Joseph Anthony Tate, Jason Sean Gagne-Keats
  • Publication number: 20210271290
    Abstract: Certain aspects of the technology disclosed herein integrate a camera with an electronic display. An electronic display includes several layers, such as a cover layer, a color filter layer, a display layer including light emitting diodes or organic light emitting diodes, a thin film transistor layer, etc. The camera can include a plurality of noncontiguous pixel regions disposed beneath the display layer and be configured to capture a plurality of images corresponding to the plurality of noncontiguous pixel regions. In some embodiments, the plurality of images can form a composite image with depth.
    Type: Application
    Filed: May 17, 2021
    Publication date: September 2, 2021
    Inventors: David John EVANS, V, Xinrui JIANG, Andrew E. RUBIN, Matthew HERSHENSON, Xiaoyu MIAO, Joseph Anthony Tate, Jason Sean GAGNE-KEATS
  • Publication number: 20210232249
    Abstract: Various embodiments concern sensors and other components that can be disposed beneath a variable transparency layer of a mobile device. By modifying how much voltage is applied to the variable transparency layer, a component, such as a camera, can be readily hidden when not in use. More specifically, the variable transparency layer may be substantially opaque when the camera is not in use and at least partially transparent when the camera is in use and ready to capture an image. The opacity level of the variable transparency layer can be modified by a voltage source that is electrically coupled to the variable transparency layer. The various levels of opacity could also enable the variable transparency layer to act as an electronic aperture for the camera.
    Type: Application
    Filed: March 25, 2021
    Publication date: July 29, 2021
    Inventors: David John Evans, V, Xinrui Jiang, Andrew E. Rubin, Matthew Hershenson, Xiaoyu Miao
  • Patent number: 11042184
    Abstract: Certain aspects of the technology disclosed herein integrate a camera with an electronic display. An electronic display includes several layers, such as a cover layer, a color filter layer, a display layer including light emitting diodes or organic light emitting diodes, a thin film transistor layer, etc. In one embodiment, the layers include a substantially transparent region disposed above the camera. The substantially transparent region allows light from outside to reach the camera, enabling the camera to record an image. In another embodiment, the color filter layer does not include a substantially transparent region, and the camera records the light from the outside colored by the color filter layer. According to another embodiment, while none of the layers include a substantially transparent region, the layers are all substantially transparent, and the camera disposed beneath the layers records light reaching the camera from outside.
    Type: Grant
    Filed: November 22, 2017
    Date of Patent: June 22, 2021
    Assignee: ESSENTIAL PRODUCTS, INC.
    Inventors: David John Evans, V, Xinrui Jiang, Andrew E. Rubin, Matthew Hershenson, Xiaoyu Miao, Joseph Anthony Tate, Jason Sean Gagne-Keats
  • Patent number: 10986255
    Abstract: Various embodiments concern sensors and other components that can be disposed beneath a variable transparency layer of a mobile device. By modifying how much voltage is applied to the variable transparency layer, a component, such as a camera, can be readily hidden when not in use. More specifically, the variable transparency layer may be substantially opaque when the camera is not in use and at least partially transparent when the camera is in use and ready to capture an image. The opacity level of the variable transparency layer can be modified by a voltage source that is electrically coupled to the variable transparency layer. The various levels of opacity could also enable the variable transparency layer to act as an electronic aperture for the camera.
    Type: Grant
    Filed: June 24, 2019
    Date of Patent: April 20, 2021
    Assignee: ESSENTIAL PRODUCTS, INC.
    Inventors: David John Evans, V, Xinrui Jiang, Andrew E. Rubin, Matthew Hershenson, Xiaoyu Miao
  • Patent number: 10937216
    Abstract: Presented here is technology to efficiently process camera images to generate lead part artistic images and videos using an artificial intelligence module receiving inputs from multiple sensors. Multiple sensors can include a depth sensor, a conventional camera, and a motion tracker providing inputs to the artificial intelligence module. Based on the inputs, the artificial intelligence module can segment the received image and/or video into a foreground image and a background image to produce portrait imagery by blurring the background image and/or video. The artificial intelligence module can select the most aesthetically pleasing image from a video. In addition, the artificial intelligence module can adjust lighting in an image or video to create artistic lighting effects. All the processing can be done in real time due to efficient combination of artificial intelligence modules, traditional image processing techniques, and use of specialized hardware.
    Type: Grant
    Filed: February 1, 2019
    Date of Patent: March 2, 2021
    Assignee: ESSENTIAL PRODUCTS, INC.
    Inventors: Xiaoyu Miao, Andrew E. Rubin
  • Publication number: 20200302941
    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for determining hotword suitability. In one aspect, a method includes receiving speech data that encodes a candidate hotword spoken by a user, evaluating the speech data or a transcription of the candidate hotword, using one or more predetermined criteria, generating a hotword suitability score for the candidate hotword based on evaluating the speech data or a transcription of the candidate hotword, using one or more predetermined criteria, and providing a representation of the hotword suitability score for display to the user.
    Type: Application
    Filed: June 3, 2020
    Publication date: September 24, 2020
    Applicant: Google LLC
    Inventors: Andrew E Rubin, Johan Schalkwyk, Maria Carolin Parada San Martin
  • Patent number: 10598790
    Abstract: The disclosed embodiments include a light detection and ranging (LIDAR) system. The LIDAR system includes a modular LIDAR device, which includes a scanner component and a structurally separate base component. The scanner component is mountable on an external surface of a vehicle, and includes a light source and detector to capture LIDAR data including a measure of a distance to an object relative to the vehicle. The scanner component also includes a communications transmitter to transmit LIDAR data indicative of the distance, and a power receiver to wirelessly power the scanner component. The base component is at least partially mountable on an interior surface of the vehicle, and includes a power transmitter to wirelessly power the scanner component, a communications receiver to wirelessly receive the LIDAR data, and a processor to enable autonomous or semi-autonomous navigation of the vehicle based on processed LIDAR data.
    Type: Grant
    Filed: February 17, 2018
    Date of Patent: March 24, 2020
    Assignee: ESSENTIAL PRODUCTS, INC.
    Inventor: Andrew E. Rubin
  • Patent number: 10591909
    Abstract: The embodiments include a handheld mobile device (HMD) operable to cause a subsystem of a vehicle to perform a vehicular operation associated with an existing capability of the subsystem. The HMD includes a processor, a port operable to communicatively couple the HMD to an existing on-board computer of a vehicle via an existing data link connector of the vehicle, and a wireless interface operable to communicatively couple the HMD to at least one of the vehicle or a remote service. The HMD further includes a memory storing a software application that, when executed by the processor, causes the HMD to communicate a command to the on-board computer via the data link connector to perform the vehicular operation associated with the existing capability of the subsystem.
    Type: Grant
    Filed: March 16, 2018
    Date of Patent: March 17, 2020
    Assignee: ESSENTIAL PRODUCTS, INC.
    Inventor: Andrew E. Rubin
  • Patent number: 10477017
    Abstract: Caller feedback in mobile devices, in which, upon receiving a telephone call from a caller, a user selection of a control is detected, and a message associated with the selected control is determined and automatically transmitted to the caller.
    Type: Grant
    Filed: June 19, 2015
    Date of Patent: November 12, 2019
    Assignee: Google LLC
    Inventors: Andrew E. Rubin, Wei Huang
  • Patent number: 10462259
    Abstract: In a computing system, information regarding a plurality of events that use a computing device is obtained, and a time-dependant increase in activity for each of at least some of the events is identified. An observed interest by a user in an event is correlated with an identified increase in activity for the event. Information about the activity at a time related to the event is provided for review by the user.
    Type: Grant
    Filed: August 15, 2017
    Date of Patent: October 29, 2019
    Assignee: Google LLC
    Inventors: Sumit Agarwal, Dipchand Nishar, Andrew E. Rubin
  • Publication number: 20190317635
    Abstract: Various embodiments concern sensors and other components that can be disposed beneath a variable transparency layer of a mobile device. By modifying how much voltage is applied to the variable transparency layer, a component, such as a camera, can be readily hidden when not in use. More specifically, the variable transparency layer may be substantially opaque when the camera is not in use and at least partially transparent when the camera is in use and ready to capture an image. The opacity level of the variable transparency layer can be modified by a voltage source that is electrically coupled to the variable transparency layer. The various levels of opacity could also enable the variable transparency layer to act as an electronic aperture for the camera.
    Type: Application
    Filed: June 24, 2019
    Publication date: October 17, 2019
    Inventors: David John Evans, V, Xinrui Jiang, Andrew E. Rubin, Matthew Hershenson, Xiaoyu Miao
  • Patent number: 10432872
    Abstract: Some embodiments include a mobile device with a light sensor overlaid under a display (e.g., a touchscreen). The mobile device can identify a command to capture an image. The mobile device can adjust at least a target portion of an opaqueness adjustable region of the display directly over the light sensor. The opaqueness adjustable region is capable of transforming from substantially opaque to substantially transparent. The mobile device can capture the image utilizing at least the light sensor while the target portion of the opaqueness adjustable region is substantially transparent.
    Type: Grant
    Filed: February 24, 2017
    Date of Patent: October 1, 2019
    Assignee: ESSENTIAL PRODUCTS, INC.
    Inventors: David John Evans, V, Xinrui Jiang, Andrew E. Rubin, Matthew Hershenson, Xiaoyu Miao, Joseph Anthony Tate, Jason Sean Gagne-Keats, Rebecca Schultz Zavin
  • Publication number: 20190287157
    Abstract: Introduced here are computer programs and associated computer-implemented techniques for developing, applying, and modifying location-aware purchasing algorithms that facilitate purchases of goods ordered using assistant devices. These purchasing algorithms can intelligently combine orders placed by multiple users to purchase the appropriate good(s) in bulk. Purchasing algorithms can take advantage of several benefits enabled by bulk ordering. For example, a purchasing algorithm may discover that some goods are available at lower prices as the number of items being ordered increases. As another example, a purchasing algorithm may discover that additional savings are available due to the increased efficiency of bulk delivery logistics.
    Type: Application
    Filed: May 18, 2018
    Publication date: September 19, 2019
    Inventors: Andrew E. Rubin, Niccolo De Masi
  • Patent number: 10380493
    Abstract: The present disclosure contemplates a variety of improved methods and systems for creating a unique user experience using an ambient operating system connected to a variety of disparate IoT devices. The described solution includes a curated scene or set of actions initiated by an assistant device. For example, the assistant device detects it is a weekday morning and initiates actions associated with the wakeup routine such as opening the blinds, making coffee and notifying the user of the current traffic report.
    Type: Grant
    Filed: May 24, 2017
    Date of Patent: August 13, 2019
    Assignee: ESSENTIAL PRODUCTS, INC.
    Inventors: Mara Clair Segal, Manuel Roman, Dwipal Desai, Andrew E. Rubin
  • Patent number: D857644
    Type: Grant
    Filed: June 7, 2018
    Date of Patent: August 27, 2019
    Assignee: ESSENTIAL PRODUCTS, INC.
    Inventors: Jason Sean Gagne-Keats, David John Evans, V, Andrew E. Rubin, Clement Puertolas
  • Patent number: D869463
    Type: Grant
    Filed: June 1, 2017
    Date of Patent: December 10, 2019
    Assignee: ESSENTIAL PRODUCTS, INC.
    Inventors: Jason Sean Gagne-Keats, David John Evans, V, Manuel Roman, Mara Clair Segal, Dwipal Desai, Andrew E. Rubin