Patents by Inventor Andrew E. Rubin

Andrew E. Rubin has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20200302941
    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for determining hotword suitability. In one aspect, a method includes receiving speech data that encodes a candidate hotword spoken by a user, evaluating the speech data or a transcription of the candidate hotword, using one or more predetermined criteria, generating a hotword suitability score for the candidate hotword based on evaluating the speech data or a transcription of the candidate hotword, using one or more predetermined criteria, and providing a representation of the hotword suitability score for display to the user.
    Type: Application
    Filed: June 3, 2020
    Publication date: September 24, 2020
    Applicant: Google LLC
    Inventors: Andrew E Rubin, Johan Schalkwyk, Maria Carolin Parada San Martin
  • Patent number: 10598790
    Abstract: The disclosed embodiments include a light detection and ranging (LIDAR) system. The LIDAR system includes a modular LIDAR device, which includes a scanner component and a structurally separate base component. The scanner component is mountable on an external surface of a vehicle, and includes a light source and detector to capture LIDAR data including a measure of a distance to an object relative to the vehicle. The scanner component also includes a communications transmitter to transmit LIDAR data indicative of the distance, and a power receiver to wirelessly power the scanner component. The base component is at least partially mountable on an interior surface of the vehicle, and includes a power transmitter to wirelessly power the scanner component, a communications receiver to wirelessly receive the LIDAR data, and a processor to enable autonomous or semi-autonomous navigation of the vehicle based on processed LIDAR data.
    Type: Grant
    Filed: February 17, 2018
    Date of Patent: March 24, 2020
    Assignee: ESSENTIAL PRODUCTS, INC.
    Inventor: Andrew E. Rubin
  • Patent number: 10591909
    Abstract: The embodiments include a handheld mobile device (HMD) operable to cause a subsystem of a vehicle to perform a vehicular operation associated with an existing capability of the subsystem. The HMD includes a processor, a port operable to communicatively couple the HMD to an existing on-board computer of a vehicle via an existing data link connector of the vehicle, and a wireless interface operable to communicatively couple the HMD to at least one of the vehicle or a remote service. The HMD further includes a memory storing a software application that, when executed by the processor, causes the HMD to communicate a command to the on-board computer via the data link connector to perform the vehicular operation associated with the existing capability of the subsystem.
    Type: Grant
    Filed: March 16, 2018
    Date of Patent: March 17, 2020
    Assignee: ESSENTIAL PRODUCTS, INC.
    Inventor: Andrew E. Rubin
  • Patent number: 10477017
    Abstract: Caller feedback in mobile devices, in which, upon receiving a telephone call from a caller, a user selection of a control is detected, and a message associated with the selected control is determined and automatically transmitted to the caller.
    Type: Grant
    Filed: June 19, 2015
    Date of Patent: November 12, 2019
    Assignee: Google LLC
    Inventors: Andrew E. Rubin, Wei Huang
  • Patent number: 10462259
    Abstract: In a computing system, information regarding a plurality of events that use a computing device is obtained, and a time-dependant increase in activity for each of at least some of the events is identified. An observed interest by a user in an event is correlated with an identified increase in activity for the event. Information about the activity at a time related to the event is provided for review by the user.
    Type: Grant
    Filed: August 15, 2017
    Date of Patent: October 29, 2019
    Assignee: Google LLC
    Inventors: Sumit Agarwal, Dipchand Nishar, Andrew E. Rubin
  • Publication number: 20190317635
    Abstract: Various embodiments concern sensors and other components that can be disposed beneath a variable transparency layer of a mobile device. By modifying how much voltage is applied to the variable transparency layer, a component, such as a camera, can be readily hidden when not in use. More specifically, the variable transparency layer may be substantially opaque when the camera is not in use and at least partially transparent when the camera is in use and ready to capture an image. The opacity level of the variable transparency layer can be modified by a voltage source that is electrically coupled to the variable transparency layer. The various levels of opacity could also enable the variable transparency layer to act as an electronic aperture for the camera.
    Type: Application
    Filed: June 24, 2019
    Publication date: October 17, 2019
    Inventors: David John Evans, V, Xinrui Jiang, Andrew E. Rubin, Matthew Hershenson, Xiaoyu Miao
  • Patent number: 10432872
    Abstract: Some embodiments include a mobile device with a light sensor overlaid under a display (e.g., a touchscreen). The mobile device can identify a command to capture an image. The mobile device can adjust at least a target portion of an opaqueness adjustable region of the display directly over the light sensor. The opaqueness adjustable region is capable of transforming from substantially opaque to substantially transparent. The mobile device can capture the image utilizing at least the light sensor while the target portion of the opaqueness adjustable region is substantially transparent.
    Type: Grant
    Filed: February 24, 2017
    Date of Patent: October 1, 2019
    Assignee: ESSENTIAL PRODUCTS, INC.
    Inventors: David John Evans, V, Xinrui Jiang, Andrew E. Rubin, Matthew Hershenson, Xiaoyu Miao, Joseph Anthony Tate, Jason Sean Gagne-Keats, Rebecca Schultz Zavin
  • Publication number: 20190287157
    Abstract: Introduced here are computer programs and associated computer-implemented techniques for developing, applying, and modifying location-aware purchasing algorithms that facilitate purchases of goods ordered using assistant devices. These purchasing algorithms can intelligently combine orders placed by multiple users to purchase the appropriate good(s) in bulk. Purchasing algorithms can take advantage of several benefits enabled by bulk ordering. For example, a purchasing algorithm may discover that some goods are available at lower prices as the number of items being ordered increases. As another example, a purchasing algorithm may discover that additional savings are available due to the increased efficiency of bulk delivery logistics.
    Type: Application
    Filed: May 18, 2018
    Publication date: September 19, 2019
    Inventors: Andrew E. Rubin, Niccolo De Masi
  • Patent number: 10380493
    Abstract: The present disclosure contemplates a variety of improved methods and systems for creating a unique user experience using an ambient operating system connected to a variety of disparate IoT devices. The described solution includes a curated scene or set of actions initiated by an assistant device. For example, the assistant device detects it is a weekday morning and initiates actions associated with the wakeup routine such as opening the blinds, making coffee and notifying the user of the current traffic report.
    Type: Grant
    Filed: May 24, 2017
    Date of Patent: August 13, 2019
    Assignee: ESSENTIAL PRODUCTS, INC.
    Inventors: Mara Clair Segal, Manuel Roman, Dwipal Desai, Andrew E. Rubin
  • Patent number: 10365932
    Abstract: The present disclosure contemplates a variety of improved methods and systems for controlling a variety of disparate home devices coupled to the framework and/or ambient operating system (AmbientOS). This home application programming interface (API) exposes the operation of the home devices in a natural and intuitive manner, facilitating control of unknown devices by high level commands. The home devices are contextually responsive to API commands. Additionally, the home application programming interface can customizing an application developed to control devices in an environment to control the devices in the environment via an assistant device with artificial intelligence (AI) capabilities.
    Type: Grant
    Filed: August 8, 2017
    Date of Patent: July 30, 2019
    Assignee: ESSENTIAL PRODUCTS, INC.
    Inventors: Manuel Roman, Mara Clair Segal, Dwipal Desai, Andrew E. Rubin
  • Patent number: 10360691
    Abstract: In one embodiment, a light sensor, such as a camera, records an image through the surface with the residue to produce a stained image. A processor associated with the camera identifies object outlines within the image using a machine learning model, and smooth the colors within the object outlines. In another embodiment, the light sensor is placed beneath a dual-mode region of a display containing the residue. The dual-mode region can be opaque and function as part of the display, or can be transparent and allow environment light to reach the light sensor. Initially, the processor determines the position of the residue by causing the dual-mode region to display a predetermined pattern, while the light sensor records the predetermined pattern. Using the determined position of the residue, the processor corrects the pixels within the residue in the recorded image, by interpolating the values of the pixels outside of the residue.
    Type: Grant
    Filed: November 22, 2017
    Date of Patent: July 23, 2019
    Assignee: ESSENTIAL PRODUCTS, INC.
    Inventors: David John Evans, V, Xinrui Jiang, Andrew E. Rubin, Matthew Hershenson, Xiaoyu Miao, Joseph Anthony Tate, Jason Sean Gagne-Keats
  • Patent number: 10359993
    Abstract: A contextual user interface based on environment is described. An assistant device can determine that speech has been spoken and determine the context of an environment of that speech. A user interface can then be generated based on the context of the environment and the content of the speech. Different context can result in different user interfaces being generated.
    Type: Grant
    Filed: May 4, 2017
    Date of Patent: July 23, 2019
    Assignee: ESSENTIAL PRODUCTS, INC.
    Inventors: Manuel Roman, Mara Clair Segal, Dwipal Desai, Andrew E. Rubin
  • Patent number: 10353842
    Abstract: Various embodiments concern techniques for intelligently switching between multiple sources of USB signals. More specifically, user devices are described that include a physical USB port for receiving a USB connector and one or more wireless transceivers that communicate with an accessory. The wireless transceiver(s) may communicate with the accessory using a USB-based protocol (e.g., Wireless USB). The user devices described herein can intelligently switch between these different sources of USB signals so that USB signals can be simultaneously or sequentially received from a peripheral (via the USB port) and an accessory (via the wireless transceiver(s)). In some embodiments, a switching routine is executed (e.g., by a processor or signal switch) that determines which peripheral and/or accessory is connected to a user device at a given point in time.
    Type: Grant
    Filed: December 6, 2017
    Date of Patent: July 16, 2019
    Assignee: ESSENTIAL PRODUCTS, INC.
    Inventors: Jason Sean Gagne-Keats, Andrew E. Rubin, David John Evans, V, Matthew Hershenson, Xiaoyu Miao, Xinrui Jiang, Joseph Anthony Tate
  • Patent number: 10355931
    Abstract: A home assistant device assisting with the setup and troubleshooting of devices is described. An assistant device can determine setup instructions for devices. The setup instructions for one device can be determined the technical aptitude of the user and assistant the user with setting up devices within their own technical abilities. The setup instructions can then be provided.
    Type: Grant
    Filed: July 5, 2017
    Date of Patent: July 16, 2019
    Assignee: ESSENTIAL PRODUCTS, INC.
    Inventors: Manuel Roman, Mara Clair Segal, Dwipal Desai, Andrew E. Rubin
  • Patent number: 10353480
    Abstract: The present disclosure contemplates a variety of improved methods and systems for enabling set up of a variety of disparate IoT devices coupled to the framework and/or ambient operating system of an assistant device. The described solution includes a voice-driven assistant device setup process. An assistant device can determine the IoT devices in its physical environment and provide setup instructions to the user. The setup including determining voice activatable commands, device information and the adapter to allow the assistant device to operate the one or more IoT devices in response to user instructions.
    Type: Grant
    Filed: May 24, 2017
    Date of Patent: July 16, 2019
    Assignee: ESSENTIAL PRODUCTS, INC.
    Inventors: Manuel Roman, Mara Clair Segal, Dwipal Desai, Andrew E. Rubin
  • Patent number: 10349224
    Abstract: Providing audio and/or video content from one user to a second user within an environment are described. An electronic device can receive conversational content from one user and determine that it is directed to a second user. The second user can be determined to be within another location of the environment (e.g., a different room of a house) and identify the capabilities of devices within the other location. Play back of the conversational content can then be performed using the identified devices within the other location.
    Type: Grant
    Filed: August 9, 2017
    Date of Patent: July 9, 2019
    Assignee: ESSENTIAL PRODUCTS, INC.
    Inventors: Mara Clair Segal, Manuel Roman, Dwipal Desai, Andrew E. Rubin
  • Patent number: 10339689
    Abstract: Presented here is technology to efficiently process camera images to generate artistic images and videos using an artificial intelligence module receiving inputs from multiple sensors. Multiple sensors can include a depth sensor, a conventional camera, and a motion tracker providing inputs to the artificial intelligence module. Based on the inputs, the artificial intelligence module can segment the received image and/or video into a foreground image and a background image to produce portrait imagery by blurring the background image and/or video. The artificial intelligence module can select the most aesthetically pleasing image from a video. In addition, the artificial intelligence module can adjust lighting in an image or video to create artistic lighting effects. All the processing can be done in real time due to efficient combination of artificial intelligence modules, traditional image processing techniques, and use of specialized hardware.
    Type: Grant
    Filed: October 31, 2018
    Date of Patent: July 2, 2019
    Assignee: ESSENTIAL PRODUCTS, INC.
    Inventors: Xiaoyu Miao, Andrew E. Rubin
  • Patent number: 10331260
    Abstract: Various embodiments concern sensors and other components that can be disposed beneath a variable transparency layer of a mobile device. By modifying how much voltage is applied to the variable transparency layer, a component, such as a camera, can be readily hidden when not in use. More specifically, the variable transparency layer may be substantially opaque when the camera is not in use and at least partially transparent when the camera is in use and ready to capture an image. The opacity level of the variable transparency layer can be modified by a voltage source that is electrically coupled to the variable transparency layer. The various levels of opacity could also enable the variable transparency layer to act as an electronic aperture for the camera.
    Type: Grant
    Filed: October 27, 2016
    Date of Patent: June 25, 2019
    Assignee: ESSENTIAL PRODUCTS, INC.
    Inventors: David John Evans, V, Xinrui Jiang, Andrew E. Rubin, Matthew Hershenson, Xiaoyu Miao
  • Patent number: D857644
    Type: Grant
    Filed: June 7, 2018
    Date of Patent: August 27, 2019
    Assignee: ESSENTIAL PRODUCTS, INC.
    Inventors: Jason Sean Gagne-Keats, David John Evans, V, Andrew E. Rubin, Clement Puertolas
  • Patent number: D869463
    Type: Grant
    Filed: June 1, 2017
    Date of Patent: December 10, 2019
    Assignee: ESSENTIAL PRODUCTS, INC.
    Inventors: Jason Sean Gagne-Keats, David John Evans, V, Manuel Roman, Mara Clair Segal, Dwipal Desai, Andrew E. Rubin