Patents by Inventor Andrew E. Rubin

Andrew E. Rubin has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • HOME DEVICE APPLICATION PROGRAMMING INTERFACE
    Publication number: 20180210710
    Abstract: The present disclosure contemplates a variety of improved methods and systems for enabling developers to program and control a variety of disparate devices coupled to the framework and/or ambient operating system. The Home API can expose operation of the devices in a natural and intuitive manner, facilitating control of unknown devices by high-level commands.
    Type: Application
    Filed: August 2, 2017
    Publication date: July 26, 2018
    Inventors: Manuel Roman, Mara Clair Segal, Dwipal Desai, Andrew E. Rubin
  • KEYWORD DRIVEN VOICE INTERFACE
    Publication number: 20180210701
    Abstract: Keyword driven voice interfaces are described. An assistant device can provide a graphical user interface (GUI) on a display screen. The GUI can be adjusted based on receiving voice input (e.g., speech) having a keyword representing an action to perform the adjustment.
    Type: Application
    Filed: May 19, 2017
    Publication date: July 26, 2018
    Inventors: Mara Clair Segal, Manuel Roman, Dwipal Desai, Andrew E. Rubin
  • PRIVACY CONTROL IN A CONNECTED ENVIRONMENT
    Publication number: 20180211657
    Abstract: Privacy control in a connected environment is described. An assistant device can detect speech spoken by a user. The speech can include a hardware activation phrase that indicates whether the user intends for at least a portion of the speech to be provided to local resources or cloud resources. The speech can then be provided to the appropriate resource based on the hardware activation phrase.
    Type: Application
    Filed: May 4, 2017
    Publication date: July 26, 2018
    Inventors: Mara Clair Segal, Manuel Roman, Dwipal Desai, Andrew E. Rubin
  • MEDIA AND COMMUNICATIONS IN A CONNECTED ENVIRONMENT
    Publication number: 20180213009
    Abstract: Facilitating communication between assistant devices is described. A method or an electronic device can determine an assistant device closest to the user can allow other users to contact said user via that assistant device. In one example, a user can use a an assistant device to have a conversation with others by communicating over a communication link established with a network outside of the user's environment.
    Type: Application
    Filed: August 9, 2017
    Publication date: July 26, 2018
    Inventors: Mara Clair Segal, Manuel Roman, Dwipal Desai, Andrew E. Rubin
  • DYNAMIC APPLICATION CUSTOMIZATION FOR AUTOMATED ENVIRONMENTS
    Publication number: 20180210740
    Abstract: The present disclosure contemplates a variety of improved methods and systems for controlling a variety of disparate home devices coupled to the framework and/or ambient operating system (AmbientOS). This home application programming interface (API) exposes the operation of the home devices in a natural and intuitive manner, facilitating control of unknown devices by high level commands. The home devices are contextually responsive to API commands. Additionally, the home application programming interface can customizing an application developed to control devices in an environment to control the devices in the environment via an assistant device with artificial intelligence (AI) capabilities.
    Type: Application
    Filed: August 8, 2017
    Publication date: July 26, 2018
    Inventors: Manuel Roman, Mara Clair Segal, Dwipal Desai, Andrew E. Rubin
  • INTENT DRIVEN SOLUTIONS IN CONNECTED ENVIRONMENTS
    Publication number: 20180211151
    Abstract: Implementing functionality corresponding to an intent of speech is described. An assistant device can detect speech spoken within its environment. The assistant device can determine that the speech includes verbal content representing an intention regarding functionality within the environment. Devices capable of providing the functionality can be identified and used to provide that functionality.
    Type: Application
    Filed: May 19, 2017
    Publication date: July 26, 2018
    Inventors: Manuel Roman, Mara Clair Segal, Dwipal Desai, Andrew E. Rubin
  • AMBIENT ASSISTANT DEVICE
    Publication number: 20180211659
    Abstract: Ambient assistance is described. An assistant device can operate in an active experience mode in which a response to a user's speech is provided if it includes a hardware activation phrase. Based on characteristics of the environment, the mode can be adjusted to a passive experience mode in which a response to speech is provided even if it does not include the hardware activation phrase.
    Type: Application
    Filed: May 18, 2017
    Publication date: July 26, 2018
    Inventors: Mara Clair Segal, Manuel Roman, Dwipal Desai, Andrew E. Rubin
  • CONTEXTUAL USER INTERFACE BASED ON MEDIA PLAYBACK
    Publication number: 20180213291
    Abstract: A contextual user interface based on playback of media content is described. An assistant device can determine that a display device (e.g., television) within its environment is playing back media content on different channels. The channels being switched among can be provided to a server, which can provide back information regarding the media content being played back on those channels. The assistant device can then generate buttons on the user interface providing the information regarding the media content and also causing the display device to switch channels upon their selection.
    Type: Application
    Filed: August 10, 2017
    Publication date: July 26, 2018
    Inventors: Manuel Roman, Mara Clair Segal, Dwipal Desai, Andrew E. Rubin
  • CONTEXTUAL USER INTERFACE BASED ON ENVIRONMENT
    Publication number: 20180210700
    Abstract: A contextual user interface based on environment is described. An assistant device can determine that speech has been spoken and determine the context of an environment of that speech. A user interface can then be generated based on the context of the environment and the content of the speech. Different context can result in different user interfaces being generated.
    Type: Application
    Filed: May 4, 2017
    Publication date: July 26, 2018
    Inventors: Manuel Roman, Mara Clair Segal, Dwipal Desai, Andrew E. Rubin
  • CONTEXTUAL USER INTERFACE BASED ON MEDIA PLAYBACK
    Publication number: 20180213290
    Abstract: A contextual user interface based on playback of media content is described. An assistant device can determine that a display device (e.g., television) within its environment is playing back media content on different channels. The channels being watched can be provided to a server, which can provide back information regarding the media content being played back on those channels. The assistant device can then generate buttons on the user interface providing the information regarding the media content and also causing the display device to switch channels upon their selection.
    Type: Application
    Filed: May 19, 2017
    Publication date: July 26, 2018
    Inventors: Manuel Roman, Mara Clair Segal, Dwipal Desai, Andrew E. Rubin
  • Home device application programming interface
    Patent number: 10031727
    Abstract: The present disclosure contemplates a variety of improved methods and systems for enabling developers to program and control a variety of disparate devices coupled to the framework and/or ambient operating system. The Home API can expose operation of the devices in a natural and intuitive manner, facilitating control of unknown devices by high-level commands.
    Type: Grant
    Filed: September 5, 2017
    Date of Patent: July 24, 2018
    Assignee: ESSENTIAL PRODUCTS, INC.
    Inventors: Manuel Roman, Mara Clair Segal, Dwipal Desai, Andrew E. Rubin
  • MANAGEMENT OF NETWORK DEVICES BASED ON CHARACTERISTICS
    Publication number: 20180205602
    Abstract: Management of devices on a wireless network is described. An assistant device can determine that a device is missing configuration settings to access resources within a connected environment. Characteristics of that device can be determined and configuration settings to a selection of the resources can be provided based on the characteristics.
    Type: Application
    Filed: May 4, 2017
    Publication date: July 19, 2018
    Inventors: Manuel Roman, Mara Clair Segal, Dwipal Desai, Andrew E. Rubin
  • Display cover mounting
    Patent number: 10021226
    Abstract: Techniques are described for mounting a display and/or display cover to a housing of a display device, such as a mobile phone. In an embodiment, the housing and display cover include chamfered edges at complementary angles to allow for an “edge-to-edge” display. The display cover and housing are affixed to each other at the chamfered edges using curable liquid adhesive.
    Type: Grant
    Filed: January 20, 2017
    Date of Patent: July 10, 2018
    Assignee: ESSENTIAL PRODUCTS, INC.
    Inventors: Jason Sean Gagne-Keats, Matthew Hershenson, Xinrui Jiang, Xiaoyu Miao, Andrew E. Rubin, Joseph Anthony Tate, David John Evans, V, Rebecca Schultz Zavin
  • Expanding a set of commands to control devices in an environment
    Patent number: 10013979
    Abstract: The present disclosure contemplates a variety of methods and systems for enabling users to automatically expand the set of commands a user can issue. An assistant device can receive a user instruction via microphone and determine a voice activatable command and device description. The assistant device can then identify that no adapter associated with the voice activatable command and device description is available. The user can be prompted to provide a second voice activatable command or a second device description which can then be used to identify an adapter. The assistant device can store the voice activatable command or the device description in association with the identified adapter.
    Type: Grant
    Filed: May 24, 2017
    Date of Patent: July 3, 2018
    Assignee: ESSENTIAL PRODUCTS, INC.
    Inventors: Manuel Roman, Mara Clair Segal, Dwipal Desai, Andrew E. Rubin
  • Determining hotword suitability
    Patent number: 10002613
    Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for determining hotword suitability. In one aspect, a method includes receiving speech data that encodes a candidate hotword spoken by a user, evaluating the speech data or a transcription of the candidate hotword, using one or more predetermined criteria, generating a hotword suitability score for the candidate hotword based on evaluating the speech data or a transcription of the candidate hotword, using one or more predetermined criteria, and providing a representation of the hotword suitability score for display to the user.
    Type: Grant
    Filed: January 20, 2016
    Date of Patent: June 19, 2018
    Assignee: Google LLC
    Inventors: Andrew E. Rubin, Johan Schalkwyk, Maria Carolina Parada San Martin
  • Apparatus and method to maximize the display area of a mobile device
    Patent number: 9998642
    Abstract: The technology disclosed here maximizes the size of the display area associated with the mobile device by various camera placement. In one embodiment, the camera is placed inside the mobile device, and can pop outside the mobile device when the camera is activated. When the camera is inactive the camera retracts inside the mobile device, and becomes unnoticeable to the user. In another embodiment, the camera is integrated into the mobile device display as a camera icon. The integrated camera serves two purposes: to record pictures, and to act as a camera icon, that when selected activates the camera. By removing the camera from the front side of the mobile device, or by integrating the camera into the display screen of the mobile device, the size of the mobile device display screen can be increased.
    Type: Grant
    Filed: July 14, 2017
    Date of Patent: June 12, 2018
    Assignee: ESSENTIAL PRODUCTS, INC.
    Inventors: David John Evans, V, Xinrui Jiang, Andrew E. Rubin, Matthew Hershenson, Xiaoyu Miao
  • Electronic display with a relief
    Patent number: 9996158
    Abstract: Introduced here are methods and systems to create a relief on an electronic display. In one embodiment, the relief is created by micro-electromechanical systems (MEMS) placed above a cover layer of the electronic display. Each MEMS when activated can protrude or depress, thus creating the relief on the electronic display. In another embodiment, the relief is created by a plurality of resistors placed beneath the cover layer. The cover layer is made out of an elastically deformable material that, when heated, expands, thus creating a protrusion on the electronic display. Each resistor when activated heats a section of the cover layer, causing the cover layer to protrude.
    Type: Grant
    Filed: May 2, 2017
    Date of Patent: June 12, 2018
    Assignee: ESSENTIAL PRODUCTS, INC.
    Inventors: David John Evans, V, Andrew E. Rubin, Xinrui Jiang, Xiaoyu Miao, Joseph Anthony Tate, Matthew Hershenson, Jason Sean Gagne-Keats, Michael Kolb
  • WIRELESS ACCESSORY BUS FOR ELECTRONIC DEVICES
    Publication number: 20180159580
    Abstract: Various embodiments concern a wireless accessory bus for a user device that enables accessories to be easily and securely attached to the user device. More specifically, the wireless accessory bus enables data to be wirelessly transmitted between the accessory and the user device when the accessory and the user device are located within close proximity to one another (e.g., when the accessory is securely attached to the wireless accessory bus). Power could also be wirelessly transferred from the user device to the accessory (or vice versa). In some embodiments, the user device includes fastening component(s) (e.g., magnets) that allow the user device and the accessory to be magnetically secured to one another. The accessory typically enables the user device to readily utilize a new functionality or an improvement to an existing functionality.
    Type: Application
    Filed: February 1, 2018
    Publication date: June 7, 2018
    Inventors: David John Evans, V, Xinrui Jiang, Andrew E. Rubin, Matthew Hershenson, Xiaoyu Miao
  • Deformable lens
    Patent number: 9989757
    Abstract: Disclosed here are methods and systems to vary geometry of an optical lens, so that a single lens can assume various geometries, and change from a portrait lens, to a standard lens, to a wide-angle lens, to a fisheye lens, etc. The lens is made out of piecewise linear elements of polygonal shape, that can move in relation to forcing members laid out on a plane. The forcing members can exert a force on the corresponding piecewise linear elements to cause them to move in relation to the forcing members. The force can be electrical, magnetic, mechanical, etc. As a result, the optical lens can assume various shapes such as concave, convex, and planar.
    Type: Grant
    Filed: July 20, 2017
    Date of Patent: June 5, 2018
    Assignee: ESSENTIAL PRODUCTS, INC.
    Inventors: David John Evans, V, Xinrui Jiang, Andrew E. Rubin, Matthew Hershenson, Xiaoyu Miao, Joseph Anthony Tate, Jason Sean Gagne-Keats
  • Assistant for management of network devices
    Patent number: 9985846
    Abstract: Management of devices on a wireless network is described. An assistant device can determine how a user used resources and/or devices outside of an environment. Based on how the user used those resources and/or devices, configuration settings of local devices within the environment can be updated to provide new resources or settings.
    Type: Grant
    Filed: June 14, 2017
    Date of Patent: May 29, 2018
    Assignee: ESSENTIAL PRODUCTS, INC.
    Inventors: Manuel Roman, Mara Clair Segal, Dwipal Desai, Andrew E. Rubin