Patents by Inventor Andrew E. Rubin

Andrew E. Rubin has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 10057125
    Abstract: The present disclosure contemplates a variety of improved methods and systems for enabling users to set up and manage a variety of disparate IoT devices coupled to the framework and/or ambient operating system of an assistant device. The described solution includes a voice-driven assistant device setup process. An assistant device can determine the IoT devices in its physical environment and provide setup instructions to the user. The assistant device can further capture user responses and use the captured responses to connect to and manage/troubleshoot/control the IoT devices.
    Type: Grant
    Filed: May 4, 2017
    Date of Patent: August 21, 2018
    Assignee: ESSENTIAL PRODUCTS, INC.
    Inventors: Manuel Roman, Mara Clair Segal, Dwipal Desai, Andrew E. Rubin
  • Patent number: 10050835
    Abstract: Management of devices on a wireless network is described. An assistant device can determine that a device is missing configuration settings to access resources within a connected environment. Characteristics of that device can be determined and configuration settings to a selection of the resources can be provided based on the characteristics.
    Type: Grant
    Filed: May 4, 2017
    Date of Patent: August 14, 2018
    Assignee: ESSENTIAL PRODUCTS, INC.
    Inventors: Manuel Roman, Mara Clair Segal, Dwipal Desai, Andrew E. Rubin
  • Publication number: 20180213291
    Abstract: A contextual user interface based on playback of media content is described. An assistant device can determine that a display device (e.g., television) within its environment is playing back media content on different channels. The channels being switched among can be provided to a server, which can provide back information regarding the media content being played back on those channels. The assistant device can then generate buttons on the user interface providing the information regarding the media content and also causing the display device to switch channels upon their selection.
    Type: Application
    Filed: August 10, 2017
    Publication date: July 26, 2018
    Inventors: Manuel Roman, Mara Clair Segal, Dwipal Desai, Andrew E. Rubin
  • Publication number: 20180213286
    Abstract: A contextual user interface based on shared activities is described. An assistant device can determine that a display device (e.g., television) within its environment is playing back media content via a channel watched by a user. The channel being watched can be provided to a server, which can provide back information regarding the media content being played back on that channel. Additionally, another user of another assistant device can be determined to be watching the same or a similar channel. The assistant device can then be provided video content for a video chat with the other user.
    Type: Application
    Filed: May 24, 2017
    Publication date: July 26, 2018
    Inventors: Manuel Roman, Mara Clair Segal, Dwipal Desai, Andrew E. Rubin
  • Publication number: 20180213448
    Abstract: Switching the providing of a conversation among communication links is described. An electronic device can determine that a mobile device is being used to provide a conversation (e.g., a phone call) using a first communication link. The mobile device can enter an environment that includes a second communication link. The conversation can be switched to the second communication link that provides more content than the first communication link (e.g., audio and visual content rather than just audio content).
    Type: Application
    Filed: May 18, 2017
    Publication date: July 26, 2018
    Inventors: Mara Clair Segal, Manuel Roman, Dwipal Desai, Andrew E. Rubin
  • Publication number: 20180210711
    Abstract: The present disclosure contemplates a variety of improved methods and systems for enabling developers to program and control a variety of disparate devices coupled to the framework and/or ambient operating system. The Home API can expose operation of the devices in a natural and intuitive manner, facilitating control of unknown devices by high-level commands.
    Type: Application
    Filed: September 5, 2017
    Publication date: July 26, 2018
    Inventors: Manuel Roman, Mara Clair Segal, Dwipal Desai, Andrew E. Rubin
  • Publication number: 20180211658
    Abstract: Ambient assistance is described. An assistant device can detect speech in its environment and determine that the speech includes words or phrases of a local dictionary of the assistant device. The assistant device can then generate an interaction opportunity based on the words or phrases of the speech.
    Type: Application
    Filed: May 18, 2017
    Publication date: July 26, 2018
    Inventors: Mara Clair Segal, Manuel Roman, Dwipal Desai, Andrew E. Rubin
  • Publication number: 20180213290
    Abstract: A contextual user interface based on playback of media content is described. An assistant device can determine that a display device (e.g., television) within its environment is playing back media content on different channels. The channels being watched can be provided to a server, which can provide back information regarding the media content being played back on those channels. The assistant device can then generate buttons on the user interface providing the information regarding the media content and also causing the display device to switch channels upon their selection.
    Type: Application
    Filed: May 19, 2017
    Publication date: July 26, 2018
    Inventors: Manuel Roman, Mara Clair Segal, Dwipal Desai, Andrew E. Rubin
  • Publication number: 20180210700
    Abstract: A contextual user interface based on environment is described. An assistant device can determine that speech has been spoken and determine the context of an environment of that speech. A user interface can then be generated based on the context of the environment and the content of the speech. Different context can result in different user interfaces being generated.
    Type: Application
    Filed: May 4, 2017
    Publication date: July 26, 2018
    Inventors: Manuel Roman, Mara Clair Segal, Dwipal Desai, Andrew E. Rubin
  • Publication number: 20180211659
    Abstract: Ambient assistance is described. An assistant device can operate in an active experience mode in which a response to a user's speech is provided if it includes a hardware activation phrase. Based on characteristics of the environment, the mode can be adjusted to a passive experience mode in which a response to speech is provided even if it does not include the hardware activation phrase.
    Type: Application
    Filed: May 18, 2017
    Publication date: July 26, 2018
    Inventors: Mara Clair Segal, Manuel Roman, Dwipal Desai, Andrew E. Rubin
  • Publication number: 20180210710
    Abstract: The present disclosure contemplates a variety of improved methods and systems for enabling developers to program and control a variety of disparate devices coupled to the framework and/or ambient operating system. The Home API can expose operation of the devices in a natural and intuitive manner, facilitating control of unknown devices by high-level commands.
    Type: Application
    Filed: August 2, 2017
    Publication date: July 26, 2018
    Inventors: Manuel Roman, Mara Clair Segal, Dwipal Desai, Andrew E. Rubin
  • Publication number: 20180207522
    Abstract: A contextual user interface based on video game playback is described. An assistant device can receive video game state information indicating a state of a playback of a video game on a video game console. Using that information, the assistant device can determine characteristics of the playback and generate a button on a graphical user interface (GUI) based on the characteristics. A user can then select the button and cause the assistant device to instruct the video game console to perform a corresponding action.
    Type: Application
    Filed: June 21, 2017
    Publication date: July 26, 2018
    Inventors: Manuel Roman, Mara Clair Segal, Dwipal Desai, Andrew E. Rubin
  • Publication number: 20180211657
    Abstract: Privacy control in a connected environment is described. An assistant device can detect speech spoken by a user. The speech can include a hardware activation phrase that indicates whether the user intends for at least a portion of the speech to be provided to local resources or cloud resources. The speech can then be provided to the appropriate resource based on the hardware activation phrase.
    Type: Application
    Filed: May 4, 2017
    Publication date: July 26, 2018
    Inventors: Mara Clair Segal, Manuel Roman, Dwipal Desai, Andrew E. Rubin
  • Publication number: 20180213364
    Abstract: Providing audio and/or video content from one user to a second user within an environment are described. An electronic device can receive conversational content from one user and determine that it is directed to a second user. The second user can be determined to be within another location of the environment (e.g., a different room of a house) and identify the capabilities of devices within the other location. Play back of the conversational content can then be performed using the identified devices within the other location.
    Type: Application
    Filed: August 9, 2017
    Publication date: July 26, 2018
    Inventors: Mara Clair Segal, Manuel Roman, Dwipal Desai, Andrew E. Rubin
  • Publication number: 20180210740
    Abstract: The present disclosure contemplates a variety of improved methods and systems for controlling a variety of disparate home devices coupled to the framework and/or ambient operating system (AmbientOS). This home application programming interface (API) exposes the operation of the home devices in a natural and intuitive manner, facilitating control of unknown devices by high level commands. The home devices are contextually responsive to API commands. Additionally, the home application programming interface can customizing an application developed to control devices in an environment to control the devices in the environment via an assistant device with artificial intelligence (AI) capabilities.
    Type: Application
    Filed: August 8, 2017
    Publication date: July 26, 2018
    Inventors: Manuel Roman, Mara Clair Segal, Dwipal Desai, Andrew E. Rubin
  • Publication number: 20180213037
    Abstract: The present disclosure contemplates a variety of improved methods and systems for controlling a variety of disparate home devices coupled to the framework and/or ambient operating system (AmbientOS). This home application programming interface (API) exposes the operation of the home devices in a natural and intuitive manner, facilitating control of unknown devices by high level commands. The home devices are contextually responsive to API commands. Additionally, the home application programming interface can customizing an application developed to control devices in an environment to control the devices in the environment via an assistant device with artificial intelligence (AI) capabilities.
    Type: Application
    Filed: September 5, 2017
    Publication date: July 26, 2018
    Inventors: Manuel Roman, Mara Clair Segal, Dwipal Desai, Andrew E. Rubin
  • Publication number: 20180210738
    Abstract: Privacy control for a contextual user interface based on environment is described. An assistant device can determine the context of its environment and, based on the context, determine a privacy expectation for a user. The assistant device can then generate a graphical user interface (GUI) based on the context and privacy expectation.
    Type: Application
    Filed: May 18, 2017
    Publication date: July 26, 2018
    Inventors: Manuel Roman, Mara Clair Segal, Dwipal Desai, Andrew E. Rubin
  • Publication number: 20180211151
    Abstract: Implementing functionality corresponding to an intent of speech is described. An assistant device can detect speech spoken within its environment. The assistant device can determine that the speech includes verbal content representing an intention regarding functionality within the environment. Devices capable of providing the functionality can be identified and used to provide that functionality.
    Type: Application
    Filed: May 19, 2017
    Publication date: July 26, 2018
    Inventors: Manuel Roman, Mara Clair Segal, Dwipal Desai, Andrew E. Rubin
  • Publication number: 20180213396
    Abstract: Privacy control in a connected environment is described. An assistant device can detect speech spoken within its environment. The assistant device can determine characteristics of that speech and determine privacy expectations regarding the first speech based on the characteristics. Based on the privacy expectations, the speech can be provided one or both of local resources of the assistant device or a cloud server to receive a response regarding the speech.
    Type: Application
    Filed: May 4, 2017
    Publication date: July 26, 2018
    Inventors: Mara Clair Segal, Manuel Clair Roman, Dwipal Desai, Andrew E. Rubin
  • Publication number: 20180213009
    Abstract: Facilitating communication between assistant devices is described. A method or an electronic device can determine an assistant device closest to the user can allow other users to contact said user via that assistant device. In one example, a user can use a an assistant device to have a conversation with others by communicating over a communication link established with a network outside of the user's environment.
    Type: Application
    Filed: August 9, 2017
    Publication date: July 26, 2018
    Inventors: Mara Clair Segal, Manuel Roman, Dwipal Desai, Andrew E. Rubin