Patents by Inventor Andrew E. Rubin

Andrew E. Rubin has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 10331260
    Abstract: Various embodiments concern sensors and other components that can be disposed beneath a variable transparency layer of a mobile device. By modifying how much voltage is applied to the variable transparency layer, a component, such as a camera, can be readily hidden when not in use. More specifically, the variable transparency layer may be substantially opaque when the camera is not in use and at least partially transparent when the camera is in use and ready to capture an image. The opacity level of the variable transparency layer can be modified by a voltage source that is electrically coupled to the variable transparency layer. The various levels of opacity could also enable the variable transparency layer to act as an electronic aperture for the camera.
    Type: Grant
    Filed: October 27, 2016
    Date of Patent: June 25, 2019
    Assignee: ESSENTIAL PRODUCTS, INC.
    Inventors: David John Evans, V, Xinrui Jiang, Andrew E. Rubin, Matthew Hershenson, Xiaoyu Miao
  • Patent number: 10332920
    Abstract: Presented here are manufacturing techniques to create an irregularly shaped electronic display, including a hollow within which a sensor, such as a camera, can be placed. The manufacturing techniques enable the creation of the hollow anytime during the manufacturing process. The resulting electronic display occupies the full side of the mobile device, with the sensors placed within and surrounded by the display.
    Type: Grant
    Filed: December 5, 2017
    Date of Patent: June 25, 2019
    Assignee: ESSENTIAL PRODUCTS, INC.
    Inventors: David John Evans, V, Xinrui Jiang, Andrew E. Rubin, Matthew Hershenson, Xiaoyu Miao, Joseph Anthony Tate, Jason Sean Gagne-Keats, Rebecca Schultz Zavin
  • Patent number: 10333576
    Abstract: Various embodiments concern a wireless accessory bus for a user device that enables accessories to be easily and securely attached to the user device. More specifically, the wireless accessory bus enables data to be wirelessly transmitted between the accessory and the user device when the accessory and the user device are located within close proximity to one another (e.g., when the accessory is securely attached to the wireless accessory bus). Power could also be wirelessly transferred from the user device to the accessory (or vice versa). In some embodiments, the user device includes fastening component(s) (e.g., magnets) that allow the user device and the accessory to be magnetically secured to one another. The accessory typically enables the user device to readily utilize a new functionality or an improvement to an existing functionality.
    Type: Grant
    Filed: June 2, 2017
    Date of Patent: June 25, 2019
    Assignee: ESSENTIAL PRODUCTS, INC.
    Inventors: David John Evans, V, Xinrui Jiang, Andrew E. Rubin, Matthew Hershenson, Xiaoyu Miao
  • Publication number: 20190172238
    Abstract: Presented here is technology to efficiently process camera images to generate lead part artistic images and videos using an artificial intelligence module receiving inputs from multiple sensors. Multiple sensors can include a depth sensor, a conventional camera, and a motion tracker providing inputs to the artificial intelligence module. Based on the inputs, the artificial intelligence module can segment the received image and/or video into a foreground image and a background image to produce portrait imagery by blurring the background image and/or video. The artificial intelligence module can select the most aesthetically pleasing image from a video. In addition, the artificial intelligence module can adjust lighting in an image or video to create artistic lighting effects. All the processing can be done in real time due to efficient combination of artificial intelligence modules, traditional image processing techniques, and use of specialized hardware.
    Type: Application
    Filed: February 1, 2019
    Publication date: June 6, 2019
    Inventors: Xiaoyu Miao, Andrew E. Rubin
  • Publication number: 20190130624
    Abstract: Presented here is technology to efficiently process camera images to generate artistic images and videos using an artificial intelligence module receiving inputs from multiple sensors. Multiple sensors can include a depth sensor, a conventional camera, and a motion tracker providing inputs to the artificial intelligence module. Based on the inputs, the artificial intelligence module can segment the received image and/or video into a foreground image and a background image to produce portrait imagery by blurring the background image and/or video. The artificial intelligence module can select the most aesthetically pleasing image from a video. In addition, the artificial intelligence module can adjust lighting in an image or video to create artistic lighting effects. All the processing can be done in real time due to efficient combination of artificial intelligence modules, traditional image processing techniques, and use of specialized hardware.
    Type: Application
    Filed: October 31, 2018
    Publication date: May 2, 2019
    Inventors: Xiaoyu Miao, Andrew E. Rubin
  • Patent number: 10271189
    Abstract: Various embodiments include a device that implements a high bandwidth wireless data interface for communication between the device and a device accessory. The device can include an external shell and a display (e.g., a touchscreen). In some embodiments, the external shell and the display together hermetically seal various other components of the device. In various embodiments, the device includes an attachment mechanism, an alignment mechanism (e.g., for magnetic alignment between a device and a device accessory), a wireless data transceiver, and a wired or wireless energy source (e.g., for sharing power between the device and the device accessory). The wireless data transceiver can transmit data at extremely high electromagnetic frequencies between the device in the device accessory.
    Type: Grant
    Filed: February 24, 2017
    Date of Patent: April 23, 2019
    Assignee: ESSENTIAL PRODUCTS, INC.
    Inventors: David John Evans, V, Joseph Anthony Tate, Jason Sean Gagne-Keats, William Francis Leggett, James Jong-sik Kim, Rebecca Schultz Zavin, Andrew E. Rubin
  • Patent number: 10244090
    Abstract: A mobile device can include electronic circuitry and a chassis shell adapted to protect the electronic circuitry. The chassis shell includes an opening exposing a tray inside the mobile device. The tray can include an external card slot and a patterned wall. The tray can be disposed within a cavity of a support structure of the mobile device. An input/output (I/O) component, such as a speaker, and a card reader can also be disposed within the cavity. The I/O component can communicate via at least a hole in the patterned wall (e.g., a speaker grill).
    Type: Grant
    Filed: July 8, 2016
    Date of Patent: March 26, 2019
    Assignee: ESSENTIAL PRODUCTS, INC.
    Inventors: David John Evans, V, Xinrui Jiang, Andrew E. Rubin, Matthew Hershenson, Xiaoyu Miao
  • Patent number: 10244089
    Abstract: A mobile device can include electronic circuitry and a chassis shell adapted to protect the electronic circuitry. The chassis shell includes an opening exposing a tray inside the mobile device. The tray can include an external card slot and a patterned wall. The tray can be disposed within a cavity of a support structure of the mobile device. An input/output (I/O) component, such as a speaker, and a card reader can also be disposed within the cavity. The I/O component can communicate via at least a hole in the patterned wall (e.g., a speaker grill).
    Type: Grant
    Filed: July 1, 2016
    Date of Patent: March 26, 2019
    Assignee: ESSENTIAL PRODUCTS, INC.
    Inventors: David John Evans, V, Xinrui Jiang, Andrew E. Rubin, Matthew Hershenson, Xiaoyu Miao
  • Patent number: 10223571
    Abstract: Various embodiments concern fingerprint sensors for mobile devices. By modifying one or more layers of a display assembly, a fingerprint sensor can be positioned directly beneath the display. For example, the air gap within the backlight structure could be replaced by an optically clear adhesive that allows waves emitted by a fingerprint sensor to properly propagate through the display assembly. In some embodiments, a fingerprint sensor is set within a recess in the display assembly. For example, a depression could be created in the protective substrate, and the fingerprint sensor could be set within the depression using an optically clear adhesive. The functionality of a fingerprint sensor could also be replicated by increasing the density of touch-sensing elements in certain areas of a display assembly that utilizes in-cell technology.
    Type: Grant
    Filed: July 11, 2017
    Date of Patent: March 5, 2019
    Assignee: ESSENTIAL PRODUCTS, INC.
    Inventors: David John Evans, V, Xinrui Jiang, Andrew E. Rubin, Matthew Hershenson, Xiaoyu Miao
  • Patent number: 10218904
    Abstract: Disclosed herein are various embodiments of an imaging device having a wide field of view configured to connect to another device. According to one embodiment, the wide field of view camera can include an array of cameras for recording a wide view (e.g., 360° view) of the surrounding environment and generate a 360° image of the surrounding environment. The wide field of view camera can be configured to connect and/or attach to another device, including a mobile device. Embodiments include a wired or wireless connection mechanism to facilitate communication between the wide field of view camera and another device. The connection mechanism may enable transmission of data associated with the wide field of view camera to another device. Embodiments include an attachment mechanism to fasten the wide field of view camera to another device.
    Type: Grant
    Filed: August 11, 2017
    Date of Patent: February 26, 2019
    Assignee: ESSENTIAL PRODUCTS, INC.
    Inventors: David John Evans, V, Xinrui Jiang, Andrew E. Rubin, Matthew Hershenson, Xiaoyu Miao
  • Patent number: 10210866
    Abstract: Ambient assistance is described. An assistant device can detect speech in its environment and determine that the speech includes words or phrases of a local dictionary of the assistant device. The assistant device can then generate an interaction opportunity based on the words or phrases of the speech.
    Type: Grant
    Filed: May 18, 2017
    Date of Patent: February 19, 2019
    Assignee: ESSENTIAL PRODUCTS, INC.
    Inventors: Mara Clair Segal, Manuel Roman, Dwipal Desai, Andrew E. Rubin
  • Patent number: 10212040
    Abstract: A home assistant device assisting with the setup and troubleshooting of devices is described. An assistant device can determine setup instructions for devices. The setup instructions for one device can be determined the technical aptitude of the user and assistant the user with setting up devices within their own technical abilities. The setup instructions can then be provided.
    Type: Grant
    Filed: January 26, 2018
    Date of Patent: February 19, 2019
    Assignee: ESSENTIAL PRODUCTS, INC.
    Inventors: Manuel Roman, Mara Clair Segal, Dwipal Desai, Andrew E. Rubin
  • Patent number: 10206040
    Abstract: Certain aspects of the technology disclosed herein include generating a virtual sound field based on data from an ambisonic recording device. The ambisonic device records sound of a surrounding environment using at least four microphones having a tetrahedral orientation. An omnidirectional microphone having an audio-isolated portion can be used to isolate sound from a particular direction. Sound received from the plurality of microphones can be used to generate a virtual sound field. The virtual sound field include a dataset indicating a pressure signal and a plurality of velocity vectors. The ambisonic recording device can include a wide angle camera and generate wide angle video corresponding to the virtual sound field.
    Type: Grant
    Filed: July 13, 2017
    Date of Patent: February 12, 2019
    Assignee: ESSENTIAL PRODUCTS, INC.
    Inventors: Michael Kolb, Xinrui Jiang, Andrew E. Rubin, Matthew Hershenson, Xiaoyu Miao, Joseph Anthony Tate, Jason Sean Gagne-Keats, David John Evans, V, Rebecca Schultz Zavin
  • Patent number: 10204623
    Abstract: Privacy control in a connected environment is described. An assistant device can detect speech spoken by a user. The speech can include a hardware activation phrase that indicates whether the user intends for at least a portion of the speech to be provided to local resources or cloud resources. The speech can then be provided to the appropriate resource based on the hardware activation phrase.
    Type: Grant
    Filed: May 4, 2017
    Date of Patent: February 12, 2019
    Assignee: ESSENTIAL PRODUCTS, INC.
    Inventors: Mara Clair Segal, Manuel Roman, Dwipal Desai, Andrew E. Rubin
  • Patent number: 10198611
    Abstract: Various embodiments concern fingerprint sensors for mobile devices. By modifying one or more layers of a display assembly, a fingerprint sensor can be positioned directly beneath the display. For example, the air gap within the backlight structure could be replaced by an optically clear adhesive that allows waves emitted by a fingerprint sensor to properly propagate through the display assembly. In some embodiments, a fingerprint sensor is set within a recess in the display assembly. For example, a depression could be created in the protective substrate, and the fingerprint sensor could be set within the depression using an optically clear adhesive. The functionality of a fingerprint sensor could also be replicated by increasing the density of touch-sensing elements in certain areas of a display assembly that utilizes in-cell technology.
    Type: Grant
    Filed: June 7, 2017
    Date of Patent: February 5, 2019
    Assignee: ESSENTIAL PRODUCTS, INC.
    Inventors: David John Evans, V, Xinrui Jiang, Andrew E. Rubin, Matthew Hershenson, Xiaoyu Miao
  • Patent number: 10176807
    Abstract: A home assistant device assisting with the setup of devices is described. An assistant device can determine setup instructions for devices. The setup instructions for one device can be determined to include a step requesting information related to the setup of another device. The setup of the devices can be ordered based on that determination. The setup instructions can then be provided.
    Type: Grant
    Filed: May 24, 2017
    Date of Patent: January 8, 2019
    Assignee: ESSENTIAL PRODUCTS, INC.
    Inventors: Manuel Roman, Mara Clair Segal, Dwipal Desai, Andrew E. Rubin
  • Patent number: 10166465
    Abstract: A contextual user interface based on video game playback is described. An assistant device can receive video game state information indicating a state of a playback of a video game on a video game console. Using that information, the assistant device can determine characteristics of the playback and generate a button on a graphical user interface (GUI) based on the characteristics. A user can then select the button and cause the assistant device to instruct the video game console to perform a corresponding action.
    Type: Grant
    Filed: June 21, 2017
    Date of Patent: January 1, 2019
    Assignee: ESSENTIAL PRODUCTS, INC.
    Inventors: Manuel Roman, Mara Clair Segal, Dwipal Desai, Andrew E. Rubin
  • Publication number: 20180350090
    Abstract: In one embodiment, a light sensor, such as a camera, records an image through the surface with the residue to produce a stained image. A processor associated with the camera identifies object outlines within the image using a machine learning model, and smooth the colors within the object outlines. In another embodiment, the light sensor is placed beneath a dual-mode region of a display containing the residue. The dual-mode region can be opaque and function as part of the display, or can be transparent and allow environment light to reach the light sensor. Initially, the processor determines the position of the residue by causing the dual-mode region to display a predetermined pattern, while the light sensor records the predetermined pattern. Using the determined position of the residue, the processor corrects the pixels within the residue in the recorded image, by interpolating the values of the pixels outside of the residue.
    Type: Application
    Filed: November 22, 2017
    Publication date: December 6, 2018
    Inventors: David John Evans, V, Xinrui Jiang, Andrew E. Rubin, Matthew Hershenson, Xiaoyu Miao, Joseph Anthony Tate, Jason Sean Gagne-Keats
  • Patent number: 10147216
    Abstract: Presented here is technology to efficiently process camera images to generate artistic images and videos using an artificial intelligence module receiving inputs from multiple sensors. Multiple sensors can include a depth sensor, a conventional camera, and a motion tracker providing inputs to the artificial intelligence module. Based on the inputs, the artificial intelligence module can segment the received image and/or video into a foreground image and a background image to produce portrait imagery by blurring the background image and/or video. The artificial intelligence module can select the most aesthetically pleasing image from a video. In addition, the artificial intelligence module can adjust lighting in an image or video to create artistic lighting effects. All the processing can be done in real time due to efficient combination of artificial intelligence modules, traditional image processing techniques, and use of specialized hardware.
    Type: Grant
    Filed: November 14, 2017
    Date of Patent: December 4, 2018
    Assignee: ESSENTIAL PRODUCTS, INC.
    Inventors: Xiaoyu Miao, Andrew E. Rubin
  • Patent number: D840367
    Type: Grant
    Filed: January 17, 2017
    Date of Patent: February 12, 2019
    Assignee: ESSENTIAL PRODUCTS, INC.
    Inventors: Xinrui Jiang, David John Evans, V, Andrew E. Rubin