Patents Assigned to ESSENTIAL PRODUCTS, INC.
  • Patent number: 10937216
    Abstract: Presented here is technology to efficiently process camera images to generate lead part artistic images and videos using an artificial intelligence module receiving inputs from multiple sensors. Multiple sensors can include a depth sensor, a conventional camera, and a motion tracker providing inputs to the artificial intelligence module. Based on the inputs, the artificial intelligence module can segment the received image and/or video into a foreground image and a background image to produce portrait imagery by blurring the background image and/or video. The artificial intelligence module can select the most aesthetically pleasing image from a video. In addition, the artificial intelligence module can adjust lighting in an image or video to create artistic lighting effects. All the processing can be done in real time due to efficient combination of artificial intelligence modules, traditional image processing techniques, and use of specialized hardware.
    Type: Grant
    Filed: February 1, 2019
    Date of Patent: March 2, 2021
    Assignee: ESSENTIAL PRODUCTS, INC.
    Inventors: Xiaoyu Miao, Andrew E. Rubin
  • Patent number: 10598790
    Abstract: The disclosed embodiments include a light detection and ranging (LIDAR) system. The LIDAR system includes a modular LIDAR device, which includes a scanner component and a structurally separate base component. The scanner component is mountable on an external surface of a vehicle, and includes a light source and detector to capture LIDAR data including a measure of a distance to an object relative to the vehicle. The scanner component also includes a communications transmitter to transmit LIDAR data indicative of the distance, and a power receiver to wirelessly power the scanner component. The base component is at least partially mountable on an interior surface of the vehicle, and includes a power transmitter to wirelessly power the scanner component, a communications receiver to wirelessly receive the LIDAR data, and a processor to enable autonomous or semi-autonomous navigation of the vehicle based on processed LIDAR data.
    Type: Grant
    Filed: February 17, 2018
    Date of Patent: March 24, 2020
    Assignee: ESSENTIAL PRODUCTS, INC.
    Inventor: Andrew E. Rubin
  • Patent number: 10591909
    Abstract: The embodiments include a handheld mobile device (HMD) operable to cause a subsystem of a vehicle to perform a vehicular operation associated with an existing capability of the subsystem. The HMD includes a processor, a port operable to communicatively couple the HMD to an existing on-board computer of a vehicle via an existing data link connector of the vehicle, and a wireless interface operable to communicatively couple the HMD to at least one of the vehicle or a remote service. The HMD further includes a memory storing a software application that, when executed by the processor, causes the HMD to communicate a command to the on-board computer via the data link connector to perform the vehicular operation associated with the existing capability of the subsystem.
    Type: Grant
    Filed: March 16, 2018
    Date of Patent: March 17, 2020
    Assignee: ESSENTIAL PRODUCTS, INC.
    Inventor: Andrew E. Rubin
  • Patent number: 10462345
    Abstract: The disclosed teachings include a 360-degree camera accessory mountable on a smartphone. The 360-degree camera accessory includes a camera module disposed partially within the camera accessory, where the camera module including an optical lens configured to capture an image of a scene. The 360-degree camera accessory also includes a rigid structure disposed within the accessory to support the camera module, and a deformable structure disposed between a camera barrel that surrounds the optical lens of the camera module and the rigid structure. The deformable structure can compensate for movement of the camera module to improve image capturing of the scene.
    Type: Grant
    Filed: August 13, 2018
    Date of Patent: October 29, 2019
    Assignee: ESSENTIAL PRODUCTS, INC.
    Inventor: Jiang Ai
  • Patent number: 10444962
    Abstract: Presented here are systems and methods to enable software applications to display images on irregular screen shapes containing the shape without display functionality. In one embodiment, the shape without display functionality is confined within a bounding shape, which, when subtracted from the irregular screen shape leaves a rectangular area of the screen where the image can be displayed. The area within the bounding shape can be occupied by images provided by the operating system associated with the irregular screen, such as a status bar and/or navigation bar. In another embodiment, the image can be displayed on the full irregular screen, such that the shape without display functionality covers a part of the image. When the occluded part of the image contains a critical object, such as a menu item, a button, etc., the image can be modified to move the critical object out of the area occluded by the shape without display functionality.
    Type: Grant
    Filed: January 9, 2018
    Date of Patent: October 15, 2019
    Assignee: ESSENTIAL PRODUCTS, INC.
    Inventors: Adithya Gajulapally, Michael Kolb, Rebecca Schultz Zavin
  • Patent number: 10440544
    Abstract: Various embodiments concern motion sensor modules able to monitor movement. A motion sensor module can be detachably connected to an electronic device to which the motion sensor module transfers motion data. In some embodiments, the motion sensor module is connected to an electronic device associated with an individual. In other embodiments, the motion sensor module is embedded within an article of clothing worn by the individual (e.g., a shirt, swimsuit, or shoe). The motion sensor module includes at least one inertial measurement unit (IMU) that generates motion data indicative of the motion of the motion sensor module as a whole.
    Type: Grant
    Filed: June 28, 2018
    Date of Patent: October 8, 2019
    Assignee: ESSENTIAL PRODUCTS, INC.
    Inventor: Jason Sean Gagne-Keats
  • Patent number: 10432872
    Abstract: Some embodiments include a mobile device with a light sensor overlaid under a display (e.g., a touchscreen). The mobile device can identify a command to capture an image. The mobile device can adjust at least a target portion of an opaqueness adjustable region of the display directly over the light sensor. The opaqueness adjustable region is capable of transforming from substantially opaque to substantially transparent. The mobile device can capture the image utilizing at least the light sensor while the target portion of the opaqueness adjustable region is substantially transparent.
    Type: Grant
    Filed: February 24, 2017
    Date of Patent: October 1, 2019
    Assignee: ESSENTIAL PRODUCTS, INC.
    Inventors: David John Evans, V, Xinrui Jiang, Andrew E. Rubin, Matthew Hershenson, Xiaoyu Miao, Joseph Anthony Tate, Jason Sean Gagne-Keats, Rebecca Schultz Zavin
  • Patent number: 10433398
    Abstract: Presented here is a system to record high-resolution infrared images without the need to include additional stand-alone sensors into the mobile device. According to one embodiment, an organic light emitting diode (OLED) display is modified to emit IR and near-IR light in a large field. The modified display allows for depth sensing and infrared imaging without a stand-alone emitter. Additionally, an IR shutter filter can be applied to the existing front facing red, green, blue (RGB) camera that would only be in place when the display is in IR emission mode. The combination of these two technologies allows a facial recognition system using existing hardware, and not require additional sensors or emitters to achieve face recognition.
    Type: Grant
    Filed: December 12, 2017
    Date of Patent: October 1, 2019
    Assignee: ESSENTIAL PRODUCTS, INC.
    Inventor: Jason Sean Gagne-Keats
  • Patent number: 10380493
    Abstract: The present disclosure contemplates a variety of improved methods and systems for creating a unique user experience using an ambient operating system connected to a variety of disparate IoT devices. The described solution includes a curated scene or set of actions initiated by an assistant device. For example, the assistant device detects it is a weekday morning and initiates actions associated with the wakeup routine such as opening the blinds, making coffee and notifying the user of the current traffic report.
    Type: Grant
    Filed: May 24, 2017
    Date of Patent: August 13, 2019
    Assignee: ESSENTIAL PRODUCTS, INC.
    Inventors: Mara Clair Segal, Manuel Roman, Dwipal Desai, Andrew E. Rubin
  • Patent number: 10365932
    Abstract: The present disclosure contemplates a variety of improved methods and systems for controlling a variety of disparate home devices coupled to the framework and/or ambient operating system (AmbientOS). This home application programming interface (API) exposes the operation of the home devices in a natural and intuitive manner, facilitating control of unknown devices by high level commands. The home devices are contextually responsive to API commands. Additionally, the home application programming interface can customizing an application developed to control devices in an environment to control the devices in the environment via an assistant device with artificial intelligence (AI) capabilities.
    Type: Grant
    Filed: August 8, 2017
    Date of Patent: July 30, 2019
    Assignee: ESSENTIAL PRODUCTS, INC.
    Inventors: Manuel Roman, Mara Clair Segal, Dwipal Desai, Andrew E. Rubin
  • Patent number: 10359993
    Abstract: A contextual user interface based on environment is described. An assistant device can determine that speech has been spoken and determine the context of an environment of that speech. A user interface can then be generated based on the context of the environment and the content of the speech. Different context can result in different user interfaces being generated.
    Type: Grant
    Filed: May 4, 2017
    Date of Patent: July 23, 2019
    Assignee: ESSENTIAL PRODUCTS, INC.
    Inventors: Manuel Roman, Mara Clair Segal, Dwipal Desai, Andrew E. Rubin
  • Patent number: 10360691
    Abstract: In one embodiment, a light sensor, such as a camera, records an image through the surface with the residue to produce a stained image. A processor associated with the camera identifies object outlines within the image using a machine learning model, and smooth the colors within the object outlines. In another embodiment, the light sensor is placed beneath a dual-mode region of a display containing the residue. The dual-mode region can be opaque and function as part of the display, or can be transparent and allow environment light to reach the light sensor. Initially, the processor determines the position of the residue by causing the dual-mode region to display a predetermined pattern, while the light sensor records the predetermined pattern. Using the determined position of the residue, the processor corrects the pixels within the residue in the recorded image, by interpolating the values of the pixels outside of the residue.
    Type: Grant
    Filed: November 22, 2017
    Date of Patent: July 23, 2019
    Assignee: ESSENTIAL PRODUCTS, INC.
    Inventors: David John Evans, V, Xinrui Jiang, Andrew E. Rubin, Matthew Hershenson, Xiaoyu Miao, Joseph Anthony Tate, Jason Sean Gagne-Keats
  • Patent number: 10353842
    Abstract: Various embodiments concern techniques for intelligently switching between multiple sources of USB signals. More specifically, user devices are described that include a physical USB port for receiving a USB connector and one or more wireless transceivers that communicate with an accessory. The wireless transceiver(s) may communicate with the accessory using a USB-based protocol (e.g., Wireless USB). The user devices described herein can intelligently switch between these different sources of USB signals so that USB signals can be simultaneously or sequentially received from a peripheral (via the USB port) and an accessory (via the wireless transceiver(s)). In some embodiments, a switching routine is executed (e.g., by a processor or signal switch) that determines which peripheral and/or accessory is connected to a user device at a given point in time.
    Type: Grant
    Filed: December 6, 2017
    Date of Patent: July 16, 2019
    Assignee: ESSENTIAL PRODUCTS, INC.
    Inventors: Jason Sean Gagne-Keats, Andrew E. Rubin, David John Evans, V, Matthew Hershenson, Xiaoyu Miao, Xinrui Jiang, Joseph Anthony Tate
  • Patent number: 10353480
    Abstract: The present disclosure contemplates a variety of improved methods and systems for enabling set up of a variety of disparate IoT devices coupled to the framework and/or ambient operating system of an assistant device. The described solution includes a voice-driven assistant device setup process. An assistant device can determine the IoT devices in its physical environment and provide setup instructions to the user. The setup including determining voice activatable commands, device information and the adapter to allow the assistant device to operate the one or more IoT devices in response to user instructions.
    Type: Grant
    Filed: May 24, 2017
    Date of Patent: July 16, 2019
    Assignee: ESSENTIAL PRODUCTS, INC.
    Inventors: Manuel Roman, Mara Clair Segal, Dwipal Desai, Andrew E. Rubin
  • Patent number: 10355931
    Abstract: A home assistant device assisting with the setup and troubleshooting of devices is described. An assistant device can determine setup instructions for devices. The setup instructions for one device can be determined the technical aptitude of the user and assistant the user with setting up devices within their own technical abilities. The setup instructions can then be provided.
    Type: Grant
    Filed: July 5, 2017
    Date of Patent: July 16, 2019
    Assignee: ESSENTIAL PRODUCTS, INC.
    Inventors: Manuel Roman, Mara Clair Segal, Dwipal Desai, Andrew E. Rubin
  • Patent number: 10349224
    Abstract: Providing audio and/or video content from one user to a second user within an environment are described. An electronic device can receive conversational content from one user and determine that it is directed to a second user. The second user can be determined to be within another location of the environment (e.g., a different room of a house) and identify the capabilities of devices within the other location. Play back of the conversational content can then be performed using the identified devices within the other location.
    Type: Grant
    Filed: August 9, 2017
    Date of Patent: July 9, 2019
    Assignee: ESSENTIAL PRODUCTS, INC.
    Inventors: Mara Clair Segal, Manuel Roman, Dwipal Desai, Andrew E. Rubin
  • Patent number: 10348871
    Abstract: Disclosed here are systems and methods which enable high-bandwidth communication between a mobile device and an accessory. The high-bandwidth communication uses electromagnetic waves in the extremely high frequency range between 30 GHz and 300 GHz inclusive, also known as millimeter waves. The millimeter waves travel through at least the chassis of the accessory and the chassis of the mobile device without significant scattering and attenuation. The properties of the materials through which the millimeter waves travel determine the attenuation of the millimeter waves. Disclosed here are various materials, and their thicknesses, which form a transmission stack through which the millimeter waves can travel unimpeded. In effect, the transmission stack acts as a dielectric member which facilitates the transmission of the millimeter waves, while attenuating transmission of waves outside of the extremely high frequency range.
    Type: Grant
    Filed: March 12, 2018
    Date of Patent: July 9, 2019
    Assignee: ESSENTIAL PRODUCTS, INC.
    Inventors: Jiang Ai, William Francis Leggett, Paulina Mustafa, Nikola Cargonja, Jason Sean Gagne-Keats, David John Evans, V, Adithya Gajulapally
  • Patent number: 10341478
    Abstract: Presented here is a handheld writing implement form factor for a mobile device. The shape of the device can correspond to the shape of a whiteboard marker. Due to the small size, the device does not have a physical keyboard or an onscreen keyboard and instead relies on environmental cues, gestural input, voice input, and touch input to interpret user instructions. For example, when the device determines from environmental cues that it is resting on a tabletop, a touch input consisting of a single press from the user is interpreted as an instruction to scroll the display. In other embodiments, the device can be used as a handheld writing implement, such as a computer stylus, or to control the device by handwriting in the air. Other uses of the device are disclosed such as making a payment, communicating with other appliances enabled for electronic communication, recording images with a gesture, etc.
    Type: Grant
    Filed: September 26, 2017
    Date of Patent: July 2, 2019
    Assignee: ESSENTIAL PRODUCTS, INC.
    Inventors: Siqi Li, David John Evans, V
  • Patent number: D857644
    Type: Grant
    Filed: June 7, 2018
    Date of Patent: August 27, 2019
    Assignee: ESSENTIAL PRODUCTS, INC.
    Inventors: Jason Sean Gagne-Keats, David John Evans, V, Andrew E. Rubin, Clement Puertolas
  • Patent number: D869463
    Type: Grant
    Filed: June 1, 2017
    Date of Patent: December 10, 2019
    Assignee: ESSENTIAL PRODUCTS, INC.
    Inventors: Jason Sean Gagne-Keats, David John Evans, V, Manuel Roman, Mara Clair Segal, Dwipal Desai, Andrew E. Rubin