Patents by Inventor Patrick Llull

Patrick Llull has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11887550
    Abstract: A display system including a tracking subsystem configured to track one of a pose of a head of a viewer or a pose of an eye of the viewer. The display system further includes an image correction module configured to, for each pixel of at least a subset of pixels of an input image, determine a pixel view angle for the pixel based on the pose of the head or the pose of the eye, determine a corrected pixel value based on an input pixel value of the pixel in the input image and based on the pixel view angle; and provide the corrected pixel value for the pixel in an angle-corrected image corresponding to the input image. The display system further includes a display panel to display the angle-corrected image.
    Type: Grant
    Filed: December 12, 2019
    Date of Patent: January 30, 2024
    Assignee: GOOGLE LLC
    Inventors: Patrick Llull, John D. Perreault, Andrew Huibers
  • Publication number: 20220319453
    Abstract: A display system including a tracking subsystem configured to track one of a pose of a head of a viewer or a pose of an eye of the viewer. The display system further includes an image correction module configured to, for each pixel of at least a subset of pixels of an input image, determine a pixel view angle for the pixel based on the pose of the head or the pose of the eye, determine a corrected pixel value based on an input pixel value of the pixel in the input image and based on the pixel view angle; and provide the corrected pixel value for the pixel in an angle-corrected image corresponding to the input image. The display system further includes a display panel to display the angle-corrected image.
    Type: Application
    Filed: December 12, 2019
    Publication date: October 6, 2022
    Inventors: Patrick Llull, John D. Perreault, Andrew Huibers
  • Patent number: 11435576
    Abstract: A near-eye display system includes a display panel to display a near-eye lightfield frame comprising an array of elemental images and an eye tracking component to track a pose of a user's eye. The system further includes a lenslet array and a rendering component to adjust the focal points of the array of elemental images in the integral lightfield frame based on the pose of the user's eye. A method of operation of the near-eye display system includes determining, using an eye tracking component of the near-eye display system, a first pose of a user's eye and determining a desired focal point for an array of elemental images forming an integral lightfield frame based on the first pose of the user's eye. The method further includes changing the focal length of light projecting out of a lenslet array based on the first pose of the user's eye.
    Type: Grant
    Filed: October 27, 2020
    Date of Patent: September 6, 2022
    Assignee: Google LLC
    Inventors: John D. Perreault, Patrick Llull
  • Patent number: 11314083
    Abstract: A near-eye display system includes a display panel to present image frames to the eyes of a user for viewing. The system also includes a beam steering assembly facing the display panel that is configurable to displace a light beam incident on the beam steering assembly, thereby laterally shifting light relative to an optical path of the light beam incident on the beam steering assembly. The beam steering assembly includes a birefringent plate configurable to replicate a light ray incident on the beam steering assembly such that the replicated light ray is laterally shifted relative to an optical path of the light ray incident on the beam steering assembly.
    Type: Grant
    Filed: October 1, 2018
    Date of Patent: April 26, 2022
    Assignee: Google LLC
    Inventors: John D. Perreault, Patrick Llull, Brion Koprowski
  • Patent number: 11181801
    Abstract: A near-eye display system includes a display panel to present image frames to the eyes of a user for viewing. The system also includes a beam steering assembly facing the display panel that is configurable to displace a light beam incident on the beam steering assembly, thereby laterally shifting light relative to an optical path of the light beam incident on the beam steering assembly. A method of operation of the near-eye display system includes configuring the beam steering assembly in a first configuration state so that the beam steering assembly displaces a light beam incident on the beam steering assembly, such that the displaced light beam is laterally shifted relative to an optical path of the light beam.
    Type: Grant
    Filed: February 6, 2018
    Date of Patent: November 23, 2021
    Assignee: Google LLC
    Inventors: John D. Perreault, Patrick Llull, Brion Koprowski
  • Patent number: 11022806
    Abstract: A near-eye display system includes a transmissive display panel to display a near-eye light field frame comprising an array of elemental images. The transmissive display panel is configured to transmit light rays of the near-eye light field frame away from the user's eye and towards an array of curved beam splitters. The curved beam splitters collimate the transmitted light rays and reflect the collimated light rays back towards the transmissive display panel for passing to the user's eye.
    Type: Grant
    Filed: May 4, 2020
    Date of Patent: June 1, 2021
    Assignee: Google LLC
    Inventors: John D. Perreault, Patrick Llull
  • Publication number: 20210076025
    Abstract: A near-eye display system includes a display panel to display a near-eye lightfield frame comprising an array of elemental images and an eye tracking component to track a pose of a user's eye. The system further includes a lenslet array and a rendering component to adjust the focal points of the array of elemental images in the integral lightfield frame based on the pose of the user's eye. A method of operation of the near-eye display system includes determining, using an eye tracking component of the near-eye display system, a first pose of a user's eye and determining a desired focal point for an array of elemental images forming an integral lightfield frame based on the first pose of the user's eye. The method further includes changing the focal length of light projecting out of a lenslet array based on the first pose of the user's eye.
    Type: Application
    Filed: October 27, 2020
    Publication date: March 11, 2021
    Inventors: John D. Perreault, Patrick Llull
  • Patent number: 10855977
    Abstract: A near-eye display system includes a display panel to display a near-eye lightfield frame comprising an array of elemental images and an eye tracking component to track a pose of a user's eye. The system further includes a lenslet array and a rendering component to adjust the focal points of the array of elemental images in the integral lightfield frame based on the pose of the user's eye. A method of operation of the near-eye display system includes determining, using an eye tracking component of the near-eye display system, a first pose of a user's eye and determining a desired focal point for an array of elemental images forming an integral lightfield frame based on the first pose of the user's eye. The method further includes changing the focal length of light projecting out of a lenslet array based on the first pose of the user's eye.
    Type: Grant
    Filed: February 15, 2018
    Date of Patent: December 1, 2020
    Assignee: GOOGLE LLC
    Inventors: John D. Perreault, Patrick Llull
  • Patent number: 10827164
    Abstract: A head-mounted display (HMD) device includes one or more active shutters coupled to a synchronization module. The synchronization module includes a first photodiode configured to detect a synchronization signal for controlling operation of the one or more active shutters. The one or more active shutters are configured to alternate between an open state to pass light and a closed state to block light for reducing a duty cycle of a display screen of a mobile device positioned within the HMD device. The synchronization signal provides a timing to block light from the display screen for a display update duration corresponding to a subset of pixels of the display screen.
    Type: Grant
    Filed: September 27, 2018
    Date of Patent: November 3, 2020
    Assignee: Google LLC
    Inventors: John D. Perreault, Jonathan Huang, Patrick Llull, Adrian Wong, Justin Legakis
  • Patent number: 10764552
    Abstract: A near-eye display system includes display panel to display a near-eye lightfield frame comprising an array of elemental images and a lenslet array to present the integral lightfield frame to a user's eye. The system further includes a rendering component to generate an array of elemental images based at least in part on a sparse sampling of a source image to decrease an overlap of image data contained within each individual elemental of the array of elemental images. A method of operation of the near-eye display system includes generating an array of elemental images forming the integral lightfield frame based on a sparse sampling of the current viewpoint of the subject object to decrease an overlap of image data contained within each individual elemental image of the array.
    Type: Grant
    Filed: February 15, 2018
    Date of Patent: September 1, 2020
    Assignee: GOOGLE LLC
    Inventors: John D. Perreault, Patrick Llull
  • Publication number: 20200264438
    Abstract: A near-eye display system includes a transmissive display panel to display a near-eye light field frame comprising an array of elemental images. The transmissive display panel is configured to transmit light rays of the near-eye light field frame away from the user's eye and towards an array of curved beam splitters. The curved beam splitters collimate the transmitted light rays and reflect the collimated light rays back towards the transmissive display panel for passing to the user's eye.
    Type: Application
    Filed: May 4, 2020
    Publication date: August 20, 2020
    Inventors: John D. PERREAULT, Patrick LLULL
  • Patent number: 10678049
    Abstract: A near-eye display system includes a display panel to display a lightfield image comprising an array of elemental images and a lenslet array facing the display panel, the lenslet array comprising lenslets with spatially-varying prescriptions, such as different diameters, different focal lengths, and different asphere terms. The lenslet array further may be formed with a planar or non-planar substrate. The system further may include a distortion map comprising a set of transform matrices, each transform matrix configured to pre-distort a corresponding elemental image of a lightfield image so as to compensate for distortion expected to be introduced by a corresponding lenslet of the lenslet array, as well as a rendering component configured to modify the array of elemental images of a rendered lightfield using the distortion map to generate a modified lightfield image, and provide the modified lightfield image for display at the display panel for viewing via the lenslet array.
    Type: Grant
    Filed: December 5, 2017
    Date of Patent: June 9, 2020
    Assignee: GOOGLE LLC
    Inventors: John D. Perreault, Patrick Llull
  • Patent number: 10678056
    Abstract: A near-eye display system includes a transmissive display panel to display a near-eye light field frame comprising an array of elemental images. The transmissive display panel is configured to transmit light rays of the near-eye light field frame away from the user's eye and towards an array of curved beam splitters. The curved beam splitters collimate the transmitted light rays and reflect the collimated light rays back towards the transmissive display panel for passing to the user's eye.
    Type: Grant
    Filed: February 26, 2018
    Date of Patent: June 9, 2020
    Assignee: GOOGLE LLC
    Inventors: John D. Perreault, Patrick Llull
  • Patent number: 10659771
    Abstract: A near-eye display system includes one or more non-planar display panels and a lenslet array to display a near-eye lightfield frame. The near-eye display system further includes a rendering component to render, based on a stereoscopic focus volume associated with a set of display geometry data of the one-or more non-planar display panels, the array of elemental images in the near-eye lightfield frame such that objects within the stereoscopic focus volume are perceived to be in focus by the user's eye. A method of operation of the near-eye display system includes receiving display geometry data for one or more non-planar display panels of the near-eye display system and rendering, based on a stereoscopic focus volume, an array of elemental images at a position within a near-eye lightfield frame such that the non-planar display panels presents objects within the stereoscopic focus volume to be in focus.
    Type: Grant
    Filed: April 13, 2018
    Date of Patent: May 19, 2020
    Assignee: Google LLC
    Inventors: John D. Perreault, Patrick Llull
  • Patent number: 10629105
    Abstract: A near-eye display system includes an array of lenslets overlying a display panel. The display panel includes an array of light projecting elements, each light projecting element being coaxial with an axis of a corresponding lenslet. The display panel further includes an array of light detecting elements and an array of sub-pixel elements. The system further includes a control component configured to activate the array of light projecting elements to project a pattern of light spots toward an eye of the user and to control the array of light detecting elements to capture an image representing a reflection of the projected pattern of light spots from the eye. The system also includes an analysis component to determine displacements between expected positions and actual positions of at least a subset of light spots in the captured image, and to characterize the eye based on the displacements.
    Type: Grant
    Filed: March 9, 2018
    Date of Patent: April 21, 2020
    Assignee: GOOGLE LLC
    Inventors: John D. Perreault, Patrick Llull
  • Patent number: 10546518
    Abstract: A near-eye display system includes a display panel to display a near-eye lightfield frame comprising an array of elemental images and an eye tracking component to track a pose of a user's eye. The system further includes a rendering component to position the array of elemental images within the near-eye lightfield frame based on the pose of the user's eye. A method of operation of the near-eye display system includes determining, using the eye tracking component, a first pose of the user's eye and determining a shift vector for an array of elemental images forming a near-eye lightfield frame based on the first pose of the user's eye. The method further includes rendering the array of elemental images at a position within the near-eye lightfield frame that is based on the shift vector.
    Type: Grant
    Filed: May 15, 2017
    Date of Patent: January 28, 2020
    Assignee: GOOGLE LLC
    Inventors: John D. Perreault, Patrick Llull
  • Publication number: 20190273911
    Abstract: A head-mounted display (HMD) device includes one or more active shutters coupled to a synchronization module. The synchronization module includes a first photodiode configured to detect a synchronization signal for controlling operation of the one or more active shutters. The one or more active shutters are configured to alternate between an open state to pass light and a closed state to block light for reducing a duty cycle of a display screen of a mobile device positioned within the HMD device. The synchronization signal provides a timing to block light from the display screen for a display update duration corresponding to a subset of pixels of the display screen.
    Type: Application
    Filed: September 27, 2018
    Publication date: September 5, 2019
    Inventors: John D. PERREAULT, Jonathan HUANG, Patrick LLULL, Adrian WONG, Justin LEGAKIS
  • Publication number: 20190265477
    Abstract: A near-eye display system includes a transmissive display panel to display a near-eye light field frame comprising an array of elemental images. The transmissive display panel is configured to transmit light rays of the near-eye light field frame away from the user's eye and towards an array of curved beam splitters. The curved beam splitters collimate the transmitted light rays and reflect the collimated light rays back towards the transmissive display panel for passing to the user's eye.
    Type: Application
    Filed: February 26, 2018
    Publication date: August 29, 2019
    Inventors: John D. PERREAULT, Patrick LLULL
  • Publication number: 20190243209
    Abstract: A near-eye display system includes a display panel to present image frames to the eyes of a user for viewing. The system also includes a beam steering assembly facing the display panel that is configurable to displace a light beam incident on the beam steering assembly, thereby laterally shifting light relative to an optical path of the light beam incident on the beam steering assembly. A method of operation of the near-eye display system includes configuring the beam steering assembly in a first configuration state so that the beam steering assembly displaces a light beam incident on the beam steering assembly, such that the displaced light beam is laterally shifted relative to an optical path of the light beam.
    Type: Application
    Filed: February 6, 2018
    Publication date: August 8, 2019
    Inventors: John D. PERREAULT, Patrick LLULL, Brion KOPROWSKI
  • Publication number: 20190243134
    Abstract: A near-eye display system includes a display panel to present image frames to the eyes of a user for viewing. The system also includes a beam steering assembly facing the display panel that is configurable to displace a light beam incident on the beam steering assembly, thereby laterally shifting light relative to an optical path of the light beam incident on the beam steering assembly. The beam steering assembly includes a birefringent plate configurable to replicate a light ray incident on the beam steering assembly such that the replicated light ray is laterally shifted relative to an optical path of the light ray incident on the beam steering assembly.
    Type: Application
    Filed: October 1, 2018
    Publication date: August 8, 2019
    Inventors: John D. Perreault, Patrick Llull, Brion Koprowski