Patents by Inventor Patrick Llull
Patrick Llull has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11887550Abstract: A display system including a tracking subsystem configured to track one of a pose of a head of a viewer or a pose of an eye of the viewer. The display system further includes an image correction module configured to, for each pixel of at least a subset of pixels of an input image, determine a pixel view angle for the pixel based on the pose of the head or the pose of the eye, determine a corrected pixel value based on an input pixel value of the pixel in the input image and based on the pixel view angle; and provide the corrected pixel value for the pixel in an angle-corrected image corresponding to the input image. The display system further includes a display panel to display the angle-corrected image.Type: GrantFiled: December 12, 2019Date of Patent: January 30, 2024Assignee: GOOGLE LLCInventors: Patrick Llull, John D. Perreault, Andrew Huibers
-
Publication number: 20220319453Abstract: A display system including a tracking subsystem configured to track one of a pose of a head of a viewer or a pose of an eye of the viewer. The display system further includes an image correction module configured to, for each pixel of at least a subset of pixels of an input image, determine a pixel view angle for the pixel based on the pose of the head or the pose of the eye, determine a corrected pixel value based on an input pixel value of the pixel in the input image and based on the pixel view angle; and provide the corrected pixel value for the pixel in an angle-corrected image corresponding to the input image. The display system further includes a display panel to display the angle-corrected image.Type: ApplicationFiled: December 12, 2019Publication date: October 6, 2022Inventors: Patrick Llull, John D. Perreault, Andrew Huibers
-
Patent number: 11435576Abstract: A near-eye display system includes a display panel to display a near-eye lightfield frame comprising an array of elemental images and an eye tracking component to track a pose of a user's eye. The system further includes a lenslet array and a rendering component to adjust the focal points of the array of elemental images in the integral lightfield frame based on the pose of the user's eye. A method of operation of the near-eye display system includes determining, using an eye tracking component of the near-eye display system, a first pose of a user's eye and determining a desired focal point for an array of elemental images forming an integral lightfield frame based on the first pose of the user's eye. The method further includes changing the focal length of light projecting out of a lenslet array based on the first pose of the user's eye.Type: GrantFiled: October 27, 2020Date of Patent: September 6, 2022Assignee: Google LLCInventors: John D. Perreault, Patrick Llull
-
Patent number: 11314083Abstract: A near-eye display system includes a display panel to present image frames to the eyes of a user for viewing. The system also includes a beam steering assembly facing the display panel that is configurable to displace a light beam incident on the beam steering assembly, thereby laterally shifting light relative to an optical path of the light beam incident on the beam steering assembly. The beam steering assembly includes a birefringent plate configurable to replicate a light ray incident on the beam steering assembly such that the replicated light ray is laterally shifted relative to an optical path of the light ray incident on the beam steering assembly.Type: GrantFiled: October 1, 2018Date of Patent: April 26, 2022Assignee: Google LLCInventors: John D. Perreault, Patrick Llull, Brion Koprowski
-
Patent number: 11181801Abstract: A near-eye display system includes a display panel to present image frames to the eyes of a user for viewing. The system also includes a beam steering assembly facing the display panel that is configurable to displace a light beam incident on the beam steering assembly, thereby laterally shifting light relative to an optical path of the light beam incident on the beam steering assembly. A method of operation of the near-eye display system includes configuring the beam steering assembly in a first configuration state so that the beam steering assembly displaces a light beam incident on the beam steering assembly, such that the displaced light beam is laterally shifted relative to an optical path of the light beam.Type: GrantFiled: February 6, 2018Date of Patent: November 23, 2021Assignee: Google LLCInventors: John D. Perreault, Patrick Llull, Brion Koprowski
-
Patent number: 11022806Abstract: A near-eye display system includes a transmissive display panel to display a near-eye light field frame comprising an array of elemental images. The transmissive display panel is configured to transmit light rays of the near-eye light field frame away from the user's eye and towards an array of curved beam splitters. The curved beam splitters collimate the transmitted light rays and reflect the collimated light rays back towards the transmissive display panel for passing to the user's eye.Type: GrantFiled: May 4, 2020Date of Patent: June 1, 2021Assignee: Google LLCInventors: John D. Perreault, Patrick Llull
-
Publication number: 20210076025Abstract: A near-eye display system includes a display panel to display a near-eye lightfield frame comprising an array of elemental images and an eye tracking component to track a pose of a user's eye. The system further includes a lenslet array and a rendering component to adjust the focal points of the array of elemental images in the integral lightfield frame based on the pose of the user's eye. A method of operation of the near-eye display system includes determining, using an eye tracking component of the near-eye display system, a first pose of a user's eye and determining a desired focal point for an array of elemental images forming an integral lightfield frame based on the first pose of the user's eye. The method further includes changing the focal length of light projecting out of a lenslet array based on the first pose of the user's eye.Type: ApplicationFiled: October 27, 2020Publication date: March 11, 2021Inventors: John D. Perreault, Patrick Llull
-
Patent number: 10855977Abstract: A near-eye display system includes a display panel to display a near-eye lightfield frame comprising an array of elemental images and an eye tracking component to track a pose of a user's eye. The system further includes a lenslet array and a rendering component to adjust the focal points of the array of elemental images in the integral lightfield frame based on the pose of the user's eye. A method of operation of the near-eye display system includes determining, using an eye tracking component of the near-eye display system, a first pose of a user's eye and determining a desired focal point for an array of elemental images forming an integral lightfield frame based on the first pose of the user's eye. The method further includes changing the focal length of light projecting out of a lenslet array based on the first pose of the user's eye.Type: GrantFiled: February 15, 2018Date of Patent: December 1, 2020Assignee: GOOGLE LLCInventors: John D. Perreault, Patrick Llull
-
Patent number: 10827164Abstract: A head-mounted display (HMD) device includes one or more active shutters coupled to a synchronization module. The synchronization module includes a first photodiode configured to detect a synchronization signal for controlling operation of the one or more active shutters. The one or more active shutters are configured to alternate between an open state to pass light and a closed state to block light for reducing a duty cycle of a display screen of a mobile device positioned within the HMD device. The synchronization signal provides a timing to block light from the display screen for a display update duration corresponding to a subset of pixels of the display screen.Type: GrantFiled: September 27, 2018Date of Patent: November 3, 2020Assignee: Google LLCInventors: John D. Perreault, Jonathan Huang, Patrick Llull, Adrian Wong, Justin Legakis
-
Patent number: 10764552Abstract: A near-eye display system includes display panel to display a near-eye lightfield frame comprising an array of elemental images and a lenslet array to present the integral lightfield frame to a user's eye. The system further includes a rendering component to generate an array of elemental images based at least in part on a sparse sampling of a source image to decrease an overlap of image data contained within each individual elemental of the array of elemental images. A method of operation of the near-eye display system includes generating an array of elemental images forming the integral lightfield frame based on a sparse sampling of the current viewpoint of the subject object to decrease an overlap of image data contained within each individual elemental image of the array.Type: GrantFiled: February 15, 2018Date of Patent: September 1, 2020Assignee: GOOGLE LLCInventors: John D. Perreault, Patrick Llull
-
Publication number: 20200264438Abstract: A near-eye display system includes a transmissive display panel to display a near-eye light field frame comprising an array of elemental images. The transmissive display panel is configured to transmit light rays of the near-eye light field frame away from the user's eye and towards an array of curved beam splitters. The curved beam splitters collimate the transmitted light rays and reflect the collimated light rays back towards the transmissive display panel for passing to the user's eye.Type: ApplicationFiled: May 4, 2020Publication date: August 20, 2020Inventors: John D. PERREAULT, Patrick LLULL
-
Patent number: 10678049Abstract: A near-eye display system includes a display panel to display a lightfield image comprising an array of elemental images and a lenslet array facing the display panel, the lenslet array comprising lenslets with spatially-varying prescriptions, such as different diameters, different focal lengths, and different asphere terms. The lenslet array further may be formed with a planar or non-planar substrate. The system further may include a distortion map comprising a set of transform matrices, each transform matrix configured to pre-distort a corresponding elemental image of a lightfield image so as to compensate for distortion expected to be introduced by a corresponding lenslet of the lenslet array, as well as a rendering component configured to modify the array of elemental images of a rendered lightfield using the distortion map to generate a modified lightfield image, and provide the modified lightfield image for display at the display panel for viewing via the lenslet array.Type: GrantFiled: December 5, 2017Date of Patent: June 9, 2020Assignee: GOOGLE LLCInventors: John D. Perreault, Patrick Llull
-
Patent number: 10678056Abstract: A near-eye display system includes a transmissive display panel to display a near-eye light field frame comprising an array of elemental images. The transmissive display panel is configured to transmit light rays of the near-eye light field frame away from the user's eye and towards an array of curved beam splitters. The curved beam splitters collimate the transmitted light rays and reflect the collimated light rays back towards the transmissive display panel for passing to the user's eye.Type: GrantFiled: February 26, 2018Date of Patent: June 9, 2020Assignee: GOOGLE LLCInventors: John D. Perreault, Patrick Llull
-
Patent number: 10659771Abstract: A near-eye display system includes one or more non-planar display panels and a lenslet array to display a near-eye lightfield frame. The near-eye display system further includes a rendering component to render, based on a stereoscopic focus volume associated with a set of display geometry data of the one-or more non-planar display panels, the array of elemental images in the near-eye lightfield frame such that objects within the stereoscopic focus volume are perceived to be in focus by the user's eye. A method of operation of the near-eye display system includes receiving display geometry data for one or more non-planar display panels of the near-eye display system and rendering, based on a stereoscopic focus volume, an array of elemental images at a position within a near-eye lightfield frame such that the non-planar display panels presents objects within the stereoscopic focus volume to be in focus.Type: GrantFiled: April 13, 2018Date of Patent: May 19, 2020Assignee: Google LLCInventors: John D. Perreault, Patrick Llull
-
Near-eye display with frame rendering based on reflected wavefront analysis for eye characterization
Patent number: 10629105Abstract: A near-eye display system includes an array of lenslets overlying a display panel. The display panel includes an array of light projecting elements, each light projecting element being coaxial with an axis of a corresponding lenslet. The display panel further includes an array of light detecting elements and an array of sub-pixel elements. The system further includes a control component configured to activate the array of light projecting elements to project a pattern of light spots toward an eye of the user and to control the array of light detecting elements to capture an image representing a reflection of the projected pattern of light spots from the eye. The system also includes an analysis component to determine displacements between expected positions and actual positions of at least a subset of light spots in the captured image, and to characterize the eye based on the displacements.Type: GrantFiled: March 9, 2018Date of Patent: April 21, 2020Assignee: GOOGLE LLCInventors: John D. Perreault, Patrick Llull -
Patent number: 10546518Abstract: A near-eye display system includes a display panel to display a near-eye lightfield frame comprising an array of elemental images and an eye tracking component to track a pose of a user's eye. The system further includes a rendering component to position the array of elemental images within the near-eye lightfield frame based on the pose of the user's eye. A method of operation of the near-eye display system includes determining, using the eye tracking component, a first pose of the user's eye and determining a shift vector for an array of elemental images forming a near-eye lightfield frame based on the first pose of the user's eye. The method further includes rendering the array of elemental images at a position within the near-eye lightfield frame that is based on the shift vector.Type: GrantFiled: May 15, 2017Date of Patent: January 28, 2020Assignee: GOOGLE LLCInventors: John D. Perreault, Patrick Llull
-
Publication number: 20190273911Abstract: A head-mounted display (HMD) device includes one or more active shutters coupled to a synchronization module. The synchronization module includes a first photodiode configured to detect a synchronization signal for controlling operation of the one or more active shutters. The one or more active shutters are configured to alternate between an open state to pass light and a closed state to block light for reducing a duty cycle of a display screen of a mobile device positioned within the HMD device. The synchronization signal provides a timing to block light from the display screen for a display update duration corresponding to a subset of pixels of the display screen.Type: ApplicationFiled: September 27, 2018Publication date: September 5, 2019Inventors: John D. PERREAULT, Jonathan HUANG, Patrick LLULL, Adrian WONG, Justin LEGAKIS
-
Publication number: 20190265477Abstract: A near-eye display system includes a transmissive display panel to display a near-eye light field frame comprising an array of elemental images. The transmissive display panel is configured to transmit light rays of the near-eye light field frame away from the user's eye and towards an array of curved beam splitters. The curved beam splitters collimate the transmitted light rays and reflect the collimated light rays back towards the transmissive display panel for passing to the user's eye.Type: ApplicationFiled: February 26, 2018Publication date: August 29, 2019Inventors: John D. PERREAULT, Patrick LLULL
-
Publication number: 20190243209Abstract: A near-eye display system includes a display panel to present image frames to the eyes of a user for viewing. The system also includes a beam steering assembly facing the display panel that is configurable to displace a light beam incident on the beam steering assembly, thereby laterally shifting light relative to an optical path of the light beam incident on the beam steering assembly. A method of operation of the near-eye display system includes configuring the beam steering assembly in a first configuration state so that the beam steering assembly displaces a light beam incident on the beam steering assembly, such that the displaced light beam is laterally shifted relative to an optical path of the light beam.Type: ApplicationFiled: February 6, 2018Publication date: August 8, 2019Inventors: John D. PERREAULT, Patrick LLULL, Brion KOPROWSKI
-
Publication number: 20190243134Abstract: A near-eye display system includes a display panel to present image frames to the eyes of a user for viewing. The system also includes a beam steering assembly facing the display panel that is configurable to displace a light beam incident on the beam steering assembly, thereby laterally shifting light relative to an optical path of the light beam incident on the beam steering assembly. The beam steering assembly includes a birefringent plate configurable to replicate a light ray incident on the beam steering assembly such that the replicated light ray is laterally shifted relative to an optical path of the light ray incident on the beam steering assembly.Type: ApplicationFiled: October 1, 2018Publication date: August 8, 2019Inventors: John D. Perreault, Patrick Llull, Brion Koprowski