Patents by Inventor Matthew Robert Fulghum
Matthew Robert Fulghum has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11783533Abstract: In one embodiment, a method includes receiving a rendered image, motion vector data, and a depth map corresponding to a current frame of a video stream generated by an application, calculating a current three-dimensional position corresponding to the current frame of an object presented in the rendered image using the depth map, calculating a past three-dimensional position of the object corresponding to a past frame using the motion vector data and the depth map, estimating a future three-dimensional position of the object corresponding to a future frame based on the past three-dimensional position and the current three-dimensional position of the object, and generating an extrapolated image corresponding to the future frame by reprojecting the object presented in the rendered image to a future viewpoint associated with the future frame using the future three-dimensional position of the object.Type: GrantFiled: February 1, 2022Date of Patent: October 10, 2023Assignee: Meta Platforms Technologies, LLCInventors: Jian Zhang, Xiang Wei, David James Borel, Matthew Robert Fulghum, Neel Bedekar
-
Publication number: 20230199184Abstract: Disclosed herein are related to a device and a method of remotely rendering an image. In one approach, a device divides an image of an artificial reality space into a plurality of slices. In one approach, the device encodes a first slice of the plurality of slices. In one approach, the device encodes a portion of a second slice of the plurality of slices, while the device encodes a portion of the first slice. In one approach, the device transmits the encoded first slice of the plurality of slices to a head wearable display. In one approach, the device transmits the encoded second slice of the plurality of slices to the head wearable display, while the device transmits a portion of the encoded first slice to the head wearable display.Type: ApplicationFiled: February 23, 2023Publication date: June 22, 2023Inventors: Matthew Robert Fulghum, Reza Nourai, Behnam Bastani
-
Publication number: 20230115057Abstract: In one embodiment, a method includes receiving a rendered image, motion vector data, and a depth map corresponding to a current frame of a video stream generated by an application, calculating a current three-dimensional position corresponding to the current frame of an object presented in the rendered image using the depth map, calculating a past three-dimensional position of the object corresponding to a past frame using the motion vector data and the depth map, estimating a future three-dimensional position of the object corresponding to a future frame based on the past three-dimensional position and the current three-dimensional position of the object, and generating an extrapolated image corresponding to the future frame by reprojecting the object presented in the rendered image to a future viewpoint associated with the future frame using the future three-dimensional position of the object.Type: ApplicationFiled: February 1, 2022Publication date: April 13, 2023Inventors: Jian Zhang, Xiang Wei, David James Borel, Matthew Robert Fulghum, Neel Bedekar
-
Patent number: 11595646Abstract: Disclosed herein are related to a device and a method of remotely rendering an image. In one approach, a device divides an image of an artificial reality space into a plurality of slices. In one approach, the device encodes a first slice of the plurality of slices. In one approach, the device encodes a portion of a second slice of the plurality of slices, while the device encodes a portion of the first slice. In one approach, the device transmits the encoded first slice of the plurality of slices to a head wearable display. In one approach, the device transmits the encoded second slice of the plurality of slices to the head wearable display, while the device transmits a portion of the encoded first slice to the head wearable display.Type: GrantFiled: June 25, 2020Date of Patent: February 28, 2023Assignee: Meta Platforms Technologies, LLCInventors: Matthew Robert Fulghum, Reza Nourai, Behnam Bastani
-
Publication number: 20210092373Abstract: Disclosed herein are related to a device and a method of remotely rendering an image. In one approach, a device divides an image of an artificial reality space into a plurality of slices. In one approach, the device encodes a first slice of the plurality of slices. In one approach, the device encodes a portion of a second slice of the plurality of slices, while the device encodes a portion of the first slice. In one approach, the device transmits the encoded first slice of the plurality of slices to a head wearable display. In one approach, the device transmits the encoded second slice of the plurality of slices to the head wearable display, while the device transmits a portion of the encoded first slice to the head wearable display.Type: ApplicationFiled: June 25, 2020Publication date: March 25, 2021Inventors: Matthew Robert Fulghum, Reza Nourai, Behnam Bastani
-
Patent number: 10692473Abstract: Channel selection, quantization, and compression are used to reduce data size of textures used in pixel correction. For example, an apparatus such as a head-mounted display may include circuitry that retrieves a compressed texture from the memory, the compressed texture being generated using various compression techniques, and decompresses the compressed texture to determine adjustment quantization values for sub-pixels based on the compressed values. The circuitry determines reconstructed brightness adjustment levels for the sub-pixels based on the adjustment quantization values, and renders an image frame based on the reconstructed brightness adjustment levels. In some embodiments, the apparatus or a separate device generates the compressed texture in a calibration and stores the texture in a memory of the apparatus for use during the pixel correction.Type: GrantFiled: March 13, 2018Date of Patent: June 23, 2020Assignee: Facebook Technologies, LLCInventor: Matthew Robert Fulghum
-
Patent number: 10553164Abstract: A system for calibrating a liquid crystal display (LCD) includes a plurality of temperature sensors, a storage medium, and a controller. Each temperature sensor measures a current temperature of at least one pixel in the LCD. The storage medium stores information about latencies for any LC-based pixel, wherein each latency corresponds to a time period for transition from a starting to an ending illumination state for one temperature of the LC-based pixel. The controller determines, based on the current temperature, the transition information and frame information, a time for each pixel in at least a portion of the LCD to transition from a first to a second illumination state. The controller computes, based on transition times, an LC transition time for at least the portion of the LCD and performs calibration of at least the portion of the LCD based on the LC transition time.Type: GrantFiled: April 8, 2019Date of Patent: February 4, 2020Assignee: Facebook Technologies, LLCInventors: Evan M. Richards, Matthew Robert Fulghum
-
Patent number: 10339897Abstract: A system for calibrating an organic light emitting diode (OLED) display is presented. The calibration system includes a series of photodiodes coupled to at least a portion of illumination elements of the OLED display, a controller, and a driver circuit. The series of photodiodes is configured to measure, for one or more illumination elements, illumination latencies and time delays associated with different brightness levels. The controller obtains, for each illumination element, information about brightness levels associated with image light emitted from that illumination element for at least two consecutive video frames. Based on the measured latencies, the time delays and the information about brightness levels, the controller determines a driving signal for a driver circuit for each illumination element. The driver circuit applies the determined driving signal to that illumination element to calibrate the OLED display.Type: GrantFiled: March 11, 2019Date of Patent: July 2, 2019Assignee: Facebook Technologies, LLCInventors: Evan M. Richards, Matthew Robert Fulghum
-
Patent number: 10311808Abstract: A system for calibrating a liquid crystal display (LCD) includes a plurality of temperature sensors, a storage medium, and a controller. Each temperature sensor measures a current temperature of at least one pixel in the LCD. The storage medium stores information about latencies for any LC-based pixel, wherein each latency corresponds to a time period for transition from a starting to an ending illumination state for one temperature of the LC-based pixel. The controller determines, based on the current temperature, the transition information and frame information, a time for each pixel in at least a portion of the LCD to transition from a first to a second illumination state. The controller computes, based on transition times, an LC transition time for at least the portion of the LCD and performs calibration of at least the portion of the LCD based on the LC transition time.Type: GrantFiled: April 24, 2017Date of Patent: June 4, 2019Assignee: Facebook Technologies, LLCInventors: Evan M. Richards, Matthew Robert Fulghum
-
Patent number: 10276130Abstract: A system for calibrating an organic light emitting diode (OLED) display is presented. The calibration system includes a series of photodiodes coupled to at least a portion of illumination elements of the OLED display, a controller, and a driver circuit. The series of photodiodes is configured to measure, for one or more illumination elements, illumination latencies and time delays associated with different brightness levels. The controller obtains, for each illumination element, information about brightness levels associated with image light emitted from that illumination element for at least two consecutive video frames. Based on the measured latencies, the time delays and the information about brightness levels, the controller determines a driving signal for a driver circuit for each illumination element. The driver circuit applies the determined driving signal to that illumination element to calibrate the OLED display.Type: GrantFiled: September 12, 2018Date of Patent: April 30, 2019Assignee: Facebook Technologies, LLCInventors: Evan M. Richards, Matthew Robert Fulghum
-
Patent number: 10198978Abstract: An optical evaluation workstation evaluates quality metrics (e.g., optical contrast) of optical elements of a HMD. The workstation includes a test pattern, an optical element feed assembly, a light source, a camera and a control module. The light source backlights the test pattern with diffuse light. The optical element feed assembly receives an optical element of a HMD and places the optical element at a first distance from the test pattern corresponding to a distance between the optics block in the HMD and an exit pupil of the HMD. The camera images the test pattern through the optical element and the camera is positioned at a second distance from the test pattern corresponding to a distance between the exit pupil and an electronic display in the HMD. The control module generates a test report for presentation to a user based on the evaluation of the optical element.Type: GrantFiled: December 15, 2015Date of Patent: February 5, 2019Assignee: Facebook Technologies, LLCInventors: Evan Mark Richards, Matthew Robert Fulghum, Samuel Redmond D'Amico, Shizhe Shen
-
Patent number: 10140955Abstract: A system for calibrating an organic light emitting diode (OLED) display is presented. The calibration system includes a series of photodiodes coupled to at least a portion of illumination elements of the OLED display, a controller, and a driver circuit. The series of photodiodes is configured to measure, for one or more illumination elements, illumination latencies and time delays associated with different brightness levels. The controller obtains, for each illumination element, information about brightness levels associated with image light emitted from that illumination element for at least two consecutive video frames. Based on the measured latencies, the time delays and the information about brightness levels, the controller determines a driving signal for a driver circuit for each illumination element. The driver circuit applies the determined driving signal to that illumination element to calibrate the OLED display.Type: GrantFiled: April 28, 2017Date of Patent: November 27, 2018Assignee: Facebook Technologies, LLCInventors: Evan M. Richards, Matthew Robert Fulghum
-
Patent number: 10075685Abstract: An optical evaluation workstation evaluates quality metrics (e.g., virtual image distance) of eyecup assemblies of a head mounted display (HMD). The workstation includes an eyecup assembly feed assembly configured to receive an eyecup assembly of a head mounted display (HMD), the eyecup assembly comprising an optics block rigidly fixed at a first distance to an electronic display panel. The optical evaluation workstation includes a camera assembly configured to capture a plurality of images of the electronic display panel through the optics block, the camera assembly comprising a pinhole aperture at an exit pupil position and a camera attached to a lens assembly having an adjustable focus. The optical evaluation workstation includes a control module configured to determine one or more virtual image distances of the eyecup assembly using the plurality of images captured by the camera assembly.Type: GrantFiled: June 19, 2016Date of Patent: September 11, 2018Assignee: Oculus VR, LLCInventors: Matthew Robert Fulghum, Samuel Redmond D'Amico, Simon Hallam, Kieran Tobias Levin
-
Patent number: 9979956Abstract: An optical evaluation workstation evaluates quality metrics (e.g., sharpness, blemishes) of eyecup assemblies of a head mounted display (HMD). The workstation includes an eyecup assembly feeder, a camera, and a control module. The eyecup assembly feeder is configured to receive an eyecup assembly of a HMD, the eyecup assembly comprising an optics block rigidly fixed at a first distance to an electronic display panel. The camera is configured to capture one or more images of the one or more test patterns presented by the electronic display panel through the optics block. The control module is configured to modify at least one image of the one or more images using a transform, and determine a quality metric for the modified at least one image.Type: GrantFiled: June 9, 2016Date of Patent: May 22, 2018Assignee: Oculus VR, LLCInventors: Samuel Redmond D'Amico, Simon Hallam, Kieran Tobias Levin, Matthew Robert Fulghum
-
Publication number: 20170169747Abstract: An optical evaluation workstation evaluates quality metrics (e.g., optical contrast) of optical elements of a HMD. The workstation includes a test pattern, an optical element feed assembly, a light source, a camera and a control module. The light source backlights the test pattern with diffuse light. The optical element feed assembly receives an optical element of a HMD and places the optical element at a first distance from the test pattern corresponding to a distance between the optics block in the HMD and an exit pupil of the HMD. The camera images the test pattern through the optical element and the camera is positioned at a second distance from the test pattern corresponding to a distance between the exit pupil and an electronic display in the HMD. The control module generates a test report for presentation to a user based on the evaluation of the optical element.Type: ApplicationFiled: December 15, 2015Publication date: June 15, 2017Inventors: Evan Mark Richards, Matthew Robert Fulghum, Samuel Redmond D'Amico, Shizhe Shen