Patents by Inventor Matthew Robert Fulghum

Matthew Robert Fulghum has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11783533
    Abstract: In one embodiment, a method includes receiving a rendered image, motion vector data, and a depth map corresponding to a current frame of a video stream generated by an application, calculating a current three-dimensional position corresponding to the current frame of an object presented in the rendered image using the depth map, calculating a past three-dimensional position of the object corresponding to a past frame using the motion vector data and the depth map, estimating a future three-dimensional position of the object corresponding to a future frame based on the past three-dimensional position and the current three-dimensional position of the object, and generating an extrapolated image corresponding to the future frame by reprojecting the object presented in the rendered image to a future viewpoint associated with the future frame using the future three-dimensional position of the object.
    Type: Grant
    Filed: February 1, 2022
    Date of Patent: October 10, 2023
    Assignee: Meta Platforms Technologies, LLC
    Inventors: Jian Zhang, Xiang Wei, David James Borel, Matthew Robert Fulghum, Neel Bedekar
  • Publication number: 20230199184
    Abstract: Disclosed herein are related to a device and a method of remotely rendering an image. In one approach, a device divides an image of an artificial reality space into a plurality of slices. In one approach, the device encodes a first slice of the plurality of slices. In one approach, the device encodes a portion of a second slice of the plurality of slices, while the device encodes a portion of the first slice. In one approach, the device transmits the encoded first slice of the plurality of slices to a head wearable display. In one approach, the device transmits the encoded second slice of the plurality of slices to the head wearable display, while the device transmits a portion of the encoded first slice to the head wearable display.
    Type: Application
    Filed: February 23, 2023
    Publication date: June 22, 2023
    Inventors: Matthew Robert Fulghum, Reza Nourai, Behnam Bastani
  • Publication number: 20230115057
    Abstract: In one embodiment, a method includes receiving a rendered image, motion vector data, and a depth map corresponding to a current frame of a video stream generated by an application, calculating a current three-dimensional position corresponding to the current frame of an object presented in the rendered image using the depth map, calculating a past three-dimensional position of the object corresponding to a past frame using the motion vector data and the depth map, estimating a future three-dimensional position of the object corresponding to a future frame based on the past three-dimensional position and the current three-dimensional position of the object, and generating an extrapolated image corresponding to the future frame by reprojecting the object presented in the rendered image to a future viewpoint associated with the future frame using the future three-dimensional position of the object.
    Type: Application
    Filed: February 1, 2022
    Publication date: April 13, 2023
    Inventors: Jian Zhang, Xiang Wei, David James Borel, Matthew Robert Fulghum, Neel Bedekar
  • Patent number: 11595646
    Abstract: Disclosed herein are related to a device and a method of remotely rendering an image. In one approach, a device divides an image of an artificial reality space into a plurality of slices. In one approach, the device encodes a first slice of the plurality of slices. In one approach, the device encodes a portion of a second slice of the plurality of slices, while the device encodes a portion of the first slice. In one approach, the device transmits the encoded first slice of the plurality of slices to a head wearable display. In one approach, the device transmits the encoded second slice of the plurality of slices to the head wearable display, while the device transmits a portion of the encoded first slice to the head wearable display.
    Type: Grant
    Filed: June 25, 2020
    Date of Patent: February 28, 2023
    Assignee: Meta Platforms Technologies, LLC
    Inventors: Matthew Robert Fulghum, Reza Nourai, Behnam Bastani
  • Publication number: 20210092373
    Abstract: Disclosed herein are related to a device and a method of remotely rendering an image. In one approach, a device divides an image of an artificial reality space into a plurality of slices. In one approach, the device encodes a first slice of the plurality of slices. In one approach, the device encodes a portion of a second slice of the plurality of slices, while the device encodes a portion of the first slice. In one approach, the device transmits the encoded first slice of the plurality of slices to a head wearable display. In one approach, the device transmits the encoded second slice of the plurality of slices to the head wearable display, while the device transmits a portion of the encoded first slice to the head wearable display.
    Type: Application
    Filed: June 25, 2020
    Publication date: March 25, 2021
    Inventors: Matthew Robert Fulghum, Reza Nourai, Behnam Bastani
  • Patent number: 10692473
    Abstract: Channel selection, quantization, and compression are used to reduce data size of textures used in pixel correction. For example, an apparatus such as a head-mounted display may include circuitry that retrieves a compressed texture from the memory, the compressed texture being generated using various compression techniques, and decompresses the compressed texture to determine adjustment quantization values for sub-pixels based on the compressed values. The circuitry determines reconstructed brightness adjustment levels for the sub-pixels based on the adjustment quantization values, and renders an image frame based on the reconstructed brightness adjustment levels. In some embodiments, the apparatus or a separate device generates the compressed texture in a calibration and stores the texture in a memory of the apparatus for use during the pixel correction.
    Type: Grant
    Filed: March 13, 2018
    Date of Patent: June 23, 2020
    Assignee: Facebook Technologies, LLC
    Inventor: Matthew Robert Fulghum
  • Patent number: 10553164
    Abstract: A system for calibrating a liquid crystal display (LCD) includes a plurality of temperature sensors, a storage medium, and a controller. Each temperature sensor measures a current temperature of at least one pixel in the LCD. The storage medium stores information about latencies for any LC-based pixel, wherein each latency corresponds to a time period for transition from a starting to an ending illumination state for one temperature of the LC-based pixel. The controller determines, based on the current temperature, the transition information and frame information, a time for each pixel in at least a portion of the LCD to transition from a first to a second illumination state. The controller computes, based on transition times, an LC transition time for at least the portion of the LCD and performs calibration of at least the portion of the LCD based on the LC transition time.
    Type: Grant
    Filed: April 8, 2019
    Date of Patent: February 4, 2020
    Assignee: Facebook Technologies, LLC
    Inventors: Evan M. Richards, Matthew Robert Fulghum
  • Patent number: 10339897
    Abstract: A system for calibrating an organic light emitting diode (OLED) display is presented. The calibration system includes a series of photodiodes coupled to at least a portion of illumination elements of the OLED display, a controller, and a driver circuit. The series of photodiodes is configured to measure, for one or more illumination elements, illumination latencies and time delays associated with different brightness levels. The controller obtains, for each illumination element, information about brightness levels associated with image light emitted from that illumination element for at least two consecutive video frames. Based on the measured latencies, the time delays and the information about brightness levels, the controller determines a driving signal for a driver circuit for each illumination element. The driver circuit applies the determined driving signal to that illumination element to calibrate the OLED display.
    Type: Grant
    Filed: March 11, 2019
    Date of Patent: July 2, 2019
    Assignee: Facebook Technologies, LLC
    Inventors: Evan M. Richards, Matthew Robert Fulghum
  • Patent number: 10311808
    Abstract: A system for calibrating a liquid crystal display (LCD) includes a plurality of temperature sensors, a storage medium, and a controller. Each temperature sensor measures a current temperature of at least one pixel in the LCD. The storage medium stores information about latencies for any LC-based pixel, wherein each latency corresponds to a time period for transition from a starting to an ending illumination state for one temperature of the LC-based pixel. The controller determines, based on the current temperature, the transition information and frame information, a time for each pixel in at least a portion of the LCD to transition from a first to a second illumination state. The controller computes, based on transition times, an LC transition time for at least the portion of the LCD and performs calibration of at least the portion of the LCD based on the LC transition time.
    Type: Grant
    Filed: April 24, 2017
    Date of Patent: June 4, 2019
    Assignee: Facebook Technologies, LLC
    Inventors: Evan M. Richards, Matthew Robert Fulghum
  • Patent number: 10276130
    Abstract: A system for calibrating an organic light emitting diode (OLED) display is presented. The calibration system includes a series of photodiodes coupled to at least a portion of illumination elements of the OLED display, a controller, and a driver circuit. The series of photodiodes is configured to measure, for one or more illumination elements, illumination latencies and time delays associated with different brightness levels. The controller obtains, for each illumination element, information about brightness levels associated with image light emitted from that illumination element for at least two consecutive video frames. Based on the measured latencies, the time delays and the information about brightness levels, the controller determines a driving signal for a driver circuit for each illumination element. The driver circuit applies the determined driving signal to that illumination element to calibrate the OLED display.
    Type: Grant
    Filed: September 12, 2018
    Date of Patent: April 30, 2019
    Assignee: Facebook Technologies, LLC
    Inventors: Evan M. Richards, Matthew Robert Fulghum
  • Patent number: 10198978
    Abstract: An optical evaluation workstation evaluates quality metrics (e.g., optical contrast) of optical elements of a HMD. The workstation includes a test pattern, an optical element feed assembly, a light source, a camera and a control module. The light source backlights the test pattern with diffuse light. The optical element feed assembly receives an optical element of a HMD and places the optical element at a first distance from the test pattern corresponding to a distance between the optics block in the HMD and an exit pupil of the HMD. The camera images the test pattern through the optical element and the camera is positioned at a second distance from the test pattern corresponding to a distance between the exit pupil and an electronic display in the HMD. The control module generates a test report for presentation to a user based on the evaluation of the optical element.
    Type: Grant
    Filed: December 15, 2015
    Date of Patent: February 5, 2019
    Assignee: Facebook Technologies, LLC
    Inventors: Evan Mark Richards, Matthew Robert Fulghum, Samuel Redmond D'Amico, Shizhe Shen
  • Patent number: 10140955
    Abstract: A system for calibrating an organic light emitting diode (OLED) display is presented. The calibration system includes a series of photodiodes coupled to at least a portion of illumination elements of the OLED display, a controller, and a driver circuit. The series of photodiodes is configured to measure, for one or more illumination elements, illumination latencies and time delays associated with different brightness levels. The controller obtains, for each illumination element, information about brightness levels associated with image light emitted from that illumination element for at least two consecutive video frames. Based on the measured latencies, the time delays and the information about brightness levels, the controller determines a driving signal for a driver circuit for each illumination element. The driver circuit applies the determined driving signal to that illumination element to calibrate the OLED display.
    Type: Grant
    Filed: April 28, 2017
    Date of Patent: November 27, 2018
    Assignee: Facebook Technologies, LLC
    Inventors: Evan M. Richards, Matthew Robert Fulghum
  • Patent number: 10075685
    Abstract: An optical evaluation workstation evaluates quality metrics (e.g., virtual image distance) of eyecup assemblies of a head mounted display (HMD). The workstation includes an eyecup assembly feed assembly configured to receive an eyecup assembly of a head mounted display (HMD), the eyecup assembly comprising an optics block rigidly fixed at a first distance to an electronic display panel. The optical evaluation workstation includes a camera assembly configured to capture a plurality of images of the electronic display panel through the optics block, the camera assembly comprising a pinhole aperture at an exit pupil position and a camera attached to a lens assembly having an adjustable focus. The optical evaluation workstation includes a control module configured to determine one or more virtual image distances of the eyecup assembly using the plurality of images captured by the camera assembly.
    Type: Grant
    Filed: June 19, 2016
    Date of Patent: September 11, 2018
    Assignee: Oculus VR, LLC
    Inventors: Matthew Robert Fulghum, Samuel Redmond D'Amico, Simon Hallam, Kieran Tobias Levin
  • Patent number: 9979956
    Abstract: An optical evaluation workstation evaluates quality metrics (e.g., sharpness, blemishes) of eyecup assemblies of a head mounted display (HMD). The workstation includes an eyecup assembly feeder, a camera, and a control module. The eyecup assembly feeder is configured to receive an eyecup assembly of a HMD, the eyecup assembly comprising an optics block rigidly fixed at a first distance to an electronic display panel. The camera is configured to capture one or more images of the one or more test patterns presented by the electronic display panel through the optics block. The control module is configured to modify at least one image of the one or more images using a transform, and determine a quality metric for the modified at least one image.
    Type: Grant
    Filed: June 9, 2016
    Date of Patent: May 22, 2018
    Assignee: Oculus VR, LLC
    Inventors: Samuel Redmond D'Amico, Simon Hallam, Kieran Tobias Levin, Matthew Robert Fulghum
  • Publication number: 20170169747
    Abstract: An optical evaluation workstation evaluates quality metrics (e.g., optical contrast) of optical elements of a HMD. The workstation includes a test pattern, an optical element feed assembly, a light source, a camera and a control module. The light source backlights the test pattern with diffuse light. The optical element feed assembly receives an optical element of a HMD and places the optical element at a first distance from the test pattern corresponding to a distance between the optics block in the HMD and an exit pupil of the HMD. The camera images the test pattern through the optical element and the camera is positioned at a second distance from the test pattern corresponding to a distance between the exit pupil and an electronic display in the HMD. The control module generates a test report for presentation to a user based on the evaluation of the optical element.
    Type: Application
    Filed: December 15, 2015
    Publication date: June 15, 2017
    Inventors: Evan Mark Richards, Matthew Robert Fulghum, Samuel Redmond D'Amico, Shizhe Shen