Patents by Inventor Mark Timothy Sullivan

Mark Timothy Sullivan has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11709364
    Abstract: A projector for illuminating a target area is presented. The projector includes an array of emitters positioned on a substrate according to a distribution. Each emitter in the array of emitters has a non-circular emission area. Operation of at least a portion of the array of emitters is controlled based in part on emission instructions to emit light. The light from the projector is configured to illuminate the target area. The projector can be part of a depth camera assembly for depth sensing of a local area, or part of an eye tracker for determining a gaze direction for an eye.
    Type: Grant
    Filed: April 25, 2022
    Date of Patent: July 25, 2023
    Assignee: Meta Platforms Technologies, LLC
    Inventors: Zhaoming Zhu, Mark Timothy Sullivan, Jonatan Ginzburg
  • Patent number: 11681209
    Abstract: The disclosed structured light projector may include (1) a light source having a light-emitting side that emits light, (2) a solid optical spacer element having a first side securely coupled to the light-emitting side of the light source, and (3) a diffractive optical element (DOE) stack including one or more DOEs, where the DOE stack includes (a) a light-receiving side securely coupled to a second side of the solid optical spacer element opposite the first side, and (b) a light-emitting side opposite the light-receiving side that emits structured light in response to the light received from the light-emitting side of the light source via the solid optical spacer element. Various other devices and methods are also disclosed.
    Type: Grant
    Filed: February 25, 2022
    Date of Patent: June 20, 2023
    Assignee: Meta Platforms Technologies, LLC
    Inventors: Mark Timothy Sullivan, Jonatan Ginzburg
  • Patent number: 11586036
    Abstract: A depth camera assembly (DCA) for depth sensing of a local area includes a structured light generator, an imaging device, and a controller. The structured light generator illuminates the local area with a structured light pattern. The structured light generator includes a programmable diffractive optical element (PDOE) that generates diffracted scanning beams using optical beams. The PDOE functions as a dynamic diffraction grating that dynamically adjusts diffraction of the optical beams to generate the diffracted scanning beams of different patterns. The diffracted scanning beams are projected as the structured light pattern into the local area, wherein the structured light pattern is dynamically adjustable based on the PDOE. The imaging device captures image(s) of at least a portion of the structured light pattern reflected from object(s) in the local area. The controller determines depth information for the object(s) based on the captured image(s).
    Type: Grant
    Filed: December 23, 2019
    Date of Patent: February 21, 2023
    Assignee: Meta Platforms Technologies, LLC
    Inventors: Andrew Matthew Bardagjy, Joseph Duggan, Cina Hazegh, Fei Liu, Mark Timothy Sullivan, Simon Morris Shand Weiss
  • Patent number: 11450015
    Abstract: A depth camera assembly for depth sensing of a local area includes a structured light generator, an imaging device, and a controller. The structured light generator illuminates a local area with structured light and includes an illumination source, a mounting element, and a diffractive optical element (DOE) mounted on the mounting element. The mounting element can have a plurality of adjustable positions relative to the illumination source based on emission instructions from the controller. The DOE generates, using light emitted from the illumination source, diffracted scanning beams that are projected as the structured light into the local area. A pattern of the structured light is dynamically adjustable and unique for each adjustable position of the mounting element. The imaging device captures image(s) of the structured light reflected from object(s) in the local area. The controller determines depth information for the object(s) based in part on the captured image(s).
    Type: Grant
    Filed: January 15, 2020
    Date of Patent: September 20, 2022
    Assignee: Meta Platforms Technologies, LLC
    Inventors: Andrew Matthew Bardagjy, Joseph Duggan, Cina Hazegh, Fei Liu, Mark Timothy Sullivan, Simon Morris Shand Weiss
  • Patent number: 11355901
    Abstract: A vertical cavity surface emitting laser (VCSEL) die package includes a bottom substrate comprising a bottom contact pad electrically contacting a bottom electrode on a bottom surface of a VCSEL die. The VCSEL die package includes a submount including a submount contact pad electrically contacting a first electrode on another surface of the VCSEL die. The submount contact pad overlaps a portion of the first electrode, wherein the VCSEL die is positioned between the submount and the bottom substrate.
    Type: Grant
    Filed: December 23, 2019
    Date of Patent: June 7, 2022
    Assignee: Facebook Technologies, LLC
    Inventors: Jonatan Ginzburg, Mark Timothy Sullivan
  • Patent number: 11353636
    Abstract: A mount includes an active area in which an optical element may be located. The mount is bonded to a neighboring mount using adhesives that are placed on a top side of a wall structure of the mount. Migration of the adhesives from the wall of the mount into the active area is prevented by use of groove-structures and micro-wall structures located in a buffer area of the mount that circumscribes the active area. In some embodiments, a diffuser is located in the buffer area of the mount to redirect the emitted light as desired for a particular application.
    Type: Grant
    Filed: January 24, 2020
    Date of Patent: June 7, 2022
    Assignee: Facebook Technologies, LLC
    Inventors: Mark Timothy Sullivan, Yaakov Yonatan Layosh, Danilo Bueno
  • Patent number: 11340456
    Abstract: A projector for illuminating a target area is presented. The projector includes an array of emitters positioned on a substrate according to a distribution. Each emitter in the array of emitters has a non-circular emission area. Operation of at least a portion of the array of emitters is controlled based in part on emission instructions to emit light. The light from the projector is configured to illuminate the target area. The projector can be part of a depth camera assembly for depth sensing of a local area, or part of an eye tracker for determining a gaze direction for an eye.
    Type: Grant
    Filed: July 24, 2019
    Date of Patent: May 24, 2022
    Assignee: Facebook Technologies, LLC
    Inventors: Zhaoming Zhu, Mark Timothy Sullivan, Jonatan Ginzburg
  • Patent number: 11333895
    Abstract: The disclosed system may include (1) a diffractive optical element (DOE) stack including one or more DOEs, where the DOE stack generates, in response to incoming light received at a first side of the DOE stack, structured light from a second side of the DOE stack opposite the first side, (2) a primary light source that emits the incoming light toward the first side of the DOE stack, and (3) at least one photodetector that detects light emitted from an edge of each of at least one of the DOEs of the DOE stack, where the edge is located between the first side and the second side of the DOE stack. Various other methods and systems are also disclosed.
    Type: Grant
    Filed: May 8, 2019
    Date of Patent: May 17, 2022
    Assignee: Facebook Technologies, LLC
    Inventors: Jonatan Ginzburg, Mark Timothy Sullivan, Benjamin Nicholas Jones
  • Patent number: 11330193
    Abstract: An imaging device for imaging of a local area surrounding the imaging device. The imaging device includes a lens assembly, a filtering element and a detector. The lens assembly is configured to receive light from a local area surrounding the imaging device and to direct at least a portion of the received light to the detector. The filtering element is placed in the imaging device within the lens assembly such that light is incident at a surface of the filtering element within a range of angles determined by a design range of angles at which the filtering element is designed to filter light. The detector is configured to capture image(s) of the local area including the filtered light. The imaging device can be integrated into a depth camera assembly for determining depth information of object(s) in the local area based on the captured image(s).
    Type: Grant
    Filed: August 27, 2020
    Date of Patent: May 10, 2022
    Assignee: Facebook Technologies, LLC
    Inventors: Andrew Matthew Bardagjy, Joseph Duggan, Cina Hazegh, Fei Liu, Mark Timothy Sullivan, Simon Morris Shand Weiss
  • Publication number: 20210231842
    Abstract: A mount includes an active area in which an optical element may be located. The mount is bonded to a neighboring mount using adhesives that are placed on a top side of a wall structure of the mount. Migration of the adhesives from the wall of the mount into the active area is prevented by use of groove-structures and micro-wall structures located in a buffer area of the mount that circumscribes the active area. In some embodiments, a diffuser is located in the buffer area of the mount to redirect the emitted light as desired for a particular application.
    Type: Application
    Filed: January 24, 2020
    Publication date: July 29, 2021
    Inventors: Mark Timothy Sullivan, Yaakov Yonatan Layosh, Danilo Bueno
  • Patent number: 10948283
    Abstract: A head-mounted display (HMD) system includes a projector system configured to emit a structured light (SL) pattern onto one or more objects in a local area, the projected SL pattern comprises at least a first SL pattern having a first field of view (FOV) corresponding to a first tileable boundary, and a second SL pattern having a second FOV corresponding to a second tileable boundary. Each of the projected SL patterns contains fiducials at predetermined locations within the SL pattern. An imaging device captures images of the local area including at least portions of the first SL pattern or the second SL patterns. The detected locations of the fiducials in the captured images is used to determine the boundary locations of the first and second SL patterns. Depth information of the local area is generated based upon the determined locations of the first and second SL patterns.
    Type: Grant
    Filed: March 3, 2020
    Date of Patent: March 16, 2021
    Assignee: Facebook Technologies, LLC
    Inventors: Mark Timothy Sullivan, Andrew Matthew Bardagjy, Joseph Duggan, Fei Liu, Simon Morris Shand Weiss
  • Publication number: 20200396362
    Abstract: An imaging device for imaging of a local area surrounding the imaging device. The imaging device includes a lens assembly, a filtering element and a detector. The lens assembly is configured to receive light from a local area surrounding the imaging device and to direct at least a portion of the received light to the detector. The filtering element is placed in the imaging device within the lens assembly such that light is incident at a surface of the filtering element within a range of angles determined by a design range of angles at which the filtering element is designed to filter light. The detector is configured to capture image(s) of the local area including the filtered light. The imaging device can be integrated into a depth camera assembly for determining depth information of object(s) in the local area based on the captured image(s).
    Type: Application
    Filed: August 27, 2020
    Publication date: December 17, 2020
    Inventors: Andrew Matthew Bardagjy, Joseph Duggan, Cina Hazegh, Fei Liu, Mark Timothy Sullivan, Simon Morris Shand Weiss
  • Patent number: 10791283
    Abstract: An imaging device for imaging of a local area surrounding the imaging device. The imaging device includes a lens assembly, a filtering element and a detector. The lens assembly is configured to receive light from a local area surrounding the imaging device and to direct at least a portion of the received light to the detector. The filtering element is placed in the imaging device within the lens assembly such that light is incident at a surface of the filtering element within a range of angles determined by a design range of angles at which the filtering element is designed to filter light. The detector is configured to capture image(s) of the local area including the filtered light. The imaging device can be integrated into a depth camera assembly for determining depth information of object(s) in the local area based on the captured image(s).
    Type: Grant
    Filed: September 1, 2017
    Date of Patent: September 29, 2020
    Assignee: Facebook Technologies, LLC
    Inventors: Andrew Matthew Bardagjy, Joseph Duggan, Cina Hazegh, Fei Liu, Mark Timothy Sullivan, Simon Morris Shand Weiss
  • Publication number: 20200259982
    Abstract: An imaging device for imaging of a local area surrounding the imaging device. The imaging device includes a lens assembly, a filtering element and a detector. The lens assembly is configured to receive light from a local area surrounding the imaging device and to direct at least a portion of the received light to the detector. The filtering element is placed in the imaging device within the lens assembly such that light is incident at a surface of the filtering element within a range of angles determined by a design range of angles at which the filtering element is designed to filter light. The detector is configured to capture image(s) of the local area including the filtered light. The imaging device can be integrated into a depth camera assembly for determining depth information of object(s) in the local area based on the captured image(s).
    Type: Application
    Filed: September 1, 2017
    Publication date: August 13, 2020
    Inventors: Andrew Matthew Bardagjy, Joseph Duggan, Cina Hazegh, Fei Liu, Mark Timothy Sullivan, Simon Morris Shand Weiss
  • Publication number: 20200151892
    Abstract: A depth camera assembly for depth sensing of a local area includes a structured light generator, an imaging device, and a controller. The structured light generator illuminates a local area with structured light and includes an illumination source, a mounting element, and a diffractive optical element (DOE) mounted on the mounting element. The mounting element can have a plurality of adjustable positions relative to the illumination source based on emission instructions from the controller. The DOE generates, using light emitted from the illumination source, diffracted scanning beams that are projected as the structured light into the local area. A pattern of the structured light is dynamically adjustable and unique for each adjustable position of the mounting element. The imaging device captures image(s) of the structured light reflected from object(s) in the local area. The controller determines depth information for the object(s) based in part on the captured image(s).
    Type: Application
    Filed: January 15, 2020
    Publication date: May 14, 2020
    Inventors: Andrew Matthew Bardagjy, Joseph Duggan, Cina Hazegh, Fei Liu, Mark Timothy Sullivan, Simon Morris Shand Weiss
  • Publication number: 20200150419
    Abstract: A depth camera assembly (DCA) for depth sensing of a local area includes a structured light generator, an imaging device, and a controller. The structured light generator illuminates the local area with a structured light pattern. The structured light generator includes a programmable diffractive optical element (PDOE) that generates diffracted scanning beams using optical beams. The PDOE functions as a dynamic diffraction grating that dynamically adjusts diffraction of the optical beams to generate the diffracted scanning beams of different patterns. The diffracted scanning beams are projected as the structured light pattern into the local area, wherein the structured light pattern is dynamically adjustable based on the PDOE. The imaging device captures image(s) of at least a portion of the structured light pattern reflected from object(s) in the local area. The controller determines depth information for the object(s) based on the captured image(s).
    Type: Application
    Filed: December 23, 2019
    Publication date: May 14, 2020
    Inventors: Andrew Matthew Bardagjy, Joseph Duggan, Cina Hazegh, Fei Liu, Mark Timothy Sullivan, Simon Morris Shand Weiss
  • Patent number: 10612912
    Abstract: A head-mounted display (HMD) system includes a projector system configured to emit a structured light (SL) pattern onto one or more objects in a local area, the projected SL pattern comprises at least a first SL pattern having a first field of view (FOV) corresponding to a first tileable boundary, and a second SL pattern having a second FOV corresponding to a second tileable boundary. Each of the projected SL patterns contains fiducials at predetermined locations within the SL pattern. An imaging device captures images of the local area including at least portions of the first SL pattern or the second SL patterns. The detected locations of the fiducials in the captured images is used to determine the boundary locations of the first and second SL patterns. Depth information of the local area is generated based upon the determined locations of the first and second SL patterns.
    Type: Grant
    Filed: October 31, 2017
    Date of Patent: April 7, 2020
    Assignee: Facebook Technologies, LLC
    Inventors: Mark Timothy Sullivan, Andrew Matthew Bardagjy, Joseph Duggan, Fei Liu, Simon Morris Shand Weiss
  • Patent number: 10586342
    Abstract: A depth camera assembly for depth sensing of a local area includes a structured light generator, an imaging device, and a controller. The structured light generator illuminates a local area with structured light and includes an illumination source, a mounting element, and a diffractive optical element (DOE) mounted on the mounting element. The mounting element can have a plurality of adjustable positions relative to the illumination source based on emission instructions from the controller. The DOE generates, using light emitted from the illumination source, diffracted scanning beams that are projected as the structured light into the local area. A pattern of the structured light is dynamically adjustable and unique for each adjustable position of the mounting element. The imaging device captures image(s) of the structured light reflected from object(s) in the local area. The controller determines depth information for the object(s) based in part on the captured image(s).
    Type: Grant
    Filed: August 31, 2017
    Date of Patent: March 10, 2020
    Assignee: Facebook Technologies, LLC
    Inventors: Andrew Matthew Bardagjy, Joseph Duggan, Cina Hazegh, Fei Liu, Mark Timothy Sullivan, Simon Morris Shand Weiss
  • Patent number: 10551614
    Abstract: A depth camera assembly (DCA) for depth sensing of a local area includes a structured light generator, an imaging device, and a controller. The structured light generator illuminates the local area with a structured light pattern. The structured light generator includes a programmable diffractive optical element (PDOE) that generates diffracted scanning beams using optical beams. The PDOE functions as a dynamic diffraction grating that dynamically adjusts diffraction of the optical beams to generate the diffracted scanning beams of different patterns. The diffracted scanning beams are projected as the structured light pattern into the local area, wherein the structured light pattern is dynamically adjustable based on the PDOE. The imaging device captures image(s) of at least a portion of the structured light pattern reflected from object(s) in the local area. The controller determines depth information for the object(s) based on the captured image(s).
    Type: Grant
    Filed: August 14, 2017
    Date of Patent: February 4, 2020
    Assignee: Facebook Technologies, LLC
    Inventors: Andrew Matthew Bardagjy, Joseph Duggan, Cina Hazegh, Fei Liu, Mark Timothy Sullivan, Simon Morris Shand Weiss
  • Patent number: 10466360
    Abstract: A depth measurement assembly (DMA) measures depth information of an object in a local area. The DMA includes structured light projector, a depth camera assembly, and a controller. The structured light projector projects structured light patterns into the local area. The structured light projector includes a diffractive optical unit that includes diffractive optical elements (DOEs) and selects a DOE. The selected DOE is illuminated by light from a light source and converts the light into a structured light pattern. In some embodiment, the diffractive optical units selects multiple DOEs associated with multiple structured light patterns. The structured light pattern is projected into the local area by a projection assembly of the structured light projector and illuminates the object. The depth camera assembly captures images of the object. The controller uses the captured images to determine depth information of the object.
    Type: Grant
    Filed: August 31, 2017
    Date of Patent: November 5, 2019
    Assignee: Facebook Technologies, LLC
    Inventors: Andrew Matthew Bardagjy, Joseph Duggan, Cina Hazegh, Fei Liu, Mark Timothy Sullivan, Simon Morris Shand Weiss