Patents by Inventor Mark Timothy Sullivan
Mark Timothy Sullivan has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11709364Abstract: A projector for illuminating a target area is presented. The projector includes an array of emitters positioned on a substrate according to a distribution. Each emitter in the array of emitters has a non-circular emission area. Operation of at least a portion of the array of emitters is controlled based in part on emission instructions to emit light. The light from the projector is configured to illuminate the target area. The projector can be part of a depth camera assembly for depth sensing of a local area, or part of an eye tracker for determining a gaze direction for an eye.Type: GrantFiled: April 25, 2022Date of Patent: July 25, 2023Assignee: Meta Platforms Technologies, LLCInventors: Zhaoming Zhu, Mark Timothy Sullivan, Jonatan Ginzburg
-
Patent number: 11681209Abstract: The disclosed structured light projector may include (1) a light source having a light-emitting side that emits light, (2) a solid optical spacer element having a first side securely coupled to the light-emitting side of the light source, and (3) a diffractive optical element (DOE) stack including one or more DOEs, where the DOE stack includes (a) a light-receiving side securely coupled to a second side of the solid optical spacer element opposite the first side, and (b) a light-emitting side opposite the light-receiving side that emits structured light in response to the light received from the light-emitting side of the light source via the solid optical spacer element. Various other devices and methods are also disclosed.Type: GrantFiled: February 25, 2022Date of Patent: June 20, 2023Assignee: Meta Platforms Technologies, LLCInventors: Mark Timothy Sullivan, Jonatan Ginzburg
-
Patent number: 11586036Abstract: A depth camera assembly (DCA) for depth sensing of a local area includes a structured light generator, an imaging device, and a controller. The structured light generator illuminates the local area with a structured light pattern. The structured light generator includes a programmable diffractive optical element (PDOE) that generates diffracted scanning beams using optical beams. The PDOE functions as a dynamic diffraction grating that dynamically adjusts diffraction of the optical beams to generate the diffracted scanning beams of different patterns. The diffracted scanning beams are projected as the structured light pattern into the local area, wherein the structured light pattern is dynamically adjustable based on the PDOE. The imaging device captures image(s) of at least a portion of the structured light pattern reflected from object(s) in the local area. The controller determines depth information for the object(s) based on the captured image(s).Type: GrantFiled: December 23, 2019Date of Patent: February 21, 2023Assignee: Meta Platforms Technologies, LLCInventors: Andrew Matthew Bardagjy, Joseph Duggan, Cina Hazegh, Fei Liu, Mark Timothy Sullivan, Simon Morris Shand Weiss
-
Patent number: 11450015Abstract: A depth camera assembly for depth sensing of a local area includes a structured light generator, an imaging device, and a controller. The structured light generator illuminates a local area with structured light and includes an illumination source, a mounting element, and a diffractive optical element (DOE) mounted on the mounting element. The mounting element can have a plurality of adjustable positions relative to the illumination source based on emission instructions from the controller. The DOE generates, using light emitted from the illumination source, diffracted scanning beams that are projected as the structured light into the local area. A pattern of the structured light is dynamically adjustable and unique for each adjustable position of the mounting element. The imaging device captures image(s) of the structured light reflected from object(s) in the local area. The controller determines depth information for the object(s) based in part on the captured image(s).Type: GrantFiled: January 15, 2020Date of Patent: September 20, 2022Assignee: Meta Platforms Technologies, LLCInventors: Andrew Matthew Bardagjy, Joseph Duggan, Cina Hazegh, Fei Liu, Mark Timothy Sullivan, Simon Morris Shand Weiss
-
Patent number: 11355901Abstract: A vertical cavity surface emitting laser (VCSEL) die package includes a bottom substrate comprising a bottom contact pad electrically contacting a bottom electrode on a bottom surface of a VCSEL die. The VCSEL die package includes a submount including a submount contact pad electrically contacting a first electrode on another surface of the VCSEL die. The submount contact pad overlaps a portion of the first electrode, wherein the VCSEL die is positioned between the submount and the bottom substrate.Type: GrantFiled: December 23, 2019Date of Patent: June 7, 2022Assignee: Facebook Technologies, LLCInventors: Jonatan Ginzburg, Mark Timothy Sullivan
-
Patent number: 11353636Abstract: A mount includes an active area in which an optical element may be located. The mount is bonded to a neighboring mount using adhesives that are placed on a top side of a wall structure of the mount. Migration of the adhesives from the wall of the mount into the active area is prevented by use of groove-structures and micro-wall structures located in a buffer area of the mount that circumscribes the active area. In some embodiments, a diffuser is located in the buffer area of the mount to redirect the emitted light as desired for a particular application.Type: GrantFiled: January 24, 2020Date of Patent: June 7, 2022Assignee: Facebook Technologies, LLCInventors: Mark Timothy Sullivan, Yaakov Yonatan Layosh, Danilo Bueno
-
Patent number: 11340456Abstract: A projector for illuminating a target area is presented. The projector includes an array of emitters positioned on a substrate according to a distribution. Each emitter in the array of emitters has a non-circular emission area. Operation of at least a portion of the array of emitters is controlled based in part on emission instructions to emit light. The light from the projector is configured to illuminate the target area. The projector can be part of a depth camera assembly for depth sensing of a local area, or part of an eye tracker for determining a gaze direction for an eye.Type: GrantFiled: July 24, 2019Date of Patent: May 24, 2022Assignee: Facebook Technologies, LLCInventors: Zhaoming Zhu, Mark Timothy Sullivan, Jonatan Ginzburg
-
Patent number: 11333895Abstract: The disclosed system may include (1) a diffractive optical element (DOE) stack including one or more DOEs, where the DOE stack generates, in response to incoming light received at a first side of the DOE stack, structured light from a second side of the DOE stack opposite the first side, (2) a primary light source that emits the incoming light toward the first side of the DOE stack, and (3) at least one photodetector that detects light emitted from an edge of each of at least one of the DOEs of the DOE stack, where the edge is located between the first side and the second side of the DOE stack. Various other methods and systems are also disclosed.Type: GrantFiled: May 8, 2019Date of Patent: May 17, 2022Assignee: Facebook Technologies, LLCInventors: Jonatan Ginzburg, Mark Timothy Sullivan, Benjamin Nicholas Jones
-
Patent number: 11330193Abstract: An imaging device for imaging of a local area surrounding the imaging device. The imaging device includes a lens assembly, a filtering element and a detector. The lens assembly is configured to receive light from a local area surrounding the imaging device and to direct at least a portion of the received light to the detector. The filtering element is placed in the imaging device within the lens assembly such that light is incident at a surface of the filtering element within a range of angles determined by a design range of angles at which the filtering element is designed to filter light. The detector is configured to capture image(s) of the local area including the filtered light. The imaging device can be integrated into a depth camera assembly for determining depth information of object(s) in the local area based on the captured image(s).Type: GrantFiled: August 27, 2020Date of Patent: May 10, 2022Assignee: Facebook Technologies, LLCInventors: Andrew Matthew Bardagjy, Joseph Duggan, Cina Hazegh, Fei Liu, Mark Timothy Sullivan, Simon Morris Shand Weiss
-
Publication number: 20210231842Abstract: A mount includes an active area in which an optical element may be located. The mount is bonded to a neighboring mount using adhesives that are placed on a top side of a wall structure of the mount. Migration of the adhesives from the wall of the mount into the active area is prevented by use of groove-structures and micro-wall structures located in a buffer area of the mount that circumscribes the active area. In some embodiments, a diffuser is located in the buffer area of the mount to redirect the emitted light as desired for a particular application.Type: ApplicationFiled: January 24, 2020Publication date: July 29, 2021Inventors: Mark Timothy Sullivan, Yaakov Yonatan Layosh, Danilo Bueno
-
Patent number: 10948283Abstract: A head-mounted display (HMD) system includes a projector system configured to emit a structured light (SL) pattern onto one or more objects in a local area, the projected SL pattern comprises at least a first SL pattern having a first field of view (FOV) corresponding to a first tileable boundary, and a second SL pattern having a second FOV corresponding to a second tileable boundary. Each of the projected SL patterns contains fiducials at predetermined locations within the SL pattern. An imaging device captures images of the local area including at least portions of the first SL pattern or the second SL patterns. The detected locations of the fiducials in the captured images is used to determine the boundary locations of the first and second SL patterns. Depth information of the local area is generated based upon the determined locations of the first and second SL patterns.Type: GrantFiled: March 3, 2020Date of Patent: March 16, 2021Assignee: Facebook Technologies, LLCInventors: Mark Timothy Sullivan, Andrew Matthew Bardagjy, Joseph Duggan, Fei Liu, Simon Morris Shand Weiss
-
Publication number: 20200396362Abstract: An imaging device for imaging of a local area surrounding the imaging device. The imaging device includes a lens assembly, a filtering element and a detector. The lens assembly is configured to receive light from a local area surrounding the imaging device and to direct at least a portion of the received light to the detector. The filtering element is placed in the imaging device within the lens assembly such that light is incident at a surface of the filtering element within a range of angles determined by a design range of angles at which the filtering element is designed to filter light. The detector is configured to capture image(s) of the local area including the filtered light. The imaging device can be integrated into a depth camera assembly for determining depth information of object(s) in the local area based on the captured image(s).Type: ApplicationFiled: August 27, 2020Publication date: December 17, 2020Inventors: Andrew Matthew Bardagjy, Joseph Duggan, Cina Hazegh, Fei Liu, Mark Timothy Sullivan, Simon Morris Shand Weiss
-
Patent number: 10791283Abstract: An imaging device for imaging of a local area surrounding the imaging device. The imaging device includes a lens assembly, a filtering element and a detector. The lens assembly is configured to receive light from a local area surrounding the imaging device and to direct at least a portion of the received light to the detector. The filtering element is placed in the imaging device within the lens assembly such that light is incident at a surface of the filtering element within a range of angles determined by a design range of angles at which the filtering element is designed to filter light. The detector is configured to capture image(s) of the local area including the filtered light. The imaging device can be integrated into a depth camera assembly for determining depth information of object(s) in the local area based on the captured image(s).Type: GrantFiled: September 1, 2017Date of Patent: September 29, 2020Assignee: Facebook Technologies, LLCInventors: Andrew Matthew Bardagjy, Joseph Duggan, Cina Hazegh, Fei Liu, Mark Timothy Sullivan, Simon Morris Shand Weiss
-
Publication number: 20200259982Abstract: An imaging device for imaging of a local area surrounding the imaging device. The imaging device includes a lens assembly, a filtering element and a detector. The lens assembly is configured to receive light from a local area surrounding the imaging device and to direct at least a portion of the received light to the detector. The filtering element is placed in the imaging device within the lens assembly such that light is incident at a surface of the filtering element within a range of angles determined by a design range of angles at which the filtering element is designed to filter light. The detector is configured to capture image(s) of the local area including the filtered light. The imaging device can be integrated into a depth camera assembly for determining depth information of object(s) in the local area based on the captured image(s).Type: ApplicationFiled: September 1, 2017Publication date: August 13, 2020Inventors: Andrew Matthew Bardagjy, Joseph Duggan, Cina Hazegh, Fei Liu, Mark Timothy Sullivan, Simon Morris Shand Weiss
-
Publication number: 20200151892Abstract: A depth camera assembly for depth sensing of a local area includes a structured light generator, an imaging device, and a controller. The structured light generator illuminates a local area with structured light and includes an illumination source, a mounting element, and a diffractive optical element (DOE) mounted on the mounting element. The mounting element can have a plurality of adjustable positions relative to the illumination source based on emission instructions from the controller. The DOE generates, using light emitted from the illumination source, diffracted scanning beams that are projected as the structured light into the local area. A pattern of the structured light is dynamically adjustable and unique for each adjustable position of the mounting element. The imaging device captures image(s) of the structured light reflected from object(s) in the local area. The controller determines depth information for the object(s) based in part on the captured image(s).Type: ApplicationFiled: January 15, 2020Publication date: May 14, 2020Inventors: Andrew Matthew Bardagjy, Joseph Duggan, Cina Hazegh, Fei Liu, Mark Timothy Sullivan, Simon Morris Shand Weiss
-
Publication number: 20200150419Abstract: A depth camera assembly (DCA) for depth sensing of a local area includes a structured light generator, an imaging device, and a controller. The structured light generator illuminates the local area with a structured light pattern. The structured light generator includes a programmable diffractive optical element (PDOE) that generates diffracted scanning beams using optical beams. The PDOE functions as a dynamic diffraction grating that dynamically adjusts diffraction of the optical beams to generate the diffracted scanning beams of different patterns. The diffracted scanning beams are projected as the structured light pattern into the local area, wherein the structured light pattern is dynamically adjustable based on the PDOE. The imaging device captures image(s) of at least a portion of the structured light pattern reflected from object(s) in the local area. The controller determines depth information for the object(s) based on the captured image(s).Type: ApplicationFiled: December 23, 2019Publication date: May 14, 2020Inventors: Andrew Matthew Bardagjy, Joseph Duggan, Cina Hazegh, Fei Liu, Mark Timothy Sullivan, Simon Morris Shand Weiss
-
Patent number: 10612912Abstract: A head-mounted display (HMD) system includes a projector system configured to emit a structured light (SL) pattern onto one or more objects in a local area, the projected SL pattern comprises at least a first SL pattern having a first field of view (FOV) corresponding to a first tileable boundary, and a second SL pattern having a second FOV corresponding to a second tileable boundary. Each of the projected SL patterns contains fiducials at predetermined locations within the SL pattern. An imaging device captures images of the local area including at least portions of the first SL pattern or the second SL patterns. The detected locations of the fiducials in the captured images is used to determine the boundary locations of the first and second SL patterns. Depth information of the local area is generated based upon the determined locations of the first and second SL patterns.Type: GrantFiled: October 31, 2017Date of Patent: April 7, 2020Assignee: Facebook Technologies, LLCInventors: Mark Timothy Sullivan, Andrew Matthew Bardagjy, Joseph Duggan, Fei Liu, Simon Morris Shand Weiss
-
Patent number: 10586342Abstract: A depth camera assembly for depth sensing of a local area includes a structured light generator, an imaging device, and a controller. The structured light generator illuminates a local area with structured light and includes an illumination source, a mounting element, and a diffractive optical element (DOE) mounted on the mounting element. The mounting element can have a plurality of adjustable positions relative to the illumination source based on emission instructions from the controller. The DOE generates, using light emitted from the illumination source, diffracted scanning beams that are projected as the structured light into the local area. A pattern of the structured light is dynamically adjustable and unique for each adjustable position of the mounting element. The imaging device captures image(s) of the structured light reflected from object(s) in the local area. The controller determines depth information for the object(s) based in part on the captured image(s).Type: GrantFiled: August 31, 2017Date of Patent: March 10, 2020Assignee: Facebook Technologies, LLCInventors: Andrew Matthew Bardagjy, Joseph Duggan, Cina Hazegh, Fei Liu, Mark Timothy Sullivan, Simon Morris Shand Weiss
-
Patent number: 10551614Abstract: A depth camera assembly (DCA) for depth sensing of a local area includes a structured light generator, an imaging device, and a controller. The structured light generator illuminates the local area with a structured light pattern. The structured light generator includes a programmable diffractive optical element (PDOE) that generates diffracted scanning beams using optical beams. The PDOE functions as a dynamic diffraction grating that dynamically adjusts diffraction of the optical beams to generate the diffracted scanning beams of different patterns. The diffracted scanning beams are projected as the structured light pattern into the local area, wherein the structured light pattern is dynamically adjustable based on the PDOE. The imaging device captures image(s) of at least a portion of the structured light pattern reflected from object(s) in the local area. The controller determines depth information for the object(s) based on the captured image(s).Type: GrantFiled: August 14, 2017Date of Patent: February 4, 2020Assignee: Facebook Technologies, LLCInventors: Andrew Matthew Bardagjy, Joseph Duggan, Cina Hazegh, Fei Liu, Mark Timothy Sullivan, Simon Morris Shand Weiss
-
Patent number: 10466360Abstract: A depth measurement assembly (DMA) measures depth information of an object in a local area. The DMA includes structured light projector, a depth camera assembly, and a controller. The structured light projector projects structured light patterns into the local area. The structured light projector includes a diffractive optical unit that includes diffractive optical elements (DOEs) and selects a DOE. The selected DOE is illuminated by light from a light source and converts the light into a structured light pattern. In some embodiment, the diffractive optical units selects multiple DOEs associated with multiple structured light patterns. The structured light pattern is projected into the local area by a projection assembly of the structured light projector and illuminates the object. The depth camera assembly captures images of the object. The controller uses the captured images to determine depth information of the object.Type: GrantFiled: August 31, 2017Date of Patent: November 5, 2019Assignee: Facebook Technologies, LLCInventors: Andrew Matthew Bardagjy, Joseph Duggan, Cina Hazegh, Fei Liu, Mark Timothy Sullivan, Simon Morris Shand Weiss