Patents by Inventor Nitay Romano

Nitay Romano has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11962748
    Abstract: Apparatus for generating a dynamic structured light pattern for optical tracking in three-dimensional space, comprises an array of lasers, such as a VCSEL laser array, to project light in a pattern into a three-dimensional space; and an optical element or elements arranged in cells. The cells are aligned with subsets of the laser array, and each cell individually applies a modulation, in particular an intensity modulation, to light from the laser or lasers of the subset, to provide a distinguishable and separately controllable part of the dynamic structured light pattern. A method of generating a structured light pattern is disclosed, in which light is provided from an array of lasers, and light is individually projected from subsets of the array of lasers to provide differentiated parts of the structured light pattern.
    Type: Grant
    Filed: June 4, 2021
    Date of Patent: April 16, 2024
    Assignee: Meta Platforms Technologies, LLC
    Inventors: Nitay Romano, Nadav Grossinger, Yair Alpern, Emil Alon
  • Patent number: 11941830
    Abstract: In one embodiment, a system includes at least one projector configured to project a plurality of projected patterns, where a projected lighting characteristic of each of the projected patterns varies over a time period in accordance with an associated predetermined temporal lighting-characteristic pattern, a camera configured to capture images of detected patterns during the time period, and one or more processors configured to: determine, for each detected pattern, a detected temporal lighting-characteristic pattern based on variations in a detected lighting characteristic of the detected pattern, identify a detected pattern that corresponds to one of the projected patterns by comparing at least one of the detected temporal lighting-characteristic patterns to at least one of the temporal lighting-characteristic patterns, and compute a depth associated with the detected patterns based on the one or more of the projected patterns, the detected pattern, and a relative position between the camera and the project
    Type: Grant
    Filed: October 7, 2021
    Date of Patent: March 26, 2024
    Assignee: Meta Platforms Technologies, LLC
    Inventors: Niv Kantor, Ricardo Garcia, Nadav Grossinger, Robert Hasbun, Nitay Romano
  • Publication number: 20230216269
    Abstract: Embodiments of the present disclosure relate to a projector that is structured to be incorporated into a small form factor electronic device. In some embodiments, the projector is integrated in a depth camera assembly used for eye tracking and/or determining depth of objects in a local area. The projector includes a vertical cavity surface emitting laser (VCSEL) array and a substrate coupled to the VCSEL array. The VCSEL array is a bottom emitting VCSEL array formed with one or more VCSELs. The substrate includes a plurality of optical features to generate one or more SL patterns from the lights that are emitted from the VCSELs.
    Type: Application
    Filed: December 20, 2022
    Publication date: July 6, 2023
    Inventors: Nitay Romano, Yaakov Yonatan Layosh, Jonatan Ginzburg
  • Patent number: 11592572
    Abstract: In one embodiment, a system includes at least one projector comprising a plurality of light emitters, where the projector is configured to project a projected pattern comprising a plurality of projected features having different locations; a camera configured to capture an image comprising a detected pattern corresponding to a reflection of the projected pattern; and one or more processors configured to: identify at least one detected feature of the detected pattern, wherein the detected feature corresponds to at least one reflection of the projected features; and activate or deactivate one or more of the light emitters based on the detected feature. The light emitters may be activated or deactivated by determining a detected feature measurement based on the detected feature, and activating or deactivating one or more of the light emitters when the detected feature measurement satisfies a threshold feature measurement condition.
    Type: Grant
    Filed: January 11, 2021
    Date of Patent: February 28, 2023
    Assignee: Meta Platforms Technologies, LLC
    Inventors: Niv Kantor, Nadav Grossinger, Nitay Romano
  • Publication number: 20220028099
    Abstract: In one embodiment, a system includes at least one projector configured to project a plurality of projected patterns, where a projected lighting characteristic of each of the projected patterns varies over a time period in accordance with an associated predetermined temporal lighting-characteristic pattern, a camera configured to capture images of detected patterns during the time period, and one or more processors configured to: determine, for each detected pattern, a detected temporal lighting-characteristic pattern based on variations in a detected lighting characteristic of the detected pattern, identify a detected pattern that corresponds to one of the projected patterns by comparing at least one of the detected temporal lighting-characteristic patterns to at least one of the temporal lighting-characteristic patterns, and compute a depth associated with the detected patterns based on the one or more of the projected patterns, the detected pattern, and a relative position between the camera and the project
    Type: Application
    Filed: October 7, 2021
    Publication date: January 27, 2022
    Inventors: Niv Kantor, Ricardo Garcia, Nadav Grossinger, Robert Hasbun, Nitay Romano
  • Patent number: 11158074
    Abstract: In one embodiment, a system includes at least one projector configured to project a plurality of projected patterns, where a projected lighting characteristic of each of the projected patterns varies over a time period in accordance with an associated predetermined temporal lighting-characteristic pattern, a camera configured to capture images of detected patterns, and one or more processors configured to: determine, for each detected pattern, a detected temporal lighting-characteristic pattern based on variations in a detected lighting characteristic of the detected pattern, identify a detected pattern that corresponds to one of the projected patterns by comparing at least one of the detected temporal lighting-characteristic patterns to at least one of the temporal lighting-characteristic patterns, and compute a depth associated with the detected patterns based on the one or more of the projected patterns, the detected pattern, and a relative position between the camera and the projector.
    Type: Grant
    Filed: October 2, 2018
    Date of Patent: October 26, 2021
    Assignee: Facebook Technologies, LLC
    Inventors: Niv Kantor, Ricardo Garcia, Nadav Grossinger, Robert Hasbun, Nitay Romano
  • Publication number: 20210297651
    Abstract: Apparatus for generating a dynamic structured light pattern for optical tracking in three-dimensional space, comprises an array of lasers, such as a VCSEL laser array, to project light in a pattern into a three-dimensional space; and an optical element or elements arranged in cells. The cells are aligned with subsets of the laser array, and each cell individually applies a modulation, in particular an intensity modulation, to light from the laser or lasers of the subset, to provide a distinguishable and separately controllable part of the dynamic structured light pattern. A method of generating a structured light pattern is disclosed, in which light is provided from an array of lasers, and light is individually projected from subsets of the array of lasers to provide differentiated parts of the structured light pattern.
    Type: Application
    Filed: June 4, 2021
    Publication date: September 23, 2021
    Inventors: Nitay Romano, Nadav Grossinger, Yair Alpern, Emil Alon
  • Patent number: 11057610
    Abstract: Apparatus for generating a dynamic structured light pattern for optical tracking in three-dimensional space, comprises an array of lasers, such as a VCSEL laser array, to project light in a pattern into a three-dimensional space; and an optical element or elements arranged in cells. The cells are aligned with subsets of the laser array, and each cell individually applies a modulation, in particular an intensity modulation, to light from the laser or lasers of the subset, to provide a distinguishable and separately controllable part of the dynamic structured light pattern. A method of generating a structured light pattern is disclosed, in which light is provided from an array of lasers, and light is individually projected from subsets of the array of lasers to provide differentiated parts of the structured light pattern.
    Type: Grant
    Filed: April 27, 2020
    Date of Patent: July 6, 2021
    Assignee: Facebook Technologies, LLC
    Inventors: Nitay Romano, Nadav Grossinger, Yair Alpern, Emil Alon
  • Publication number: 20210132228
    Abstract: In one embodiment, a system includes at least one projector comprising a plurality of light emitters, where the projector is configured to project a projected pattern comprising a plurality of projected features having different locations; a camera configured to capture an image comprising a detected pattern corresponding to a reflection of the projected pattern; and one or more processors configured to: identify at least one detected feature of the detected pattern, wherein the detected feature corresponds to at least one reflection of the projected features; and activate or deactivate one or more of the light emitters based on the detected feature. The light emitters may be activated or deactivated by determining a detected feature measurement based on the detected feature, and activating or deactivating one or more of the light emitters when the detected feature measurement satisfies a threshold feature measurement condition.
    Type: Application
    Filed: January 11, 2021
    Publication date: May 6, 2021
    Inventors: Niv Kantor, Nadav Grossinger, Nitay Romano
  • Patent number: 10901092
    Abstract: In one embodiment, a system includes at least one projector comprising a plurality of light emitters, where the projector is configured to project a projected pattern comprising a plurality of projected features having different locations; a camera configured to capture an image comprising a detected pattern corresponding to a reflection of the projected pattern; and one or more processors configured to: identify at least one detected feature of the detected pattern, wherein the detected feature corresponds to at least one reflection of the projected features; and activate or deactivate one or more of the light emitters based on the detected feature. The light emitters may be activated or deactivated by determining a detected feature measurement based on the detected feature, and activating or deactivating one or more of the light emitters when the detected feature measurement satisfies a threshold feature measurement condition.
    Type: Grant
    Filed: October 2, 2018
    Date of Patent: January 26, 2021
    Assignee: Facebook Technologies, LLC
    Inventors: Niv Kantor, Nadav Grossinger, Nitay Romano
  • Patent number: 10896516
    Abstract: In one embodiment, a system includes at least one projector configured to project a plurality of projected patterns onto a scene, the projected patterns including a first projected pattern that includes a plurality of first projected features, a camera configured to capture a plurality of images including a first detected pattern corresponding to a reflection of the first projected pattern, and one or more processors configured to: compute a depth map of the scene based on the first projected pattern, the first detected pattern, and relative positions of the camera and the at least one projector, project, using the projector, a second projected pattern comprising a plurality of second projected features onto a portion of the scene, where the second projected pattern is more sparse than the first projected pattern, and capture, using the camera, a second detected pattern corresponding to a reflection of the second projected pattern.
    Type: Grant
    Filed: October 2, 2018
    Date of Patent: January 19, 2021
    Assignee: Facebook Technologies, LLC
    Inventors: Niv Kantor, Ricardo Garcia, Nadav Grossinger, Nitay Romano
  • Patent number: 10895752
    Abstract: Disclosed herein are techniques for structured light pattern generation. A method for generating a one-dimensional structured light pattern in a first direction and with a desired intensity pattern includes generating a plurality of one-dimensional light patterns using a two-dimensional diffractive optical element with different periods in two orthogonal directions, and combining the plurality of one-dimensional light patterns to form the one-dimensional structured light pattern with the desired intensity pattern. Each of the one-dimensional light patterns includes a one-dimensional light pattern in the first direction. The plurality of one-dimensional light patterns is distributed in a second direction different from the first direction. A separation angle between each pair of adjacent one-dimensional light patterns of the plurality of one-dimensional light patterns in the second direction and with respect to the two-dimensional diffractive optical element is less than a threshold value.
    Type: Grant
    Filed: January 10, 2018
    Date of Patent: January 19, 2021
    Assignee: FACEBOOK TECHNOLOGIES, LLC
    Inventors: Nitay Romano, Nadav Grossinger, Yaakov Yonatan Layosh
  • Patent number: 10877622
    Abstract: In one embodiment, a computing system may access a first image and a second image of at least a common portion of an environment while a light emission with a predetermined emission pattern is projected by a projector. The first and second images are respectively captured by a first and a second detector that are respectively separated from the projector by a first and a second distance. The system may determine that a first portion of the first image corresponds to a second portion of the second image. The system may compute, using triangulation, a first depth value associated with the first portion and a second depth value associated with the second portion. The system may determine that the first and second depth values match in accordance with one or more predetermined criteria, and generate a depth map of the environment based on at least one of the depth values.
    Type: Grant
    Filed: August 29, 2018
    Date of Patent: December 29, 2020
    Assignee: Facebook Technologies, LLC
    Inventors: Nitay Romano, Ricardo Garcia, Nadav Grossinger, Robert Hasbun, Niv Kantor
  • Patent number: 10837765
    Abstract: Apparatus for structured light scanning. The structured light includes one or more projected lines or other patterns. At least two independent emitters emit light for each projected line or pattern. Typically the at least two independent emitters are arranged in a row. The apparatus also includes a pattern generator for causing light from respective emitters of a given row to overlap along a pattern axis to form a projected pattern.
    Type: Grant
    Filed: November 26, 2018
    Date of Patent: November 17, 2020
    Assignee: Facebook Technologies, LLC
    Inventors: Guy Raz, Nadav Grossinger, Nitay Romano
  • Patent number: 10839536
    Abstract: In one embodiment, a system includes a first projector configured to project a first projected pattern having one or more first projected lighting characteristics, a second projector configured to project a second projected pattern having one or more second projected lighting characteristics, a camera configured to capture an image comprising first and second detected patterns corresponding to reflections of the first and second projected patterns, respectively, and one or more processors configured to: identify a detected point in the image that corresponds to a projected point in at least one of the first and second projected patterns by comparing detected lighting characteristics of the first and second detected patterns with the first and second projected lighting characteristics, and compute a depth associated with the detected point based on the projected point, the detected point, and a relative position between the camera and at least one of the projectors.
    Type: Grant
    Filed: October 2, 2018
    Date of Patent: November 17, 2020
    Assignee: Facebook Technologies, LLC
    Inventors: Nadav Grossinger, Ricardo Garcia, Robert Hasbun, Niv Kantor, Nitay Romano
  • Publication number: 20200267377
    Abstract: Apparatus for generating a dynamic structured light pattern for optical tracking in three-dimensional space, comprises an array of lasers, such as a VCSEL laser array, to project light in a pattern into a three-dimensional space; and an optical element or elements arranged in cells. The cells are aligned with subsets of the laser array, and each cell individually applies a modulation, in particular an intensity modulation, to light from the laser or lasers of the subset, to provide a distinguishable and separately controllable part of the dynamic structured light pattern. A method of generating a structured light pattern is disclosed, in which light is provided from an array of lasers, and light is individually projected from subsets of the array of lasers to provide differentiated parts of the structured light pattern.
    Type: Application
    Filed: April 27, 2020
    Publication date: August 20, 2020
    Inventors: Nitay Romano, Nadav Grossinger, Yair Alpern, Emil Alon
  • Patent number: 10687047
    Abstract: Apparatus for generating a dynamic structured light pattern for optical tracking in three-dimensional space, comprises an array of lasers, such as a VCSEL laser array, to project light in a pattern into a three-dimensional space; and an optical element or elements arranged in cells. The cells are aligned with subsets of the laser array, and each cell individually applies a modulation, in particular an intensity modulation, to light from the laser or lasers of the subset, to provide a distinguishable and separately controllable part of the dynamic structured light pattern. A method of generating a structured light pattern is disclosed, in which light is provided from an array of lasers, and light is individually projected from subsets of the array of lasers to provide differentiated parts of the structured light pattern.
    Type: Grant
    Filed: July 11, 2018
    Date of Patent: June 16, 2020
    Assignee: Facebook Technologies, LLC
    Inventors: Nitay Romano, Nadav Grossinger, Yair Alpern, Emil Alon
  • Publication number: 20200105005
    Abstract: In one embodiment, a system includes a first projector configured to project a first projected pattern having one or more first projected lighting characteristics, a second projector configured to project a second projected pattern having one or more second projected lighting characteristics, a camera configured to capture an image comprising first and second detected patterns corresponding to reflections of the first and second projected patterns, respectively, and one or more processors configured to: identify a detected point in the image that corresponds to a projected point in at least one of the first and second projected patterns by comparing detected lighting characteristics of the first and second detected patterns with the first and second projected lighting characteristics, and compute a depth associated with the detected point based on the projected point, the detected point, and a relative position between the camera and at least one of the projectors.
    Type: Application
    Filed: October 2, 2018
    Publication date: April 2, 2020
    Inventors: Nadav Grossinger, Ricardo Garcia, Robert Hasbun, Niv Kantor, Nitay Romano
  • Publication number: 20200073531
    Abstract: In one embodiment, a computing system may access a first image and a second image of at least a common portion of an environment while a light emission with a predetermined emission pattern is projected by a projector. The first and second images are respectively captured by a first and a second detector that are respectively separated from the projector by a first and a second distance. The system may determine that a first portion of the first image corresponds to a second portion of the second image. The system may compute, using triangulation, a first depth value associated with the first portion and a second depth value associated with the second portion. The system may determine that the first and second depth values match in accordance with one or more predetermined criteria, and generate a depth map of the environment based on at least one of the depth values.
    Type: Application
    Filed: August 29, 2018
    Publication date: March 5, 2020
    Inventors: Nitay Romano, Ricardo Garcia, Nadav Grossinger, Robert Hasbun, Niv Kantor
  • Patent number: 10559113
    Abstract: A device connectable to a near eye display or to a virtual reality headset and to a portable computing platform having a processor is provided herein. The device may include: an illuminator configured to illuminate a proximity of a user wearing the headset or the near eye display with patterned light; and an TR camera configured to capture reflections of said patterned light coming from at least one object located in the proximity of the user, wherein the processor is configured to: establish data and power connection between the device and said poliable computing platform and said near eye display; and generate a depth map of said object based on the reflections.
    Type: Grant
    Filed: November 7, 2017
    Date of Patent: February 11, 2020
    Assignee: Facebook Technologies, LLC
    Inventors: Kobi Kaminitz, Nadav Grossinger, Moshe Meyassed, Nitay Romano