Patents by Inventor Jan Oberlaender

Jan Oberlaender has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11961296
    Abstract: A system generates a plurality of spatial points based on depth measurements of physical objects. The system determines, based on the plurality of spatial points, an occupancy score for each voxel within a plurality of voxels. The system identifies, based on a gaze of the user, a first set of occupied voxels that are in a field of view of the user and a second set of occupied voxels that are outside the field of view of the user. The system updates the occupancy scores of the first set of occupied voxels by temporally decaying one or more of the plurality of spatial points within the first set of occupied voxels. The system maintains the occupancy scores of the second set of occupied voxels. The system detects intrusions in a predefined subspace within a physical space based on the updated occupancy scores of the first set of occupied voxels.
    Type: Grant
    Filed: January 25, 2023
    Date of Patent: April 16, 2024
    Assignee: Meta Platforms Technologies, LLC
    Inventors: Alexandru-Eugen Ichim, Sarthak Ray, Alexander Sorkine Hornung, Gioacchino Noris, Gaurav Chaurasia, Jan Oberländer
  • Publication number: 20240119672
    Abstract: In one embodiment, a method by a computing system comprising a color camera and two monochrome cameras respectively associated with two eyes of a user includes computing a point cloud corresponding to a visible environment based at least on two stereoscopic grayscale images respectively captured by the two monochrome cameras, generating a mesh corresponding to the visible environment based on the computed point cloud, and generating two stereoscopic colorized images to be respectively displayed to the two eyes of the user, where each of the two stereoscopic colorized images is generated using (1) the mesh, (2) luminance information from one of the two stereoscopic grayscale images that is associated with the eye to which the stereoscopic colorized image is to be displayed, and (3) color information from a color input image captured by the color camera.
    Type: Application
    Filed: October 10, 2023
    Publication date: April 11, 2024
    Inventors: Gaurav Chaurasia, Jan Oberländer, Ricardo da Silveira Cabral, Paul Timothy Furgale
  • Patent number: 11915375
    Abstract: In particular embodiments, a computing system may divide at least a portion of a physical space surrounding a user into a plurality of three-dimensional (3D) regions, wherein each of the 3D regions is associated with an area of a plurality of areas in a plane. The system may generate estimated locations of features of objects in the portion of the physical space. Based on the estimated locations, the system may determine an occupancy state of each of the plurality of 3D regions. Then based on the occupancy states of the plurality of 3D regions, the system may determine that one or more of the plurality of areas have respective airspaces that are likely unoccupied by objects.
    Type: Grant
    Filed: February 8, 2023
    Date of Patent: February 27, 2024
    Assignee: Meta Platforms Technologies, LLC
    Inventors: Alexandru-Eugen Ichim, Matthew James Alderman, Alexander Sorkine Hornung, Manuel Werlberger, Gaurav Chaurasia, Jan Oberländer
  • Publication number: 20240062425
    Abstract: In one embodiment, a computing system may capture a first grayscale image using a first camera at a first camera pose and a second grayscale image using a second camera at a second camera pose. The computing system may capture a reference color image using an RGB camera at a third camera pose. The computing system may generate, using a colorization machine-learning model, a first color image with a same camera pose as the first camera pose based on the reference color image and the first grayscale image. The computing system may generate, using the colorization machine-learning model, a second color image with a same camera pose as the second camera pose based on the reference color image, the second grayscale image, and the first color image.
    Type: Application
    Filed: August 17, 2022
    Publication date: February 22, 2024
    Inventors: Catherine Marie Herold, Alberto Garcia Garcia, Romain Bachy, Jan Oberländer, Ana Dodik, Ricardo da Silveira Cabral
  • Publication number: 20240037963
    Abstract: A method for recognizing a road intersection ahead in the driving direction of a vehicle. In the method, an overall probability of the presence of the road intersection ahead is calculated on the basis of data acquired during the trip of the vehicle and the presence of the road intersection ahead is deduced on the basis of the calculated overall probability.
    Type: Application
    Filed: May 31, 2023
    Publication date: February 1, 2024
    Inventors: Stephan Fuhrmann, Paul Wolff, Jan Oberlaender, Oezguer Sen
  • Publication number: 20240010447
    Abstract: The invention relates to a conveyor device (1), designed: to receive an item to be conveyed (F2), more particularly a meat item, at a receiving region (A1) from an upstream feed device (110); to transfer the item to be conveyed (F2) at a transfer region (A3); to hand over the item to be conveyed (F2) in a handover region (A2) from the receiving region (A1) to the transfer region (A3), wherein the conveyor device (1) comprises a plurality of discrete transport units (21), wherein the transport units (21) are more particularly arranged in circulation, characterized in that the transport units (21) are designed: to receive the item to be conveyed (F2) at the receiving region (A1), to be handed over between the receiving region (A1) and the transfer region (A3), and to hand over the item to be conveyed (F2) at the transfer region (A3).
    Type: Application
    Filed: December 10, 2021
    Publication date: January 11, 2024
    Inventors: Stefan Hamacher, Stephan Kronholz, Kai Lubomierski, Jan Oberländer, Thomas Rydlewski, Jürgen Zinn, Klaus Baltes, Erwin Mans, Muammer Genc
  • Publication number: 20230260228
    Abstract: One example method for adaptive mixed reality includes estimating ambient lighting conditions using one or more sensors; calibrating each of the one or more sensors spatially or spectrally; determining a color point based on the ambient lighting conditions; and modifying a mixed reality display based on the color point, wherein the mixed reality display comprises virtual reality (VR) content and pass-through (PT) content.
    Type: Application
    Filed: February 15, 2023
    Publication date: August 17, 2023
    Inventors: Zhang Jia, Jan Oberländer, Stefan Rüffer, Gian Diego Tipaldi
  • Publication number: 20230186568
    Abstract: In particular embodiments, a computing system may divide at least a portion of a physical space surrounding a user into a plurality of three-dimensional (3D) regions, wherein each of the 3D regions is associated with an area of a plurality of areas in a plane. The system may generate estimated locations of features of objects in the portion of the physical space. Based on the estimated locations, the system may determine an occupancy state of each of the plurality of 3D regions. Then based on the occupancy states of the plurality of 3D regions, the system may determine that one or more of the plurality of areas have respective airspaces that are likely unoccupied by objects.
    Type: Application
    Filed: February 8, 2023
    Publication date: June 15, 2023
    Inventors: Alexandru-Eugen Ichim, Matthew James Alderman, Alexander Sorkine Hornung, Manuel Werlberger, Gaurav Chaurasia, Jan Oberländer
  • Publication number: 20230177833
    Abstract: A system generates a plurality of spatial points based on depth measurements of physical objects. The system determines, based on the plurality of spatial points, an occupancy score for each voxel within a plurality of voxels. The system identifies, based on a gaze of the user, a first set of occupied voxels that are in a field of view of the user and a second set of occupied voxels that are outside the field of view of the user. The system updates the occupancy scores of the first set of occupied voxels by temporally decaying one or more of the plurality of spatial points within the first set of occupied voxels. The system maintains the occupancy scores of the second set of occupied voxels. The system detects intrusions in a predefined subspace within a physical space based on the updated occupancy scores of the first set of occupied voxels.
    Type: Application
    Filed: January 25, 2023
    Publication date: June 8, 2023
    Inventors: Alexandru-Eugen Ichim, Sarthak Ray, Alexander Sorkine Hornung, Gioacchino Noris, Gaurav Chaurasia, Jan Oberländer
  • Patent number: 11605201
    Abstract: In particular embodiments, a computing system may divide at least a portion of a physical space surrounding a user into a plurality of three-dimensional (3D) regions, wherein each of the 3D regions is associated with an area of a plurality of areas in a plane. The system may generate estimated locations of features of objects in the portion of the physical space. Based on the estimated locations, the system may determine an occupancy state of each of the plurality of 3D regions. Then based on the occupancy states of the plurality of 3D regions, the system may determine that one or more of the plurality of areas have respective airspaces that are likely unoccupied by objects.
    Type: Grant
    Filed: January 27, 2020
    Date of Patent: March 14, 2023
    Assignee: Meta Platforms Technologies, LLC
    Inventors: Alexandru-Eugen Ichim, Matthew James Alderman, Alexander Sorkine Hornung, Manuel Werlberger, Gaurav Chaurasia, Jan Oberländer
  • Patent number: 11574474
    Abstract: A system generates a plurality of spatial points based on depth measurements of physical objects. The system determines, based on the plurality of spatial points, an occupancy score for each voxel within a plurality of voxels. The system identifies, based on a gaze of the user, a first set of occupied voxels that are in a field of view of the user and a second set of occupied voxels that are outside the field of view of the user. The system updates the occupancy scores of the first set of occupied voxels by temporally decaying one or more of the plurality of spatial points within the first set of occupied voxels. The system maintains the occupancy scores of the second set of occupied voxels. The system detects intrusions in a predefined subspace within a physical space based on the updated occupancy scores of the first set of occupied voxels.
    Type: Grant
    Filed: September 20, 2021
    Date of Patent: February 7, 2023
    Assignee: Meta Platforms Technologies, LLC
    Inventors: Alexandru-Eugen Ichim, Sarthak Ray, Alexander Sorkine Hornung, Gioacchino Noris, Gaurav Chaurasia, Jan Oberländer
  • Patent number: 11410387
    Abstract: In one embodiment for generating passthrough, a computing system may access images of an environment captured by cameras of a device worn by a user. The system may generate, based on the images, depth measurements of objects in the environment. The system may generate a mesh covering a field of view of the user and then update the mesh based on the depth measurements to represent a contour of the objects in the environment. The system may determine a first viewpoint of a first eye of the user and render a first output image based on the first viewpoint and the updated mesh. The system may then display the first output image on a first display of the device, the first display being configured to be viewed by the first eye of the user.
    Type: Grant
    Filed: January 17, 2020
    Date of Patent: August 9, 2022
    Assignee: Facebook Technologies, LLC.
    Inventors: Matthew James Alderman, Gaurav Chaurasia, Paul Timothy Furgale, Lingwen Gan, Alexander Sorkine Hornung, Alexandru-Eugen Ichim, Arthur Nieuwoudt, Jan Oberländer, Gian Diego Tipaldi
  • Publication number: 20220004766
    Abstract: A system generates a plurality of spatial points based on depth measurements of physical objects. The system determines, based on the plurality of spatial points, an occupancy score for each voxel within a plurality of voxels. The system identifies, based on a gaze of the user, a first set of occupied voxels that are in a field of view of the user and a second set of occupied voxels that are outside the field of view of the user. The system updates the occupancy scores of the first set of occupied voxels by temporally decaying one or more of the plurality of spatial points within the first set of occupied voxels. The system maintains the occupancy scores of the second set of occupied voxels. The system detects intrusions in a predefined subspace within a physical space based on the updated occupancy scores of the first set of occupied voxels.
    Type: Application
    Filed: September 20, 2021
    Publication date: January 6, 2022
    Inventors: Alexandru-Eugen Ichim, Sarthak Ray, Alexander Sorkine Hornung, Gioacchino Noris, Gaurav Chaurasia, Jan Oberländer
  • Publication number: 20210319220
    Abstract: In one embodiment, a method includes generating a plurality of spatial points based on depth measurements of physical objects within a physical space surrounding a user and determining, based on the spatial points, a location at which a physical object is likely to exist. The method then renders, based on the location of the physical object, a virtual space representing the physical space. This virtual space may include a virtual object representing the physical object. The method displays the virtual space to the user, and, while displaying the virtual space, receives input from the user indicating a boundary of a subspace within the virtual space, and detects that at least a portion of the virtual object is within the subspace. Finally, the method updates the virtual space to indicate that the portion of the virtual object is within the subspace.
    Type: Application
    Filed: April 9, 2020
    Publication date: October 14, 2021
    Inventors: Alexandru-Eugen Ichim, Sarthak Ray, Alexander Sorkine Hornung, Gioacchino Noris, Gaurav Chaurasia, Jan Oberländer
  • Patent number: 11126850
    Abstract: In one embodiment, a method includes generating a plurality of spatial points based on depth measurements of physical objects within a physical space surrounding a user and determining, based on the spatial points, a location at which a physical object is likely to exist. The method then renders, based on the location of the physical object, a virtual space representing the physical space. This virtual space may include a virtual object representing the physical object. The method displays the virtual space to the user, and, while displaying the virtual space, receives input from the user indicating a boundary of a subspace within the virtual space, and detects that at least a portion of the virtual object is within the subspace. Finally, the method updates the virtual space to indicate that the portion of the virtual object is within the subspace.
    Type: Grant
    Filed: April 9, 2020
    Date of Patent: September 21, 2021
    Assignee: Facebook Technologies, LLC
    Inventors: Alexandru-Eugen Ichim, Sarthak Ray, Alexander Sorkine Hornung, Gioacchino Noris, Gaurav Chaurasia, Jan Oberländer
  • Publication number: 20210233311
    Abstract: In particular embodiments, a computing system may divide at least a portion of a physical space surrounding a user into a plurality of three-dimensional (3D) regions, wherein each of the 3D regions is associated with an area of a plurality of areas in a plane. The system may generate estimated locations of features of objects in the portion of the physical space. Based on the estimated locations, the system may determine an occupancy state of each of the plurality of 3D regions. Then based on the occupancy states of the plurality of 3D regions, the system may determine that one or more of the plurality of areas have respective airspaces that are likely unoccupied by objects.
    Type: Application
    Filed: January 27, 2020
    Publication date: July 29, 2021
    Inventors: Alexandru-Eugen Ichim, Matthew James Alderman, Alexander Sorkine Hornung, Manuel Werlberger, Gaurav Chaurasia, Jan Oberländer