Patents by Inventor Kjell Fredrik Larsson

Kjell Fredrik Larsson has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11874126
    Abstract: A method includes obtaining a rule that is associated with a segment of a map, determining a state for use in evaluation of the rule, evaluating the rule using the state, identifying an action to be performed based on a result of evaluating the rule using the state, and utilizing the action to be performed as an input to an automated control system of a vehicle.
    Type: Grant
    Filed: September 14, 2018
    Date of Patent: January 16, 2024
    Assignee: APPLE INC.
    Inventors: David A. Rosenthal, Andreas H. Bockert, Jessica A. Butorac, Gunnar Martin Byrod, Shane T. Hinerman, Kjell Fredrik Larsson, William W. Luciw, Patrick L. Wheeler
  • Patent number: 11798173
    Abstract: Systems and methods for moving point detection for point clouds. Some implementations may include obtaining a sequence of point clouds, wherein the sequence of point clouds includes a current point cloud, a previous point cloud that precedes the current point cloud, and a next point cloud that follows the current point cloud; inputting a voxelized representation of the current point cloud to a forward-pass recurrent neural network with a hidden state based on the previous point cloud to obtain a first voxelized activation; inputting the voxelized representation of the current point cloud to a backward-pass recurrent neural network with a hidden state based on the next point cloud to obtain a second voxelized activation; combining the first voxelized activation and the second voxelized activation to obtain a prediction of whether respective points are moving or static; and updating the current point cloud based on the prediction.
    Type: Grant
    Filed: November 16, 2020
    Date of Patent: October 24, 2023
    Assignee: APPLE INC.
    Inventors: Ulrich Berger, Jingwei Wang, Huy Tho Ho, Kjell Fredrik Larsson
  • Patent number: 11580328
    Abstract: Systems and methods for semantic labeling of point clouds using images. Some implementations may include obtaining a point cloud that is based on lidar data reflecting one or more objects in a space; obtaining an image that includes a view of at least one of the one or more objects in the space; determining a projection of points from the point cloud onto the image; generating, using the projection, an augmented image that includes one or more channels of data from the point cloud and one or more channels of data from the image; inputting the augmented image to a two dimensional convolutional neural network to obtain a semantic labeled image wherein elements of the semantic labeled image include respective predictions; and mapping, by reversing the projection, predictions of the semantic labeled image to respective points of the point cloud to obtain a semantic labeled point cloud.
    Type: Grant
    Filed: March 1, 2021
    Date of Patent: February 14, 2023
    Assignee: APPLE INC.
    Inventors: Huy Tho Ho, Jingwei Wang, Kjell Fredrik Larsson
  • Patent number: 11333517
    Abstract: A method includes capturing images at a device and analyzing the images at the device using a first analysis model to obtain information regarding an observed object that corresponds to a predetermined object. The method also includes determining whether the information regarding the observed object is consistent with stored mapping information, and, in response to determining that the information regarding the observed object is not consistent with the stored mapping information, modifying the stored mapping information based on the observed object.
    Type: Grant
    Filed: April 5, 2021
    Date of Patent: May 17, 2022
    Assignee: Apple Inc.
    Inventors: Weiyu Zhang, Xufeng Han, Lukas M. Marti, Ross W. Anderson, Kjell Fredrik Larsson
  • Patent number: 11189082
    Abstract: A method includes obtaining a three-dimensional model that represents a natural environment and identifying ground-level surfaces from the three-dimensional model, wherein the ground-level surfaces from the three-dimensional model represent ground-level features from the natural environment. The method also includes identifying overhanging features from the three-dimensional model, wherein the overhanging features from the three-dimensional model block visibility of the ground-level surfaces from the three-dimensional model when the ground-level surfaces are viewed from an orthographic perspective.
    Type: Grant
    Filed: August 31, 2020
    Date of Patent: November 30, 2021
    Assignee: Apple Inc.
    Inventors: Ibrahim Musba, Jizhou Gao, Jim Loup Zin, Andreas H. Bockert, Kjell Fredrik Larsson
  • Patent number: 10969237
    Abstract: A method includes capturing images at a device and analyzing the images at the device using a first analysis model to obtain information regarding an observed object that corresponds to a predetermined object. The method also includes determining whether the information regarding the observed object is consistent with stored mapping information, and, in response to determining that the information regarding the observed object is not consistent with the stored mapping information, modifying the stored mapping information based on the observed object.
    Type: Grant
    Filed: March 22, 2019
    Date of Patent: April 6, 2021
    Assignee: Apple Inc.
    Inventors: Weiyu Zhang, Xufeng Han, Lukas M. Marti, Ross W. Anderson, Kjell Fredrik Larsson
  • Patent number: 10936908
    Abstract: Systems and methods for semantic labeling of point clouds using images. Some implementations may include obtaining a point cloud that is based on lidar data reflecting one or more objects in a space; obtaining an image that includes a view of at least one of the one or more objects in the space; determining a projection of points from the point cloud onto the image; generating, using the projection, an augmented image that includes one or more channels of data from the point cloud and one or more channels of data from the image; inputting the augmented image to a two dimensional convolutional neural network to obtain a semantic labeled image wherein elements of the semantic labeled image include respective predictions; and mapping, by reversing the projection, predictions of the semantic labeled image to respective points of the point cloud to obtain a semantic labeled point cloud.
    Type: Grant
    Filed: May 7, 2020
    Date of Patent: March 2, 2021
    Assignee: Apple Inc.
    Inventors: Huy Tho Ho, Jingwei Wang, Kjell Fredrik Larsson
  • Publication number: 20200394834
    Abstract: A method includes obtaining a three-dimensional model that represents a natural environment and identifying ground-level surfaces from the three-dimensional model, wherein the ground-level surfaces from the three-dimensional mode represent ground-level features from the natural environment. The method also includes identifying overhanging features from the three-dimensional model, wherein the overhanging features from the three-dimensional model block visibility of the ground-level surfaces from the three-dimensional model when the ground-level surfaces are viewed from an orthographic perspective.
    Type: Application
    Filed: August 31, 2020
    Publication date: December 17, 2020
    Inventors: Ibrahim Musba, Jizhou Gao, Jim Loup Zin, Andreas H. Bockert, Kjell Fredrik Larsson
  • Patent number: 10839530
    Abstract: Systems and methods for moving point detection for point clouds. Some implementations may include obtaining a sequence of point clouds, wherein the sequence of point clouds includes a current point cloud, a previous point cloud that precedes the current point cloud, and a next point cloud that follows the current point cloud; inputting a voxelized representation of the current point cloud to a forward-pass recurrent neural network with a hidden state based on the previous point cloud to obtain a first voxelized activation; inputting the voxelized representation of the current point cloud to a backward-pass recurrent neural network with a hidden state based on the next point cloud to obtain a second voxelized activation; combining the first voxelized activation and the second voxelized activation to obtain a prediction of whether respective points are moving or static; and updating the current point cloud based on the prediction.
    Type: Grant
    Filed: September 4, 2018
    Date of Patent: November 17, 2020
    Assignee: Apple Inc.
    Inventors: Ulrich Berger, Jingwei Wang, Huy Tho Ho, Kjell Fredrik Larsson
  • Patent number: 10762690
    Abstract: A method includes obtaining images, obtaining three-dimensional surface measurements, defining a three-dimensional mesh using the three-dimensional surface measurements, texturing the three-dimensional mesh using the images to define a textured three-dimensional mesh, identifying a first portion of the textured three-dimensional mesh, identifying a second portion of the textured three-dimensional mesh that obstructs visibility of part of the first portion of the textured three-dimensional mesh from an overhead perspective, and rendering a simulated overhead perspective image such that the second portion of the textured three-dimensional mesh is not represented in the simulated overhead perspective image.
    Type: Grant
    Filed: February 11, 2019
    Date of Patent: September 1, 2020
    Assignee: Apple Inc.
    Inventors: Ibrahim Musba, Jizhou Gao, Jim Loup Zin, Andreas H. Bockert, Kjell Fredrik Larsson
  • Publication number: 20200258289
    Abstract: A method includes obtaining images, obtaining three-dimensional surface measurements, defining a three-dimensional mesh using the three-dimensional surface measurements, texturing the three-dimensional mesh using the images to define a textured three-dimensional mesh, identifying a first portion of the textured three-dimensional mesh, identifying a second portion of the textured three-dimensional mesh that obstructs visibility of part of the first portion of the textured three-dimensional mesh from an overhead perspective, and rendering a simulated overhead perspective image such that the second portion of the textured three-dimensional mesh is not represented in the simulated overhead perspective image.
    Type: Application
    Filed: February 11, 2019
    Publication date: August 13, 2020
    Inventors: Ibrahim Musba, Jizhou Gao, Jim Loup Zin, Andreas H. Bockert, Kjell Fredrik Larsson
  • Patent number: 10650278
    Abstract: Systems and methods for semantic labeling of point clouds using images. Some implementations may include obtaining a point cloud that is based on lidar data reflecting one or more objects in a space; obtaining an image that includes a view of at least one of the one or more objects in the space; determining a projection of points from the point cloud onto the image; generating, using the projection, an augmented image that includes one or more channels of data from the point cloud and one or more channels of data from the image; inputting the augmented image to a two dimensional convolutional neural network to obtain a semantic labeled image wherein elements of the semantic labeled image include respective predictions; and mapping, by reversing the projection, predictions of the semantic labeled image to respective points of the point cloud to obtain a semantic labeled point cloud.
    Type: Grant
    Filed: June 28, 2018
    Date of Patent: May 12, 2020
    Assignee: Apple Inc.
    Inventors: Huy Tho Ho, Jingwei Wang, Kjell Fredrik Larsson