Patents by Inventor Andreas Wallin
Andreas Wallin has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).
-
Patent number: 11787334Abstract: The present invention relates to a driver assistance (DA) system and method for vehicle flank safety. This system and method also have utility in autonomous driving (AD) applications. The system and method optionally pair one or more cameras with one or more proximity sensors to provide free space awareness and contact avoidance related to the flank of a vehicle, providing a virtual distance grid overlay on one or more camera views available to an operator, predefined safety boundary intrusion detection under low-speed maneuvering conditions, door-open obstruction and danger detection, and a flank illumination system.Type: GrantFiled: September 4, 2019Date of Patent: October 17, 2023Assignee: Volvo Car CorporationInventors: Sihao Ding, Andreas Wallin, Megha Maheshwari
-
Patent number: 11308639Abstract: A method and apparatus for annotating point cloud data. An apparatus may be configured to cause display of the point cloud data, label points in the point cloud data with a plurality of annotation points, the plurality of annotation points corresponding to points on a human body, move, in response to a user input, one or more of the annotation points to define a human pose and create annotated point cloud data, and output the annotated point cloud data.Type: GrantFiled: November 22, 2019Date of Patent: April 19, 2022Assignee: Volvo Car CorporationInventors: Saudin Botonjic, Sihao Ding, Andreas Wallin
-
Patent number: 11302198Abstract: An on-board vehicle system and method for camera or sensor-based parking spot detection and identification is provided. This system and method utilizes a standard front (or side or rear) camera or sensor image to detect and identify one or more parking spots at a distance via vector or like representation using a deep neural network trained with data annotated using an annotation tool, without first transforming the standard camera or sensor image(s) to a bird's-eye-view (BEV) or the like. The system and method can be incorporated in a driver-assist (DA) or autonomous driving (AD) system.Type: GrantFiled: July 20, 2020Date of Patent: April 12, 2022Assignee: Volvo Car CorporationInventors: Sihao Ding, Andreas Wallin
-
Patent number: 11100366Abstract: Methods and systems for digital image segmentation and annotation, including: receiving a digital image depicting, in part, an object of interest from an input file; one or more of manually and automatically adding a polygon around the object of interest to generate a segmented digital image; one or more of manually and automatically appending a label to the polygon around the object of interest to generate a segmented and annotated digital image, wherein the label indicates one or more of an identity and a characteristic of the object of interest; and outputting information related to the segmented and annotated digital image to an output file. Optionally, the polygon is one of a bounding box and a 4-point polygon. Optionally, the object of interest is a parking spot.Type: GrantFiled: April 26, 2018Date of Patent: August 24, 2021Assignee: Volvo Car CorporationInventors: Sohini Roy Chowdhury, Andreas Wallin, Sihao Ding
-
Vehicle lane marking and other object detection using side fisheye cameras and three-fold de-warping
Patent number: 11055541Abstract: A method performed by a vehicle system for handling images of the surroundings of a vehicle. An image of the surroundings of the vehicle is obtained. The image is obtained from at least one side image capturing device mounted in or on the vehicle, and the image capturing device comprises a fisheye camera lens. At least a part of the distortions in the image is corrected to obtain a corrected image. The corrected image is rotationally transformed using a first rotational transformation to obtain a first transformed image. The corrected image is rotationally transformed using a second rotational transformation to obtain a second transformed image. The first and second transformed images are consecutive or adjacent images.Type: GrantFiled: February 1, 2019Date of Patent: July 6, 2021Assignee: Volvo Car CorporationInventors: Andreas Wallin, Sihao Ding -
Patent number: 11043005Abstract: An apparatus and method for estimating the pose of one or more persons is described. An example technique may include receiving a point cloud from a LiDAR sensor, the point cloud including a plurality of points representing positions of objects relative to the LiDAR sensor, processing the point cloud to produce a voxelized frame including a plurality of voxels, processing the voxelized frame using a deep neural network to determine one or more persons relative to the LiDAR sensor and a pose for each of the one or more persons, and outputting a location of the determined one or more persons and the pose for each of the determined one or more persons.Type: GrantFiled: November 22, 2019Date of Patent: June 22, 2021Assignee: Volvo Car CorporationInventors: Andreas Wallin, Sihao Ding
-
Patent number: 10916013Abstract: There is provided a method for image segmentation and annotation. The method comprises: providing an image; reducing the image size and smoothing the image to perform low-pass filtering on the image; restoring the image size; performing pixel level clustering of the image; performing spatial clustering of the image; selecting one or more clusters corresponding to a region of interest, ROI, based on a predetermined image mask, wherein the predetermined image mask has a known location in relation to the ROI; defining the selected one or more clusters as a proposed ROI; and determining if the proposed ROI sufficiently corresponds to an actual ROI.Type: GrantFiled: February 1, 2019Date of Patent: February 9, 2021Assignee: Volvo Car CorporationInventors: Andreas Wallin, Sohini Roy Chowdhury
-
Patent number: 10915767Abstract: Parking spot detection methods and systems that detect and pair parking line markers, improving the accuracy and speed of parking spot detection in vehicular driver assist (DA) and autonomous driving (AD) applications. These methods and systems incorporate three major steps: (1) preprocessing—one or more standard camera images are input into the algorithm and a bird's-eye-view (BEV) image is output from the algorithm; (2) deep neural network (DNN) segmentation of the parking line markers—the BEV image is input into the algorithm and a binary image is output from the algorithm (with, e.g., the parking line markers areas displayed in white and the background displayed in black); and (3) binary image processing—the binary image is input into the algorithm and detected and paired parking line markers representing the parking spots are output from the algorithm.Type: GrantFiled: September 12, 2019Date of Patent: February 9, 2021Assignee: Volvo Car CorporationInventors: Sihao Ding, Minming Zhao, Ying Li, Andreas Wallin, Harshavardhan Reddy Dasari, Gambhir Bista
-
Publication number: 20200349847Abstract: An on-board vehicle system and method for camera or sensor-based parking spot detection and identification is provided. This system and method utilizes a standard front (or side or rear) camera or sensor image to detect and identify one or more parking spots at a distance via vector or like representation using a deep neural network trained with data annotated using an annotation tool, without first transforming the standard camera or sensor image(s) to a bird's-eye-view (BEV) or the like. The system and method can be incorporated in a driver-assist (DA) or autonomous driving (AD) system.Type: ApplicationFiled: July 20, 2020Publication date: November 5, 2020Inventors: Sihao DING, Andreas WALLIN
-
Publication number: 20200294266Abstract: A method and apparatus for annotating point cloud data. An apparatus may be configured to cause display of the point cloud data, label points in the point cloud data with a plurality of annotation points, the plurality of annotation points corresponding to points on a human body, move, in response to a user input, one or more of the annotation points to define a human pose and create annotated point cloud data, and output the annotated point cloud data.Type: ApplicationFiled: November 22, 2019Publication date: September 17, 2020Inventors: Saudin Botonjic, Sihao Ding, Andreas Wallin
-
Patent number: 10720058Abstract: The present invention provides an on-board vehicle system and method for camera or sensor-based parking spot detection and identification. Advantageously, this system and method utilizes a standard front (or side or rear) camera or sensor image to detect and identify one or more parking spots at a distance via vector or like representation using a deep neural network trained with data annotated using an annotation tool, without first transforming the standard camera or sensor image(s) to a bird's-eye-view (BEV) or the like. The system and method can be incorporated in a driver-assist (DA) or autonomous driving (AD) system.Type: GrantFiled: September 13, 2018Date of Patent: July 21, 2020Assignee: Volvo Car CorporationInventors: Sihao Ding, Andreas Wallin
-
Publication number: 20200167954Abstract: An apparatus and method for estimating the pose of one or more persons is described. An example technique may include receiving a point cloud from a LiDAR sensor, the point cloud including a plurality of points representing positions of objects relative to the LiDAR sensor, processing the point cloud to produce a voxelized frame including a plurality of voxels, processing the voxelized frame using a deep neural network to determine one or more persons relative to the LiDAR sensor and a pose for each of the one or more persons, and outputting a location of the determined one or more persons and the pose for each of the determined one or more persons.Type: ApplicationFiled: November 22, 2019Publication date: May 28, 2020Inventors: Andreas Wallin, Sihao Ding
-
VEHICLE LANE MARKING AND OTHER OBJECT DETECTION USING SIDE FISHEYE CAMERAS AND THREE-FOLD DE-WARPING
Publication number: 20200117918Abstract: A method performed by a vehicle system for handling images of the surroundings of a vehicle. An image of the surroundings of the vehicle is obtained. The image is obtained from at least one side image capturing device mounted in or on the vehicle, and the image capturing device comprises a fisheye camera lens. At least a part of the distortions in the image is corrected to obtain a corrected image. The corrected image is rotationally transformed using a first rotational transformation to obtain a first transformed image. The corrected image is rotationally transformed using a second rotational transformation to obtain a second transformed image. The first and second transformed images are consecutive or adjacent images.Type: ApplicationFiled: February 1, 2019Publication date: April 16, 2020Inventors: Andreas WALLIN, Sihao DING -
Publication number: 20200090519Abstract: The present invention provides an on-board vehicle system and method for camera or sensor-based parking spot detection and identification. Advantageously, this system and method utilizes a standard front (or side or rear) camera or sensor image to detect and identify one or more parking spots at a distance via vector or like representation using a deep neural network trained with data annotated using an annotation tool, without first transforming the standard camera or sensor image(s) to a bird's-eye-view (BEV) or the like. The system and method can be incorporated in a driver-assist (DA) or autonomous driving (AD) system.Type: ApplicationFiled: September 13, 2018Publication date: March 19, 2020Inventors: Sihao DING, Andreas WALLIN
-
Publication number: 20200089974Abstract: Parking spot detection methods and systems that detect and pair parking line markers, improving the accuracy and speed of parking spot detection in vehicular driver assist (DA) and autonomous driving (AD) applications. These methods and systems incorporate three major steps: (1) preprocessing—one or more standard camera images are input into the algorithm and a bird's-eye-view (BEV) image is output from the algorithm; (2) deep neural network (DNN) segmentation of the parking line markers—the BEV image is input into the algorithm and a binary image is output from the algorithm (with, e.g., the parking line markers areas displayed in white and the background displayed in black); and (3) binary image processing—the binary image is input into the algorithm and detected and paired parking line markers representing the parking spots are output from the algorithm.Type: ApplicationFiled: September 12, 2019Publication date: March 19, 2020Inventors: Sihao DING, Minming ZHAO, Ying LI, Andreas WALLIN, Harshavardhan Reddy DASARI, Gambhir BISTA
-
Publication number: 20200070725Abstract: The present invention relates to a driver assistance (DA) system and method for vehicle flank safety. This system and method also have utility in autonomous driving (AD) applications. The system and method optionally pair one or more cameras with one or more proximity sensors to provide free space awareness and contact avoidance related to the flank of a vehicle, providing a virtual distance grid overlay on one or more camera views available to an operator, predefined safety boundary intrusion detection under low-speed maneuvering conditions, door-open obstruction and danger detection, and a flank illumination system.Type: ApplicationFiled: September 4, 2019Publication date: March 5, 2020Inventors: Sihao DING, Andreas WALLIN, Megha MAHESHWARI
-
Publication number: 20190332893Abstract: Methods and systems for digital image segmentation and annotation, including: receiving a digital image depicting, in part, an object of interest from an input file; one or more of manually and automatically adding a polygon around the object of interest to generate a segmented digital image; one or more of manually and automatically appending a label to the polygon around the object of interest to generate a segmented and annotated digital image, wherein the label indicates one or more of an identity and a characteristic of the object of interest; and outputting information related to the segmented and annotated digital image to an output file. Optionally, the polygon is one of a bounding box and a 4-point polygon. Optionally, the object of interest is a parking spot.Type: ApplicationFiled: April 26, 2018Publication date: October 31, 2019Inventors: Sohini ROY CHOWDHURY, Andreas WALLIN, Sihao DING
-
Publication number: 20190287252Abstract: There is provided a method for image segmentation and annotation. The method comprises: providing an image; reducing the image size and smoothing the image to perform low-pass filtering on the image; restoring the image size; performing pixel level clustering of the image; performing spatial clustering of the image; selecting one or more clusters corresponding to a region of interest, ROI, based on a predetermined image mask, wherein the predetermined image mask has a known location in relation to the ROI; defining the selected one or more clusters as a proposed ROI; and determining if the proposed ROI sufficiently corresponds to an actual ROI.Type: ApplicationFiled: February 1, 2019Publication date: September 19, 2019Inventors: Andreas WALLIN, Sohini ROY CHOWDHURY
-
Patent number: 9273881Abstract: A connecting piece for a duct such as a ventilation duct is provided and includes an inner flow space in communication with the interior of the duct, the connecting piece having at least one joining portion on which an end region of the duct is slidable and fixable. The connecting piece includes a compressed fiber material and a binder. The connecting piece displays a substantially configurationally stable portion in association with the joining portion, and the connecting piece displays, at least interiorly, a layer which is impervious to a fluid, in particular a gas, this layer being adjacent the inner flow space of the connecting piece.Type: GrantFiled: November 23, 2010Date of Patent: March 1, 2016Assignee: Climate Recovery Ind. ABInventors: Peter Wallin, Göran Bernhardsson, Andreas Wallin
-
Patent number: 8406960Abstract: A vehicle safety system comprising: at least one occupant safety device (6) for protecting an occupant of the vehicle (1) in the event of a side impact; and a control unit (7) operable to receive information from one or more vehicle sensors (2, 3, 4, 5) and to provide a trigger signal to activate the occupant safety device (6). Under normal driving conditions, a default deployment algorithm is used by the control unit (7) to determine whether the trigger signal should be generated; and if it is determined that loss of control of the vehicle (1) is occurring, or is expected to occur, and the longitudinal speed of the vehicle (1) exceeds a first threshold, the control unit (7) employs a first further deployment algorithm to determine whether the trigger signal should be generated. The first further deployment algorithm being adapted to cause the trigger signal to be generated a shorter time after the initiation of a side impact than is the case for the default deployment algorithm.Type: GrantFiled: January 28, 2008Date of Patent: March 26, 2013Assignee: Autoliv Development ABInventors: Yannick Erb, Yann Le Merrer, Peter Hardå, Andreas Wallin