Patents by Inventor Daan He

Daan He has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11554717
    Abstract: A vehicular vision system includes a camera disposed at a vehicle and operable to capture multiple frames of image data during a driving maneuver of the vehicle. A control includes an image processor that processes frames of captured image data to determine feature points in an image frame when the vehicle is operated within a first range of steering angles, and to determine motion trajectories of those feature points in subsequent image frames for the respective range of steering angles. The control determines a horizon line based on the determined motion trajectories. Responsive to determination that the determined horizon line is non-parallel to the horizontal axis of the image plane, at least one of pitch, roll or yaw of the camera is adjusted. Image data captured by the camera is processed at the control for object detection.
    Type: Grant
    Filed: May 17, 2021
    Date of Patent: January 17, 2023
    Assignee: MAGNA ELECTRONICS INC.
    Inventors: Nikhil Gupta, Hilda Faraji, Daan He, Ghanshyam Rathi
  • Publication number: 20220092721
    Abstract: The present disclosure provides systems and methods for improved image watermarking to improve robustness and capacity, without degrading perceptibility. Specifically, the systems and methods discussed herein allow for a higher decoding success rate, at the same distortion level and message rate; or a higher message rate, at the same distortion level and decoding success rate. Implementations of these systems utilize a side chain of additional information, available only to the decoder and not the encoder, to achieve asymptotically lossless data compression, allowing the same message to be transmitted in fewer bits.
    Type: Application
    Filed: June 18, 2020
    Publication date: March 24, 2022
    Applicant: Google LLC
    Inventors: Daan He, Dake He
  • Publication number: 20210268962
    Abstract: A vehicular vision system includes a camera disposed at a vehicle and operable to capture multiple frames of image data during a driving maneuver of the vehicle. A control includes an image processor that processes frames of captured image data to determine feature points in an image frame when the vehicle is operated within a first range of steering angles, and to determine motion trajectories of those feature points in subsequent image frames for the respective range of steering angles. The control determines a horizon line based on the determined motion trajectories. Responsive to determination that the determined horizon line is non-parallel to the horizontal axis of the image plane, at least one of pitch, roll or yaw of the camera is adjusted. Image data captured by the camera is processed at the control for object detection.
    Type: Application
    Filed: May 17, 2021
    Publication date: September 2, 2021
    Inventors: Nikhil Gupta, Hilda Faraji, Daan He, Ghanshyam Rathi
  • Patent number: 11007934
    Abstract: A method for dynamically calibrating a vehicular camera includes disposing a camera at a vehicle and operating the camera to capture multiple frames of image data while the vehicle is in motion and is steered within at least two ranges of steering angles. Feature points are determined in an image frame when the vehicle is steered within a respective range of steering angles, and motion trajectories of those feature points are tracked in subsequent image frames for the respective range of steering angles. A horizon line is determined based on the tracked feature points. Responsive to determination that the determined horizon line is non-parallel to the horizontal axis of the image plane, at least one of pitch, roll or yaw of the camera is adjusted. Image data captured by the camera is processed at the control for object detection.
    Type: Grant
    Filed: May 4, 2020
    Date of Patent: May 18, 2021
    Assignee: MAGNA ELECTRONICS INC.
    Inventors: Nikhil Gupta, Hilda Faraji, Daan He, Ghanshyam Rathi
  • Patent number: 10919458
    Abstract: A method for calibrating a vehicular camera includes providing at least a front or rear camera and a side camera with overlapping fields of view, and calibrating the front or rear camera, capturing a calibrated frame of image data with the front or rear camera, and capturing a sideward frame of image data with a side camera. At least one feature is determined present in the overlapping region of the calibrated frame, and pixel positions of the determined feature are predicted for the side camera. Misalignment of the side camera is determined based on a comparison of the predicted pixel positions of the determined feature to the pixel positions of the determined feature in the sideward frame of image data captured by the side camera. Processing of image data captured by the side camera is adjusted to accommodate the determined misalignment.
    Type: Grant
    Filed: May 18, 2020
    Date of Patent: February 16, 2021
    Assignee: MAGNA ELECTRONICS INC.
    Inventors: Nikhil Gupta, Hilda Faraji, Daan He, Ghanshyam Rathi
  • Publication number: 20200276939
    Abstract: A method for calibrating a vehicular camera includes providing at least a front or rear camera and a side camera with overlapping fields of view, and calibrating the front or rear camera, capturing a calibrated frame of image data with the front or rear camera, and capturing a sideward frame of image data with a side camera. At least one feature is determined present in the overlapping region of the calibrated frame, and pixel positions of the determined feature are predicted for the side camera. Misalignment of the side camera is determined based on a comparison of the predicted pixel positions of the determined feature to the pixel positions of the determined feature in the sideward frame of image data captured by the side camera. Processing of image data captured by the side camera is adjusted to accommodate the determined misalignment.
    Type: Application
    Filed: May 18, 2020
    Publication date: September 3, 2020
    Inventors: Nikhil Gupta, Hilda Faraji, Daan He, Ghanshyam Rathi
  • Publication number: 20200262347
    Abstract: A method for dynamically calibrating a vehicular camera includes disposing a camera at a vehicle and operating the camera to capture multiple frames of image data while the vehicle is in motion and is steered within at least two ranges of steering angles. Feature points are determined in an image frame when the vehicle is steered within a respective range of steering angles, and motion trajectories of those feature points are tracked in subsequent image frames for the respective range of steering angles. A horizon line is determined based on the tracked feature points. Responsive to determination that the determined horizon line is non-parallel to the horizontal axis of the image plane, at least one of pitch, roll or yaw of the camera is adjusted. Image data captured by the camera is processed at the control for object detection.
    Type: Application
    Filed: May 4, 2020
    Publication date: August 20, 2020
    Inventors: Nikhil Gupta, Hilda Faraji, Daan He, Ghanshyam Rathi
  • Patent number: 10654423
    Abstract: A method for dynamically ascertaining alignment of a vehicular camera relative to a vehicle to which the camera is attached includes determining a plurality of steering angle ranges for the vehicle, each of which is a range of steering angles that approximates straight vehicle motion over less than two seconds of travel time of the vehicle while the vehicle is in motion and turning. Image data captured by a camera of the vehicle is processed to determine a central vanishing point when the vehicle is in motion and moving straight. A plurality of feature points are selected in the image frames for each steering angle range, and a vanishing point for a plurality of tracked motion trajectories for each steering angle range is determined. An alignment of the camera is determined based at least in part on the determined central vanishing point and a determined vanishing line.
    Type: Grant
    Filed: December 4, 2017
    Date of Patent: May 19, 2020
    Assignee: MAGNA ELECTRONICS INC.
    Inventors: Nikhil Gupta, Hilda Faraji, Daan He, Ghanshyam Rathi
  • Patent number: 10640041
    Abstract: A method for dynamically calibrating without manual intervention a forward viewing vehicular camera with respect to its three rotational degrees of freedom includes disposing a camera at a vehicle and operating the camera to acquire multiple frames of image data as the vehicle is moving and steered through a plurality of steering angles. Feature points are determined in an image frame when the vehicle is steered within a respective range of steering angles and motion trajectories of those feature points are tracked in subsequent image frames for the respective range of steering angles. A vanishing point is established in the image plane for the feature points for the respective range of steering angles. Based on established vanishing points, a vanishing line is determined. When the vanishing line is determined to be non-horizontal, at least one of pitch, roll or yaw of the camera is adjusted.
    Type: Grant
    Filed: February 4, 2019
    Date of Patent: May 5, 2020
    Assignee: MAGNA ELECTRONICS INC.
    Inventors: Nikhil Gupta, Hilda Faraji, Daan He, Ghanshyam Rathi
  • Publication number: 20190168670
    Abstract: A method for dynamically calibrating without manual intervention a forward viewing vehicular camera with respect to its three rotational degrees of freedom includes disposing a camera at a vehicle and operating the camera to acquire multiple frames of image data as the vehicle is moving and steered through a plurality of steering angles. Feature points are determined in an image frame when the vehicle is steered within a respective range of steering angles and motion trajectories of those feature points are tracked in subsequent image frames for the respective range of steering angles. A vanishing point is established in the image plane for the feature points for the respective range of steering angles. Based on established vanishing points, a vanishing line is determined. When the vanishing line is determined to be non-horizontal, at least one of pitch, roll or yaw of the camera is adjusted.
    Type: Application
    Filed: February 4, 2019
    Publication date: June 6, 2019
    Inventors: Nikhil Gupta, Hilda Faraji, Daan He, Ghanshyam Rathi
  • Patent number: 10202077
    Abstract: A method for dynamically correcting misalignment of a vehicular camera includes fixedly disposing a camera at a vehicle and operating the camera to acquire multiple frames of image data while the vehicle is moving generally in a straight line. A plurality of sets of feature points are selected in an image frame, with each set including a first feature point and a second feature point. For each set of feature points, a motion trajectory of that set's feature points is tracked in subsequent image frames. For each tracked first and second feature points, a vanishing point is established in the image plane. Based on the established vanishing point, a vanishing line is determined in the image plane. When the vanishing line is determined to be non-horizontal in the image plane, at least one of pitch, roll or yaw of the camera is adjusted to correct rotational misalignment of the camera.
    Type: Grant
    Filed: May 23, 2016
    Date of Patent: February 12, 2019
    Assignee: MAGNA ELECTRONICS INC.
    Inventors: Nikhil Gupta, Hilda Faraji, Daan He, Ghanshyam Rathi
  • Publication number: 20180086284
    Abstract: A method for dynamically ascertaining alignment of a vehicular camera relative to a vehicle to which the camera is attached includes determining a plurality of steering angle ranges for the vehicle, each of which is a range of steering angles that approximates straight vehicle motion over less than two seconds of travel time of the vehicle while the vehicle is in motion and turning. Image data captured by a camera of the vehicle is processed to determine a central vanishing point when the vehicle is in motion and moving straight. A plurality of feature points are selected in the image frames for each steering angle range, and a vanishing point for a plurality of tracked motion trajectories for each steering angle range is determined. An alignment of the camera is determined based at least in part on the determined central vanishing point and a determined vanishing line.
    Type: Application
    Filed: December 4, 2017
    Publication date: March 29, 2018
    Inventors: Nikhil Gupta, Hilda Faraji, Daan He, Ghanshyam Rathi
  • Patent number: 9834153
    Abstract: A method of dynamically calibrating a given camera relative to a reference camera of a vehicle includes identifying an overlapping region in an image frame provided by the given camera and an image frame provided by the reference camera and selecting at least a portion of an object in the overlapped region of the reference image frame. Expected pixel positions of the selected object portion in the given image frame is determined based on the location of the selected object portion in the reference image frame, and pixel positions of the selected object portion are located as detected in the given image frame. An alignment of the given camera is determined based on a comparison of the pixel positions of the selected object portion in the given image frame to the expected pixel positions of the selected object portion in the given image frame.
    Type: Grant
    Filed: April 25, 2012
    Date of Patent: December 5, 2017
    Assignee: MAGNA ELECTRONICS INC.
    Inventors: Nikhil Gupta, Hilda Faraji, Daan He, Ghanshyam Rathi
  • Publication number: 20160267657
    Abstract: A method for dynamically correcting misalignment of a vehicular camera includes fixedly disposing a camera at a vehicle and operating the camera to acquire multiple frames of image data whilst the vehicle is moving generally in a straight line. A plurality of sets of feature points are selected in an image frame, with each set including a first feature point and a second feature point. For each set of feature points, a motion trajectory of that set's feature points is tracked in subsequent image frames. For each tracked first and second feature points, a vanishing point is established in the image plane. Based on the established vanishing point, a vanishing line is determined in the image plane. When the vanishing line is determined to be non-horizontal in the image plane, at least one of pitch, roll or yaw of the camera is adjusted to correct rotational misalignment of the camera.
    Type: Application
    Filed: May 23, 2016
    Publication date: September 15, 2016
    Inventors: Nikhil Gupta, Hilda Faraji, Daan He, Ghanshyam Rathi
  • Patent number: 9357208
    Abstract: A method of dynamically ascertaining the alignment of a vehicular camera. The method involves acquiring a sequence of images provided by the camera whilst the vehicle is in motion. For each range of steering angles, the method (i) selects a plurality of feature points in the images, (ii) tracks a motion trajectory for each selected feature point, and (iii) determines a vanishing point in the image plane based on the tracked motion trajectories. The method determines a vanishing line in the image plane based on a locus of these vanishing points and determines the alignment of the camera based on the position of a central vanishing point (corresponding to the zero degree angle) and the vanishing line.
    Type: Grant
    Filed: January 20, 2012
    Date of Patent: May 31, 2016
    Assignee: MAGNA ELECTRONICS INC.
    Inventors: Nikhil Gupta, Hilda Faraji, Daan He, Ghanshyam Rathi
  • Publication number: 20150049193
    Abstract: A method of dynamically calibrating a given camera relative to a reference camera of a vehicle includes identifying an overlapping region in an image frame provided by the given camera and an image frame provided by the reference camera and selecting at least a portion of an object in the overlapped region of the reference image frame. Expected pixel positions of the selected object portion in the given image frame is determined based on the location of the selected object portion in the reference image frame, and pixel positions of the selected object portion are located as detected in the given image frame. An alignment of the given camera is determined based on a comparison of the pixel positions of the selected object portion in the given image frame to the expected pixel positions of the selected object portion in the given image frame.
    Type: Application
    Filed: April 25, 2012
    Publication date: February 19, 2015
    Applicant: MAGNA INTERNATIONAL INC.
    Inventors: Nikhil Gupta, Hilda Faraji, Daan He, Ghanshyam Rathi
  • Publication number: 20140043473
    Abstract: A method of dynamically ascertaining the alignment of a vehicular camera. The method involves acquiring a sequence of images provided by the camera whilst the vehicle is in motion. For each range of steering angles, the method (i) selects a plurality of feature points in the images, (ii) tracks a motion trajectory for each selected feature point, and (iii) determines a vanishing point in the image plane based on the tracked motion trajectories. The method determines a vanishing line in the image plane based on a locus of these vanishing points and determines the alignment of the camera based on the position of a central vanishing point (corresponding to the zero degree angle) and the vanishing line.
    Type: Application
    Filed: January 20, 2012
    Publication date: February 13, 2014
    Inventors: Nikhil Gupta, Hilda Faraji, Daan He, Ghanshyam Rathi