Patents by Inventor Yuesheng Lu

Yuesheng Lu has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11553140
    Abstract: A vehicular vision system includes first and second cameras disposed at a vehicle and having respective overlapping fields of view that include a road surface of a road along which the vehicle is traveling. Image data captured by the cameras is provided to an image processor and is processed to determine relative movement of a road feature present in the captured image data. The determined movement of the road feature relative to the vehicle in first image data captured by the first camera is compared to the determined movement of the road feature relative to the vehicle in second image data captured by the second camera, and at least a rotational offset of the second camera at the vehicle relative to the first camera at the vehicle is determined and the image data are remapped to at least partially accommodate misalignment of the second camera relative to the first camera.
    Type: Grant
    Filed: December 14, 2020
    Date of Patent: January 10, 2023
    Assignee: MAGNA ELECTRONICS INC.
    Inventor: Yuesheng Lu
  • Publication number: 20230001855
    Abstract: A vehicular vision system includes at least one color camera disposed at a vehicle and having an image sensor operable to capture image data. A first system on chip (SoC) includes an image signal processor that receives captured image data and converts the received image data to converted data that is in a format suitable for machine vision processing. A second system on chip (SoC) receives captured image data and communicates display data to a display disposed in the vehicle, with the display data being in a format suitable for display of video images at the display. At startup of the vehicle, video images derived from the display data are displayed by the display within a time period following startup of the vehicle and machine vision data processing of converted data does not commence until after the display time period has elapsed following startup of the vehicle.
    Type: Application
    Filed: September 2, 2022
    Publication date: January 5, 2023
    Inventors: Yuesheng Lu, Vivek Vaid, Patrick A. Miller
  • Publication number: 20230001984
    Abstract: A vehicular trailer guidance system includes an electronic control unit (ECU) and a rear backup camera disposed at a vehicle. A human machine interface (HMI) is operable in (i) a trailer left-backup mode, (i) a trailer straight-backup mode and (iii) a trailer right-backup mode. Responsive to selection by the driver of the trailer left-backup mode or trailer right-backup mode, the ECU sets a desired trailer angle of the trailer tongue leftward or rightward to an angle that is commensurate with a driver-selected setting of an input device. Responsive to selection by the driver of the trailer straight-backup mode, the ECU sets the desired trailer angle to a zero degree angle. The ECU, while the vehicle is backing up the trailer, controls the power steering system of the vehicle to steer the vehicle to back up the trailer to have the determined trailer angle coincide with the set desired trailer angle.
    Type: Application
    Filed: December 16, 2020
    Publication date: January 5, 2023
    Inventors: Yuesheng Lu, Jyothi P. Gali, Richard C. Bozich, Alexander Velichko
  • Publication number: 20220410907
    Abstract: A vehicular driver monitoring system includes a camera and an electronic control unit. The camera is disposed at an interior rearview mirror assembly of the vehicle so as to view at least the face of a driver of the vehicle. The camera captures image data and the captured image data includes image data representative of the face of the driver. The vehicular driver monitoring system detects changes at the driver's eyes via processing by the image processor of image data captured by the camera, and determines driver attentiveness based at least in part on detected changes at the driver's eyes. The vehicular driver monitoring system functions as a remote Photoplethysmography system, and monitors a heart rate of the driver based at least in part on processing at the electronic control unit of image data captured by the camera, and determines impairment of the driver's capability to operate the vehicle.
    Type: Application
    Filed: September 2, 2022
    Publication date: December 29, 2022
    Inventor: Yuesheng Lu
  • Publication number: 20220417413
    Abstract: A vehicular vision system includes an exterior lighting assembly that illuminates a field of illumination exterior of a vehicle. A light source controller operates the exterior lighting assembly in a repeating cycle that includes (i) a first illumination period wherein light emitted by the exterior lighting assembly has a first brightness level and (ii) a second illumination period wherein the emitted light has a second brightness level lower than the first brightness level. A camera controller operates a camera to capture image data during at least part of the first illumination period and at least part of the second illumination period. A camera signal processor receives captured image data and processes image data captured by the camera during the first illumination period for (i) display of video images derived from the image data captured by the camera during the first illumination period and/or (ii) for object detection.
    Type: Application
    Filed: August 29, 2022
    Publication date: December 29, 2022
    Inventors: Clarence P. McElroy, Yuesheng Lu, Axel Nix
  • Patent number: 11535158
    Abstract: A vehicular vision system includes a camera having a housing and a lens barrel including a lens. The camera is configured to be disposed at an exterior portion of a vehicle so as to have a field of view exterior of the vehicle. An image processor is operable to process frames of image data captured by the camera. A heating device is disposed at or near the lens and is activated to initially heat the lens responsive to determination, via processing by the image processor of a frame of captured image data, of a threshold degree of lens occlusion at the lens. The heating device is (i) deactivated responsive to determination that the determined lens occlusion is not water or moisture, or (ii) further powered to increase the heating function responsive to determination that the determined occlusion is water or moisture.
    Type: Grant
    Filed: March 26, 2020
    Date of Patent: December 27, 2022
    Assignee: MAGNA ELECTRONICS INC.
    Inventors: Zhongyao Liu, Yuesheng Lu, Jonathan D. Conger
  • Patent number: 11528391
    Abstract: A vehicular camera module includes a front housing, a printed circuit board housed by the front housing, an imager at the printed circuit board, a rear housing joined with the front housing, and a coaxial connecting element. With the rear housing joined with the front housing, an inward-extending portion of the coaxial connecting element extends inward of the rear housing towards the front housing and electrically connects with circuitry at the printed circuit board. With the rear housing joined with the front housing, a plurality of spring tabs make electrical connection between the circuitry at the printed circuit board and the rear housing. An outward-extending portion of the coaxial connecting element is configured for coaxial electrical connection to a vehicle connector.
    Type: Grant
    Filed: February 3, 2022
    Date of Patent: December 13, 2022
    Assignee: MAGNA ELECTRONICS INC.
    Inventors: Jamie A. Mleczko, Jonathan D. Conger, Steven V. Byrne, Yuesheng Lu
  • Patent number: 11518377
    Abstract: A vehicular vision system includes a camera, a distance sensor and a controller having at least one processor. Image data captured by the camera and sensor data captured by the distance sensor are processed at the controller. The controller, responsive to processing of captured image data and of captured sensor data, detects an object. The controller determines the distance to the detected object based at least in part on difference between the positions of the detected object in captured image data and in captured sensor data. The controller, responsive to processing of captured image data and of captured sensor data, and responsive to the determined distance to the detected object, determines that the detected object represents a collision risk. The controller alerts a driver of the vehicle of the collision risk and/or controls the vehicle to mitigate the collision risk.
    Type: Grant
    Filed: December 21, 2020
    Date of Patent: December 6, 2022
    Assignee: MAGNA ELECTRONICS INC.
    Inventors: Yuesheng Lu, Joel S. Gibson, Duane W. Gebauer, Richard D. Shriner, Patrick A. Miller
  • Patent number: 11505123
    Abstract: A vehicular camera monitoring system includes a pair of rearward viewing cameras disposed at a vehicle with overlapping fields of view. A driver-monitoring camera is disposed at the vehicle. An ECU includes an image processor that processes image data captured by the driver-monitor camera and the rearward viewing cameras. A stereographic video display screen is disposed at the vehicle and viewable by the driver of the vehicle. Responsive to processing of image data captured by the driver-monitoring camera, the ECU determines location of each eye of the driver of the vehicle. Responsive to processing of image data captured by each of the rearward viewing cameras, the stereographic video display screen displays video images derived at least in part from image data captured by both rearward viewing cameras and provides depth perception to the driver of the vehicle viewing the displayed video images.
    Type: Grant
    Filed: December 1, 2020
    Date of Patent: November 22, 2022
    Assignee: MAGNA ELECTRONICS INC.
    Inventor: Yuesheng Lu
  • Patent number: 11498494
    Abstract: A vehicular camera monitoring system a driver-side camera, a driver-side video display screen disposed at a driver-side cabin region of an interior cabin of the vehicle, a passenger-side camera and a passenger-side video display screen disposed at a passenger-side cabin region of the interior cabin of the vehicle. During a parking maneuver or parking-space exit maneuver of the vehicle, the driver-side video display screen displays parking assist images derived from image data captured by the driver-side camera and the passenger-side video display screen displays parking assist images derived from image data captured by the passenger-side camera.
    Type: Grant
    Filed: November 23, 2020
    Date of Patent: November 15, 2022
    Assignee: MAGNA ELECTRONICS INC.
    Inventors: Niall R. Lynam, Yuesheng Lu
  • Publication number: 20220357551
    Abstract: A vehicular camera includes a circuit board having an imager disposed at a first side of the circuit board. A lens barrel accommodates a lens assembly having a plurality of lens elements spaced apart along the lens barrel by respective lens spacers. Each lens spacer is formed of a material having a coefficient of thermal expansion (CTE) of 5 ppm/° C. or less. The circuit board is positioned at a lens holder, and the lens barrel is positioned at a lens holder so as to optically align the lens and the imager. The lens barrel is formed of a material having a CTE that matches within ten percent of the CTE of the material that forms the lens holder, with the CTEs of the lens barrel and lens holder materials being greater than the CTE of the material of the lens spacers.
    Type: Application
    Filed: July 25, 2022
    Publication date: November 10, 2022
    Inventors: Zhongyao Liu, Steven V. Byrne, Yuesheng Lu
  • Patent number: 11479174
    Abstract: A camera for a vehicular vision system includes a circuit board having a first side and a second side opposite the first side. The circuit board has a first coefficient of thermal expansion (CTE). An imager is disposed at the first side of the circuit board, and a lens assembly is optically aligned with the imager. A bend-countering element is disposed at the first side or the second side of the circuit board. The bend-countering element has a second CTE that is different from the first CTE of the circuit board. The bend-countering element counters temperature-induced bending of the circuit board. With the camera disposed at the vehicle, temperature-induced bending of the bend-countering element is in an opposite direction from temperature-induced bending of the circuit board.
    Type: Grant
    Filed: January 25, 2021
    Date of Patent: October 25, 2022
    Assignee: MAGNA ELECTRONICS INC.
    Inventors: Yuesheng Lu, Steven V. Byrne
  • Patent number: 11465560
    Abstract: A vehicular vision system includes a rear backup vehicle camera, a trailer camera disposed at a rear of a trailer, a display device disposed in the vehicle, and an electronic control unit (ECU) disposed in the vehicle. With the trailer not hitched to the vehicle and during a reversing maneuver of the vehicle, the ECU generates video images derived at least in part from image data captured by the rear backup vehicle camera and the display device displays the video images. With the trailer hitched to the vehicle, image data captured by the trailer camera is provided to the vehicle via data communication over powerline using a DC powerline, and the display device displays the video images derived at least in part from image data captured by the trailer camera for viewing by the driver of the vehicle during the driving maneuver of the vehicle with the trailer hitched thereto.
    Type: Grant
    Filed: November 22, 2021
    Date of Patent: October 11, 2022
    Assignee: MAGNA ELECTRONICS INC.
    Inventors: Yuesheng Lu, Krishna Koravadi, Vivek Vaid, Joshua G. Windeler, Heinz A. Mattern
  • Patent number: 11457134
    Abstract: A camera sub-assembly for a vehicular camera includes a lens barrel having a cylinder accommodating a plurality of lens optics, and an annular flange extending radially outward from the cylinder. The cylinder is received in a receiving structure of a lens holder so that an annular attaching surface of the lens barrel is juxtaposed with an annular attaching surface of the receiving structure with a cured adhesive disposed between and contacting both of the annular attaching surfaces. The cured adhesive includes an adhesive material. With the lens optics aligned with respect to an imaging array of a printed circuit board attached at the lens holder, the adhesive material is cured to a partially-cured state via exposure of the adhesive material to ultraviolet light. With the joined lens barrel and lens holder construction at a further curing station, the adhesive material is further cured from the partially-cured state to a more-cured state.
    Type: Grant
    Filed: February 8, 2021
    Date of Patent: September 27, 2022
    Assignee: MAGNA ELECTRONICS INC.
    Inventors: Matthew C. Sesti, Robert A. Devota, Yuesheng Lu, Steven V. Byrne, Joel S. Gibson
  • Patent number: 11433809
    Abstract: A vision system for a vehicle includes at least one camera disposed at a vehicle and having an image sensor operable to capture image data. A display is operable to display video images for viewing by a driver of the vehicle during normal operation of the vehicle. A first system on chip (SoC) receives captured image data and processes the received captured image data for machine vision. The first SoC, responsive to image processing of the received captured image data, generates an output for a driver assistance system of the vehicle. A second system on chip (SoC) receives captured image data and communicates the image data to the display.
    Type: Grant
    Filed: February 1, 2017
    Date of Patent: September 6, 2022
    Assignee: MAGNA ELECTRONICS INC.
    Inventors: Yuesheng Lu, Vivek Vaid, Patrick A. Miller
  • Patent number: 11433906
    Abstract: A driver monitoring system for a vehicle includes a camera and an ECU. The camera is disposed at an interior of the vehicle so as to view the face of a driver of the vehicle. The camera captures image data and the captured image data includes image data representative of the face of the driver. The ECU includes electronic circuitry and associated software, with the electronic circuitry including an image processor that processes image data captured by the camera. The ECU, responsive to processing by the image processor of image data captured by the camera, determines a heart rate of the driver.
    Type: Grant
    Filed: July 9, 2020
    Date of Patent: September 6, 2022
    Assignee: MAGNA ELECTRONICS INC.
    Inventor: Yuesheng Lu
  • Patent number: 11431916
    Abstract: An imaging system for a vehicle includes a tail lamp assembly that illuminates a field of illumination rearward of the vehicle. A light source control may operate at least one light source of the tail lamp assembly in a repeating cycle that includes (i) a first illumination period wherein light emitted by the tail lamp assembly has a first brightness level and (ii) a second illumination period wherein light emitted by the tail lamp assembly has a second brightness level that is lower than the first brightness level. A camera is operable to capture image data representative of a region that is at least in part within the field of illumination. A camera control may operate the camera to capture image data during at least part of the first illumination period.
    Type: Grant
    Filed: October 12, 2020
    Date of Patent: August 30, 2022
    Assignee: MAGNA ELECTRONICS INC.
    Inventors: Clarence P. McElroy, Yuesheng Lu, Axel Nix
  • Publication number: 20220268933
    Abstract: A vehicular object detection system includes a camera and a lidar. With the camera mounted at a windshield of a vehicle, and with the lidar mounted at an exterior portion of the vehicle, and based at least in part on processing of image data captured by the camera and lidar data captured by the lidar, a plurality of individual objects present exterior of the vehicle are detected. Based at least in part on processing of captured image data and captured lidar data, (i) respective proximity relative to the vehicle of individual objects is determined, (ii) respective speed relative to the vehicle of individual objects is determined and (iii) respective location relative to the vehicle of individual objects is determined. Based at least in part on processing of captured image data and/or processing of captured lidar data, the system determines collision potential between the vehicle and an individual object.
    Type: Application
    Filed: May 13, 2022
    Publication date: August 25, 2022
    Inventors: Yuesheng Lu, Michael J. Higgins-Luthman
  • Publication number: 20220262038
    Abstract: A vehicular imaging system includes a camera disposed behind a windshield of a vehicle and viewing through a portion of the windshield. Image data captured by the camera is provided to a control. The control receives, via a communication bus of the vehicle, at least one selected from the group consisting of (i) vehicle pitch information relating to pitch of the vehicle, (ii) vehicle yaw information relating to yaw of the vehicle and (iii) vehicle steering information relating to steering of the vehicle. The system automatically corrects for misalignment of the camera. Image data captured by the camera is processed at the control for a lane departure warning system of the vehicle and for at least one selected from the group consisting of (i) an automatic headlamp control system of the vehicle, (ii) a collision avoidance system of the vehicle and (iii) an adaptive front lighting system of the vehicle.
    Type: Application
    Filed: May 9, 2022
    Publication date: August 18, 2022
    Inventors: Yuesheng Lu, Michael J. Higgins-Luthman, Antony V. Jeyaraj, Manoj R. Phirke
  • Patent number: 11410431
    Abstract: A vehicular control system includes a rear backup camera viewing at least rearward of the vehicle. With a trailer hitched to the vehicle, and based at least in part on image processing of captured image data during a backing-up maneuver, the image processor determines a distance between an axle of the trailer and the hitch of the vehicle and determines a trailer angle of the trailer hitched to the vehicle. During the backing-up maneuver of the trailer hitched to the vehicle, the vehicular control system determines a path of the trailer responsive to (i) a steering angle of the vehicle, (ii) the determined trailer angle of the trailer and (iii) the determined distance between the axle of the trailer and the hitch of the vehicle. The vehicular control system displays information to assist the driver in backing up the trailer hitched to the vehicle.
    Type: Grant
    Filed: February 1, 2021
    Date of Patent: August 9, 2022
    Assignee: MAGNA ELECTRONICS INC.
    Inventors: Sebastian Pliefke, Paul Jarmola, Thomas Wierich, Steven V. Byrne, Yuesheng Lu