Patents by Inventor Yun-Qian Miao

Yun-Qian Miao has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20240140738
    Abstract: A multimodal freight monitoring and contextual notification system for a delivery vehicle. The system may include one or more monitoring systems configured to generate monitoring data for multimodal monitoring of freight included within a cargo bay of the delivery vehicle and a contextual notification controller configured to generate a contextual notification as a function thereof.
    Type: Application
    Filed: October 26, 2022
    Publication date: May 2, 2024
    Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventors: Alaa M. Khamis, Yun Qian Miao, Christopher L. Oesterling, Derek B. Ancrum, Shawn F. Granda
  • Patent number: 11935156
    Abstract: Methods and systems are provided for generating a virtual view of a scene associated with a vehicle. In one embodiment, a method includes: obtaining image data including a plurality of images captured by a plurality of cameras of the vehicle; obtaining steering angle data captured by a sensor of the vehicle; detecting, by a processor, a shadow in at least one image of the plurality of images; determining, by the processor, auto-white balance data for each image of the plurality of images; selectively combining, by the processor, the auto-white balance data of the images based on the detected shadow, and the steering angle data; and generating, by the processor, output image data based on the combined auto-white balance data and the image data.
    Type: Grant
    Filed: February 18, 2022
    Date of Patent: March 19, 2024
    Assignee: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventors: Sai Vishnu Aluru, Yun Qian Miao, Sravan Daruri, Mohamed A. Naiel
  • Publication number: 20240029318
    Abstract: Vehicles and methods for augmenting rearview displays for vehicles are provided. An exemplary method is provided for augmenting a rearview display for a vehicle having a gate moveable between a closed configuration and an opened configuration. The method includes collecting dynamic pixel images of an area behind the vehicle using a camera connected to the vehicle. Further, the method includes, in response to a command, displaying graphical overlays to the collected dynamic pixel images on a display screen, via a processor, wherein the graphical overlays depict an outline of the gate and/or projected path of the gate in the opened configuration.
    Type: Application
    Filed: July 21, 2022
    Publication date: January 25, 2024
    Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventors: Yun Qian Miao, Norman J. Weigert, Ralph David Schlottke
  • Patent number: 11873023
    Abstract: Methods and systems are provided for assisting a user with parking a vehicle in a parking space. In various embodiments a method includes: receiving, by a processor, user input indicating a position of a virtual line displayed on a display screen of the vehicle, wherein the virtual line is adjustable by a user; storing, by the processor and in a datastore, the position of the virtual line and a vehicle position associated with a parking space; and selectively displaying, by the processor, an appearance of the virtual line on the display screen when the vehicle is within a range of the vehicle position to assist a user in parking the vehicle in the parking space, wherein the selectively displaying is based on a comparison of a boundary within a scene associated with the parking space and the virtual line.
    Type: Grant
    Filed: January 12, 2022
    Date of Patent: January 16, 2024
    Assignee: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventors: Yun Qian Miao, Jason J Parks, Norman J Weigert, Mark T Gaylord
  • Patent number: 11862904
    Abstract: Systems, Methods, and Apparatuses are provided for monitoring cable connections between a trailer and vehicle. The system includes a monitoring device disposed within the vehicle; and a trailer cable and a breakaway trailer cable that provide a set of cable connections, the monitoring device is configured to: monitor the set of cable connections from connection data generated by a set of multimodal sensors integrated with the vehicle about statuses of the cable connections between the trailer and the vehicle; initiate a monitor function upon detection of a presence of the trailer connected to the vehicle by at least one sensor of the set of multimodal sensors integrated with the vehicle; and determine the statuses of the cable connections by fusing together using an information fusion algorithm one or more types of signal data from the set of multimodal sensors comprising optical signal data, radio signal data, and range signal data.
    Type: Grant
    Filed: November 30, 2021
    Date of Patent: January 2, 2024
    Assignee: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventors: Alaa M. Khamis, Yun Qian Miao, Ralph David Schlottke
  • Publication number: 20230356727
    Abstract: Systems and methods for measuring how level a trailer is and providing trailer levelling guidance. The systems and methods include a vehicle comprising a vehicle levelness estimator, a trailer connectable to the vehicle and a rear facing camera mounted on the vehicle. The methods and systems include capturing an image of the trailer using the rear facing camera, receiving a vehicle levelness parameter from the vehicle levelness estimator of the vehicle, determining a rotation angle of the trailer relative to the vehicle based on the image, determining an estimated trailer levelness parameter based on the rotation angle and the vehicle levelness parameter, and outputting the estimated trailer levelness parameter.
    Type: Application
    Filed: May 6, 2022
    Publication date: November 9, 2023
    Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventors: Mohamed A. Naiel, Yun Qian Miao, Cristinel Padurariu, Alaa M. Khamis
  • Publication number: 20230322159
    Abstract: In exemplary embodiments, methods and systems are provided for a digital flashlight for a vehicle. In another exemplary embodiment, a system is provided that includes a display of a vehicle; and a processor coupled to the display of the vehicle and a camera of the vehicle and configured to at least facilitate: obtaining a camera image frame via the camera of the vehicle; determining a first region of the camera image frame having a first brightness level; determining a second region of the camera image frame having a second brightness level that is greater than the first brightness level; and providing instructions to the display of the vehicle for displaying the first region with increased brightness that is based on the second brightness level.
    Type: Application
    Filed: April 7, 2022
    Publication date: October 12, 2023
    Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventors: Yun Qian Miao, Charles A. Massoll, Ephraim Chi Man Yuen
  • Patent number: 11772561
    Abstract: In exemplary embodiments, methods and systems are provided for a digital flashlight for a vehicle. In another exemplary embodiment, a system is provided that includes a display of a vehicle; and a processor coupled to the display of the vehicle and a camera of the vehicle and configured to at least facilitate: obtaining a camera image frame via the camera of the vehicle; determining a first region of the camera image frame having a first brightness level; determining a second region of the camera image frame having a second brightness level that is greater than the first brightness level; and providing instructions to the display of the vehicle for displaying the first region with increased brightness that is based on the second brightness level.
    Type: Grant
    Filed: April 7, 2022
    Date of Patent: October 3, 2023
    Assignee: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventors: Yun Qian Miao, Charles A Massoll, Ephraim Chi Man Yuen
  • Publication number: 20230281552
    Abstract: A method includes virtually dividing a cargo area of a vehicle into a plurality of virtual cells. The method also includes creating, by implementing machine learning, a load profile for the cargo area. The load profile indicates a weight estimate at each of the plurality of virtual cells based on a load in the cargo area. Guidance on moving the load within the cargo area is provided based on the load profile to balance the load in the cargo area.
    Type: Application
    Filed: March 1, 2022
    Publication date: September 7, 2023
    Inventors: Alaa M. Khamis, Yun Qian Miao, Romeo D. Garcia, JR., Gaurav Talwar
  • Publication number: 20230267655
    Abstract: Methods and systems are provided for generating a virtual view of a scene associated with a vehicle. In one embodiment, a method includes: obtaining image data including a plurality of images captured by a plurality of cameras of the vehicle; obtaining steering angle data captured by a sensor of the vehicle; detecting, by a processor, a shadow in at least one image of the plurality of images; determining, by the processor, auto-white balance data for each image of the plurality of images; selectively combining, by the processor, the auto-white balance data of the images based on the detected shadow, and the steering angle data; and generating, by the processor, output image data based on the combined auto-white balance data and the image data.
    Type: Application
    Filed: February 18, 2022
    Publication date: August 24, 2023
    Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventors: Sai Vishnu Aluru, Yun Qian Miao, Sravan Daruri, Mohamed A. Naiel
  • Publication number: 20230219620
    Abstract: Methods and systems are provided for assisting a user with parking a vehicle in a parking space. In various embodiments a method includes: receiving, by a processor, user input indicating a position of a virtual line displayed on a display screen of the vehicle, wherein the virtual line is adjustable by a user; storing, by the processor and in a datastore, the position of the virtual line and a vehicle position associated with a parking space; and selectively displaying, by the processor, an appearance of the virtual line on the display screen when the vehicle is within a range of the vehicle position to assist a user in parking the vehicle in the parking space, wherein the selectively displaying is based on a comparison of a boundary within a scene associated with the parking space and the virtual line.
    Type: Application
    Filed: January 12, 2022
    Publication date: July 13, 2023
    Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventors: Yun Qian Miao, Jason J. Parks, Norman J. Weigert, Mark T Gaylord
  • Publication number: 20230170652
    Abstract: Systems, Methods, and Apparatuses are provided for monitoring cable connections between a trailer and vehicle. The system includes a monitoring device disposed within the vehicle; and a trailer cable and a breakaway trailer cable that provide a set of cable connections, the monitoring device is configured to: monitor the set of cable connections from connection data generated by a set of multimodal sensors integrated with the vehicle about statuses of the cable connections between the trailer and the vehicle; initiate a monitor function upon detection of a presence of the trailer connected to the vehicle by at least one sensor of the set of multimodal sensors integrated with the vehicle; and determine the statuses of the cable connections by fusing together using an information fusion algorithm one or more types of signal data from the set of multimodal sensors comprising optical signal data, radio signal data, and range signal data.
    Type: Application
    Filed: November 30, 2021
    Publication date: June 1, 2023
    Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventors: Alaa M. Khamis, Yun Qian Miao, Ralph David Schlottke
  • Publication number: 20230137098
    Abstract: Systems for detecting movement of a trailer having a rearward facing camera and linked to a tow vehicle. The systems include taking a first image and a second image with the camera and comparing the images. A first amount of trailer movement is determined between the second image and the first image. The systems may also take additional images and determine a second amount of trailer movement occurring between the additional images. Tracking the first amount and the second amount of trailer movement determines an amount of trailer sway. The determined trailer sway may be compared to a maximum allowable sway and, if the movement is greater than the maximum allowable sway, mitigating sway of the trailer with the tow vehicle.
    Type: Application
    Filed: November 3, 2021
    Publication date: May 4, 2023
    Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventors: Yun Qian Miao, Halit Zengin, Akram M. Abdel-Rahman, Todd W. Nelson
  • Patent number: 11511669
    Abstract: A system for trailer coupler localization for guidance during a hitching maneuver for a vehicle includes a trailer device including a trailer coupler and a graphic providing structure affixed to the trailer coupler. The structure includes at least one predefined graphic image. The system further includes a rear facing camera device attached to the vehicle and providing a captured image of the predefined graphic image. The system further includes a computerized controller, including programming to receive and analyze the captured image of the predefined graphic image to determine a relative position of the graphic providing structure to the camera device. The controller further includes programming to utilize the analysis to determine a relative position of the trailer coupler to a trailer hitch ball of the vehicle and to provide an output to control the hitching maneuver based upon the relative position.
    Type: Grant
    Filed: May 10, 2021
    Date of Patent: November 29, 2022
    Assignee: GM Global Technology Operations LLC
    Inventors: Zachary T. Kroeze, Yun Qian Miao, Shi M. Yu, Patrick Andruszkiewicz, Ralph D. Schlottke
  • Publication number: 20220355735
    Abstract: A system for trailer coupler localization for guidance during a hitching maneuver for a vehicle includes a trailer device including a trailer coupler and a graphic providing structure affixed to the trailer coupler. The structure includes at least one predefined graphic image. The system further includes a rear facing camera device attached to the vehicle and providing a captured image of the predefined graphic image. The system further includes a computerized controller, including programming to receive and analyze the captured image of the predefined graphic image to determine a relative position of the graphic providing structure to the camera device. The controller further includes programming to utilize the analysis to determine a relative position of the trailer coupler to a trailer hitch ball of the vehicle and to provide an output to control the hitching maneuver based upon the relative position.
    Type: Application
    Filed: May 10, 2021
    Publication date: November 10, 2022
    Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventors: Zachary T. Kroeze, Yun Qian Miao, Shi M. Yu, Patrick Andruszkiewicz, Ralph D. Schlottke
  • Patent number: 11358637
    Abstract: Methods and apparatus are provided for determining a hitch articulation angle including a camera for capturing a first image and a second image, a steering sensor configured to detect a steering angle, a velocity sensor configured to detect a vehicle velocity, a processor configured to for generating a bird's eye view of the first image and the second image through a perspective transform, generating a trailer hitch model from the first image in response to the steering angle and the vehicle velocity indicating a vehicle is traveling in a straight forward direction, generating a current hitch model from the second image, determining a hitch articulation angle in response to an angular difference between the trailer hitch model and the current hitch model, and a vehicle controller controlling the vehicle in response to the hitch articulation angle.
    Type: Grant
    Filed: December 16, 2019
    Date of Patent: June 14, 2022
    Assignee: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventors: Zachary T. Kroeze, Yun Qian Miao
  • Patent number: 11231716
    Abstract: Methods and apparatus are provided for determining a trailer dimension including a radar for generating a depth map wherein the depth map includes a detection of a first trailer surface, a camera for generating an image of the first trailer surface, a processor operative to determine a first dimension of the first trailer surface in response to the depth map and a second dimension of the first trailer surface in response to the first dimension and the image, and a vehicle controller controlling a vehicle in response to the first dimension and the second dimension.
    Type: Grant
    Filed: January 28, 2020
    Date of Patent: January 25, 2022
    Assignee: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventors: Dan Mepham, Hongguang Sun, Yun Qian Miao
  • Publication number: 20210232142
    Abstract: Methods and apparatus are provided for determining a trailer dimension including a radar for generating a depth map wherein the depth map includes a detection of a first trailer surface, a camera for generating an image of the first trailer surface, a processor operative to determine a first dimension of the first trailer surface in response to the depth map and a second dimension of the first trailer surface in response to the first dimension and the image, and a vehicle controller controlling a vehicle in response to the first dimension and the second dimension.
    Type: Application
    Filed: January 28, 2020
    Publication date: July 29, 2021
    Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventors: Dan Mepham, Hongguang Sun, Yun Qian Miao
  • Patent number: 11070707
    Abstract: One general aspect includes a method to remove a vehicle shadow from image information, the method includes the steps of—determining a location of the vehicle shadow in an environment surrounding the vehicle, (based on the outcome of step) selecting one or more cameras installed on the vehicle, and removing the vehicle shadow from the image information produced by the one or more cameras.
    Type: Grant
    Filed: January 6, 2020
    Date of Patent: July 20, 2021
    Assignee: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventors: Mohannad Murad, Sai Vishnu Aluru, Yun Qian Miao
  • Publication number: 20210211558
    Abstract: One general aspect includes a method to remove a vehicle shadow from image information, the method includes the steps of—determining a location of the vehicle shadow in an environment surrounding the vehicle, (based on the outcome of step) selecting one or more cameras installed on the vehicle, and removing the vehicle shadow from the image information produced by the one or more cameras.
    Type: Application
    Filed: January 6, 2020
    Publication date: July 8, 2021
    Inventors: Mohannad Murad, Sai Vishnu Aluru, Yun Qian Miao