Patents by Inventor Qingrong Zhao

Qingrong Zhao has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20180060674
    Abstract: A method for determining wetness on a path of travel. A surface of the path of travel is captured by at least one image capture device. A plurality of wet surface detection techniques is applied to the at least one image. An analysis for each wet surface detection technique is determined in real-time of whether the surface of the path of travel is wet. Each analysis independently determines whether the path of travel is wet. Each analysis by each wet surface detection technique is input to a fusion and decision making module. Each analysis determined by each wet surface detection technique is weighted within the fusion and decision making module by comprehensive analysis of weather information, geology information, and vehicle motions. A wet surface detection signal is provided to a control device. The control device applies the wet surface detection signal to mitigate the wet surface condition.
    Type: Application
    Filed: August 24, 2016
    Publication date: March 1, 2018
    Inventors: QINGRONG ZHAO, BAKHTIAR B. LITKOUHI, QI ZHANG, JINSONG WANG
  • Publication number: 20180059677
    Abstract: A method for determining a thickness of water on a path of travel. A plurality of images of a surface of the path of travel is captured by an image capture device over a predetermined sampling period. A plurality of wet surface detection techniques are applied to each of the images. A detection rate is determined in real-time for each wet surface detection technique. A detection rate trigger condition is determined as a function of a velocity of the vehicle for each detection rate. The real-time determined detection rate trigger conditions are compared to predetermined detection rate trigger conditions in a classification module to identify matching results pattern. A water film thickness associated with the matching results pattern is identified in the classification module. A water film thickness signal is provided to a control device. The control device applies the water film thickness signal to mitigate the wet surface condition.
    Type: Application
    Filed: August 24, 2016
    Publication date: March 1, 2018
    Inventors: QINGRONG ZHAO, QI ZHANG, BAKHTIAR B. LITKOUHI, JINSONG WANG
  • Publication number: 20180043900
    Abstract: Methods and systems are provided for determining a road surface friction coefficient and controlling a feature of the vehicle based thereon. In one embodiment, a method includes: receiving signals from an electronic power steering system and an inertial measurement unit; estimating parameters associated with an electronic power steering system model using an iterative optimization method; calculating an electronic power steering system variable using the electronic power steering system model, the estimated parameters and one or more of the received signals; determining whether the calculated electronic power steering system variable satisfies a fitness criterion; and when the calculated electronic power steering system variable does satisfy the fitness criterion, determining a road surface friction coefficient based on at least one of the estimated parameters.
    Type: Application
    Filed: August 12, 2016
    Publication date: February 15, 2018
    Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventors: YADOLLAH SABRI, SIMON E. ZIMMERMAN, YINGMEI SI, STEVEN T. SCHWEITZER, QINGRONG ZHAO, QI ZHANG, NIKOLAI K. MOSHCHUK
  • Patent number: 9836660
    Abstract: A method of determining a wet surface condition of a road. An image of a road surface is captured by an image capture device of the host vehicle. The image capture device is mounted on a side of the host vehicle and an image is captured in a downward direction. A region of interest is identified in the captured image by a processor. The region of interest is in a region rearward of a tire of a host vehicle. The region of interest is representative of where a tire track as generated by the tire rotating on the road when the road surface is wet. A determination is made whether water is present in the region of interest as a function of identifying the tire track. A wet road surface signal is generated in response to the identification of water in the region of interest.
    Type: Grant
    Filed: December 3, 2015
    Date of Patent: December 5, 2017
    Assignee: GM Global Technology Operations LLC
    Inventors: Qingrong Zhao, Qi Zhang, Jinsong Wang, Bakhtiar B. Litkouhi
  • Publication number: 20170282869
    Abstract: A method of determining a surface condition of a path of travel. A plurality of images is captured of a surface of the path of travel by an image capture device. The image capture device captures images at varying scales. A feature extraction technique is applied by a feature extraction module to each of the scaled images. A fusion technique is applied, by the processor, to the extracted features for identifying the surface condition of the path of travel. A road surface condition signal provide to a control device. The control device applies the road surface condition signal to mitigate the wet road surface condition.
    Type: Application
    Filed: March 30, 2016
    Publication date: October 5, 2017
    Inventors: WEI TONG, QINGRONG ZHAO, BAKHTIAR B. LITKOUHI, SHUQING ZENG
  • Publication number: 20170161573
    Abstract: A method for determining a wet surface condition of a road. An image of a road surface is captured by an image capture device of the host vehicle. The image capture device is mounted on a side of the host vehicle and captures an image in a downward direction. Identifying in the captured image, by a processor, a region of interest. The region of interest is in a region sideways to a face of the wheel. The region of interest is representative of where sideways splash as generated by the wheel occurs. A determination is made whether water is present in the region of interest. A wet road surface signal is generated in response to the identification of water in the region of interest.
    Type: Application
    Filed: December 3, 2015
    Publication date: June 8, 2017
    Inventors: QINGRONG ZHAO, QI ZHANG, JINSONG WANG, BAKHTIAR B. LITKOUHI
  • Publication number: 20170161570
    Abstract: A method for determining a wet surface condition of a road. An image of a road surface is captured by an image capture device of the host vehicle. The image capture device is mounted on a side of the host vehicle and captures an image in a downward direction. A region of interest rearward of the wheel of the host vehicle is identified in the captured image by a processor. The region of interest is representative of where rearward splash as generated by the wheel occurs. A determination is made whether precipitation is present in the region of interest by applying a filter to the image. A wet road surface signal is generated in response to the identification of precipitation in the region of interest.
    Type: Application
    Filed: December 3, 2015
    Publication date: June 8, 2017
    Inventors: QINGRONG ZHAO, QI ZHANG, JINSONG WANG, BAKHTIAR B. LITKOUHI
  • Publication number: 20170161571
    Abstract: A method for determining a snow covered surface condition of a path of travel. A beam of light is emitted at a surface of the path of travel by a light emitting source. An image of a path of travel surface is captured by an image capture device. The image capture device is mounted on the vehicle and captures an image in a downward direction. The captured image captures the beam of light emitted on the path of travel surface. Analyzing a subsurface scattering of the light generated on the path of travel surface by a processor. A determination is made whether snow is present on the path of travel. A snow covered path of travel surface signal is generated in response to the identification of snow on the path of travel.
    Type: Application
    Filed: December 3, 2015
    Publication date: June 8, 2017
    Inventors: QINGRONG ZHAO, JINSONG WANG, QI ZHANG, BAKHTIAR B. LITKOUHI, WENDE ZHANG
  • Publication number: 20170161572
    Abstract: A method of determining a wet surface condition of a road. An image of a road surface is captured by an image capture device of the host vehicle. The image capture device is mounted on a side of the host vehicle and an image is captured in a downward direction. A region of interest is identified in the captured image by a processor. The region of interest is in a region rearward of a tire of a host vehicle. The region of interest is representative of where a tire track as generated by the tire rotating on the road when the road surface is wet. A determination is made whether water is present in the region of interest as a function of identifying the tire track. A wet road surface signal is generated in response to the identification of water in the region of interest.
    Type: Application
    Filed: December 3, 2015
    Publication date: June 8, 2017
    Inventors: QINGRONG ZHAO, QI ZHANG, JINSONG WANG, BAKHTIAR B. LITKOUHI
  • Publication number: 20170162045
    Abstract: A method for determining a wet surface condition of a road. Capturing an image of a wheel of a remote vehicle traveling in an adjacent lane by an image capture device of a host vehicle. Identifying in the captured image, by processor of a host vehicle, a region of interest relative to the wheel where the region of interest is representative of where precipitation dispersion occurs. A determination is made whether precipitation is present in the region of interest. A wet road surface signal is generated in response to the identification of precipitation in the adjacent lane.
    Type: Application
    Filed: December 3, 2015
    Publication date: June 8, 2017
    Inventors: Qingrong ZHAO, Jinsong WANG, Qi ZHANG, Bakhtiar B. LITKOUHI
  • Patent number: 9598087
    Abstract: Systems and methods use an image of a road surface that is generated by a camera. The image includes a pattern from a light source. A region of interest in the image is determined based on the pattern from the light source. A total area is determined that includes at least part of the region of interest and an area adjacent the region of interest. A feature vector is extracted based on the region of interest and the total area. A road condition is determined based on the feature vector and a classifier.
    Type: Grant
    Filed: December 12, 2014
    Date of Patent: March 21, 2017
    Assignee: GM Global Technology Operations LLC
    Inventors: Qingrong Zhao, Qi Zhang, Jinsong Wang, Bakhtiar Litkouhi, Wende Zhang
  • Patent number: 9594964
    Abstract: A method for determining a wet road surface condition for a vehicle driving on a road. A first image exterior of the vehicle is captured by an image capture device. A second image exterior of the vehicle is captured by the image capture device. A section of the road is identified in the first and second captured images. A texture of the road in the first and second images captured by a processor are compared. A determination is made whether the texture of the road in the first image is different from the texture of the road in the second image. A wet driving surface indicating signal is generated in response to the determination that the texture of the road in the first image is different than the texture of the road in the second image.
    Type: Grant
    Filed: June 12, 2014
    Date of Patent: March 14, 2017
    Assignee: GM Global Technology Operations LLC
    Inventors: Qingrong Zhao, Wende Zhang, Jinsong Wang, Bakhtiar Brian Litkouhi
  • Publication number: 20160167669
    Abstract: Systems and methods use an image of a road surface that is generated by a camera. The image includes a pattern from a light source. A region of interest in the image is determined based on the pattern from the light source. A total area is determined that includes at least part of the region of interest and an area adjacent the region of interest. A feature vector is extracted based on the region of interest and the total area. A road condition is determined based on the feature vector and a classifier.
    Type: Application
    Filed: December 12, 2014
    Publication date: June 16, 2016
    Inventors: QINGRONG ZHAO, QI ZHANG, JINSONG WANG, BAKHTIAR LITKOUHI, WENDE ZHANG
  • Publication number: 20160101782
    Abstract: Methods and systems for determining road surface information in a vehicle. In one embodiment, the method includes: determining at least one condition assessment value based on steering data; determining a feature set to include at least one of self-aligning torque (SAT), slip angle, SAT variance, steering rate, and lateral acceleration based on the condition assessment value; processing steering data obtained during a steering maneuver and associated with the feature set using a pattern classification technique; and determining a surface type based on the processing.
    Type: Application
    Filed: October 9, 2014
    Publication date: April 14, 2016
    Inventors: YOUSSEF A. GHONEIM, QINGRONG ZHAO, QI ZHANG, BAKHTIAR B. LITKOUHI, YINGMEI SI, DAVID M. SIDLOSKY, VALARIE V. BOATMAN, SAMI AHMED
  • Publication number: 20150363651
    Abstract: A method for determining a wet road surface condition for a vehicle driving on a road. A first image exterior of the vehicle is captured by an image capture device. A second image exterior of the vehicle is captured by the image capture device. A section of the road is identified in the first and second captured images. A texture of the road in the first and second images captured by a processor are compared. A determination is made whether the texture of the road in the first image is different from the texture of the road in the second image. A wet driving surface indicating signal is generated in response to the determination that the texture of the road in the first image is different than the texture of the road in the second image.
    Type: Application
    Filed: June 12, 2014
    Publication date: December 17, 2015
    Inventors: QINGRONG ZHAO, WENDE ZHANG, JINSONG WANG, BAKHTIAR BRIAN LITKOUHI
  • Publication number: 20150363654
    Abstract: A method for determining a wet road surface condition on a road. An image exterior of the vehicle is captured by an image capture device. A real object and a virtual object are detected in the captured image. A feature point is identified on the real object and on the virtual object. A potential virtual object associated with the real object is identified on a ground surface of the road in the captured image. The feature point detected on the real object is compared with the feature point detected on the virtual object. A determination is made whether the ground surface includes a mirror effect reflective surface in response to the feature point detected on the real object matching the feature point detected on the virtual object. A wet driving surface indicating signal is generated in response to the determination that the ground surface includes a mirror effect reflective surface.
    Type: Application
    Filed: June 12, 2014
    Publication date: December 17, 2015
    Inventors: QINGRONG ZHAO, WENDE ZHANG, JINSONG WANG, BAKHTIAR BRIAN LITKOUHI
  • Patent number: 9139204
    Abstract: A method of determining a road surface condition for a vehicle driving on a road. Probabilities associated with a plurality of road surface conditions based on an image of a capture scene are determined by a first probability module. Probabilities associated with the plurality of road surface conditions based on vehicle operating data are determined by a second probability module. The probabilities determined by the first and second probability modules are input to a data fusion unit for fusing the probabilities and determining a road surface condition. A refined probability is output from the data fusion unit that is a function of the fused first and second probabilities. The refined probability from the data fusion unit is provided to an adaptive learning unit. The adaptive learning unit generates output commands that refine tunable parameters of at least the first probability and second probability modules for determining the respective probabilities.
    Type: Grant
    Filed: June 12, 2014
    Date of Patent: September 22, 2015
    Assignee: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventors: Qingrong Zhao, Jinsong Wang, Wende Zhang, Bakhtiar Brian Litkouhi
  • Patent number: 9090264
    Abstract: A method for determining a wet road surface condition for a vehicle driving on a road. An image exterior of the vehicle is captured by an image capture device at a first and second instance of time. Potential objects and feature objects are detected on a ground surface of the road of travel at the first instance of time and the second instance of time. A determination is made whether the ground surface includes a mirror effect reflective surface based on a triangulation technique utilizing the feature points in the captured images at the first instance of time and the second instance of time. A wet driving surface indicating signal is generated in response to the determination that the ground surface includes a mirror effect reflective surface.
    Type: Grant
    Filed: June 12, 2014
    Date of Patent: July 28, 2015
    Assignee: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventors: Qingrong Zhao, Wende Zhang, Jinsong Wang, Bakhtiar Brian Litkouhi
  • Patent number: 8306712
    Abstract: A method is provided for determining an adhesive condition of a surface of a vehicle road using a statistical pattern recognition technique. A plurality of probability distribution functions is provided representing respective adhesive effects between the vehicle tire of a driven vehicle and the vehicle road. An index is calculated which represents a vehicle understeer characteristic. Probability analysis is applied for each of the road surface adhesive conditions as a function of the index. Each probability analysis is recursively updated. A likelihood factor is determined for each road surface adhesive condition as a function of each respective recursively updated probability analysis. Each respective road surface adhesive condition has a respective likelihood factor that identifies the likelihood of the road surface having the respective adhesive condition as a function of the index. The identified adhesive condition of the road surface is input into a vehicle control process.
    Type: Grant
    Filed: March 24, 2009
    Date of Patent: November 6, 2012
    Assignee: GM Global Technology Operations LLC
    Inventors: Weiwen Deng, Qingrong Zhao
  • Publication number: 20100250086
    Abstract: A method is provided for determining an adhesive condition of a surface of a vehicle road using a statistical pattern recognition technique. A plurality of probability distribution functions is provided representing respective adhesive effects between the vehicle tire of a driven vehicle and the vehicle road. An index is calculated which represents a vehicle understeer characteristic. Probability analysis is applied for each of the road surface adhesive conditions as a function of the index. Each probability analysis is recursively updated. A likelihood factor is determined for each road surface adhesive condition as a function of each respective recursively updated probability analysis. Each respective road surface adhesive condition has a respective likelihood factor that identifies the likelihood of the road surface having the respective adhesive condition as a function of the index. The identified adhesive condition of the road surface is input into a vehicle control process.
    Type: Application
    Filed: March 24, 2009
    Publication date: September 30, 2010
    Applicant: GM GLOBAL TECHNOLOGY OPERATIONS, INC.
    Inventors: Weiwen Deng, Qingrong Zhao