Patents by Inventor Mohannad Murad

Mohannad Murad has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Publication number: 20200318973
    Abstract: A method for vehicle tracking and localization includes receiving, by a controller, odometry data from a sensor of the first vehicle; geospatial data from a Global Positioning System (GPS) device of the first vehicle; inertial data from an inertial measurement unit (IMU) of the first vehicle; estimating an estimated-current location of the first vehicle and an estimated-current trajectory of the first vehicle using the odometry data from the sensor, the geospatial data from the GPS device, and the inertial data from the IMU of the first vehicle; inputting the inertial data into a Bayesian Network to determine a predicted location of the first vehicle and a predicted trajectory of the first vehicle, and updating the Bayesian Network using the estimated-current location and the estimated-current trajectory of the first vehicle using the odometry data and the geospatial data.
    Type: Application
    Filed: April 2, 2019
    Publication date: October 8, 2020
    Applicant: GM Global Technology Operations LLC
    Inventors: Lawrence A. Bush, Fan Bai, Pengfei Ren, Eric L. Raphael, Mohannad Murad, Mohammad Naserian
  • Patent number: 10793091
    Abstract: A system and method to perform dynamic bandwidth adjustment among two or more vehicle sensors includes receiving input. The input includes data from each of the two or more vehicle sensors. The two or more vehicle sensors include a camera, an audio detector, a radar system, or a lidar system. The method also includes determining a bandwidth at which each of the two or more vehicle sensors should provide the data, and providing a control signal to each of the two or more vehicle sensors to adjust the bandwidth based on the determining.
    Type: Grant
    Filed: February 1, 2018
    Date of Patent: October 6, 2020
    Assignee: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventors: Yasen Hu, Shuqing Zeng, Wei Tong, Mohannad Murad, David R. Petrucci, Gregg R. Kittinger
  • Publication number: 20200304752
    Abstract: Methods and apparatus are provided for real time video upscaling in a vehicle display system. The apparatus includes a camera for capturing an image having a first resolution, a display operative at a second resolution, a sensor for detecting a condition, and a processor for selecting a scaling algorithm in response to the first resolution, the second resolution and the condition, the processor further operative to scale the image from the first resolution to the second resolution to generate a rescaled image and for coupling the rescaled image to the display.
    Type: Application
    Filed: March 20, 2019
    Publication date: September 24, 2020
    Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventors: Sai Vishnu Aluru, Mohannad Murad, James A. Carpenter, Joseph G. Machak
  • Patent number: 10777078
    Abstract: One general aspect includes a method to provide an alert to a vehicle occupant, the method includes: detecting, via an internal camera, whether the vehicle occupant is paying attention to an environment surrounding the vehicle; detecting, via an external camera, an occurrence of an event in the environment surrounding the vehicle; and based on each of the preceding steps, providing a notification configured to alert the vehicle occupant to transition the vehicle from a stopped state to a moving state.
    Type: Grant
    Filed: January 6, 2020
    Date of Patent: September 15, 2020
    Assignee: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventor: Mohannad Murad
  • Patent number: 10757363
    Abstract: A method and system for gathering vehicle video data, processing the vehicle video data, and providing the processed data to a cloud layer that reconstructs the scene encountered by the vehicle. By reconstructing the encountered scene at the cloud layer, a variety of commands can be generated for that vehicle or other vehicles in the vicinity, where the commands address the conditions being experienced by the vehicles. This may be particularly useful for autonomous or semi-autonomous vehicles. If the reconstructed scene is not sufficiently accurate or detailed, one or more data extraction parameter(s) can be adjusted so that additional data is provided to the cloud layer; if the reconstructed scene is sufficiently accurate, then the data extraction parameter(s) can be adjusted so that less data is provided to the cloud layer, thus, reducing unnecessary cellular data charges.
    Type: Grant
    Filed: October 30, 2018
    Date of Patent: August 25, 2020
    Assignee: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventors: Fan Bai, Mohannad Murad, Douglas C. Martin
  • Patent number: 10739455
    Abstract: In various embodiments, methods, systems, and vehicles are provided for distance determinations using cameras from different vehicles. The system includes a first camera onboard a first vehicle, providing a first image, the first image having therein an object of interest (OOI) for which a distance from the first vehicle is desired; and a second camera, providing second camera data including a second image having therein the OOI. The system further includes a control module configured to process and time synchronize first camera data and second camera data to generate a distance determination for the OOI, using the first camera data, the second camera data, and a distance between the first and second camera.
    Type: Grant
    Filed: May 24, 2018
    Date of Patent: August 11, 2020
    Assignee: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventors: Mohannad Murad, Fan Bai, Joseph G. Machak
  • Patent number: 10733233
    Abstract: In various embodiments, methods, systems, and vehicles are provided that include obtaining first camera images from a first camera onboard a first vehicle; generating, via one or more computer processors, a first situation awareness graph with respect to objects near the first vehicle, using the first camera images; obtaining second camera images from a second camera of a second device that is in proximity to the first vehicle; generating, via one or more computer processors, a second situation awareness graph with the respect to the objects, using the second camera images; and generating, via one or more computer processor, a global situation awareness graph with respect to the objects, by merging the first situation awareness graph with the second situation awareness graph, using respective first and second weights for the first and second situation awareness graphs.
    Type: Grant
    Filed: April 11, 2018
    Date of Patent: August 4, 2020
    Assignee: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventors: Fan Bai, Mohannad Murad, Joseph G. Machak, Wende Zhang
  • Patent number: 10710593
    Abstract: An automotive vehicle includes an actuator configured to control vehicle steering, acceleration, or shifting, a sensor configured to capture images of a region exterior to the vehicle, and a controller in communication with the actuator and the sensor. The controller is configured to selectively control the actuator according to a primary mode and a secondary mode. The controller is additionally configured to detect liquid on a driving surface proximate the vehicle, to estimate a depth of the liquid based on images captured by the sensor, and to control the actuator in the secondary mode in response to the depth exceeding a predefined threshold.
    Type: Grant
    Filed: September 4, 2018
    Date of Patent: July 14, 2020
    Assignee: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventor: Mohannad Murad
  • Publication number: 20200192362
    Abstract: A parking assist system and method for aligning a capture resonator mounted on a vehicle with a source resonator, charging pad, disposed on a ground surface is disclosed. The parking assist system includes a vehicle GPS receiver, a vehicle external sensor, an ultra-wide band (UWB) sensor, a controller; and a display device. The controller is configured to process information collected from the vehicle GPS receiver, the vehicle external sensor, and the UWB sensor to determine the location of the source resonator and to calculate a path to park the vehicle such that the capture resonator is aligned with the source resonator. A rendering of a trajectory path is displayed on a display device. The calculated path may be communicated to an autonomous driving system to autonomously maneuvering the vehicle into a parking space such that the capture resonator is aligned with the source resonator.
    Type: Application
    Filed: December 12, 2018
    Publication date: June 18, 2020
    Inventors: Mohannad Murad, Eugene F. Saltzberg, Michael J. Bliss, Apral S. Hara, Junhua Tang
  • Publication number: 20200167941
    Abstract: Systems and methods for depth estimation of images from a mono-camera by use of radar data by: receiving, a plurality of input 2-D images from the mono-camera; generating, by the processing unit, an estimated depth image by supervised training of an image estimation model; generating, by the processing unit, a synthetic image from a first input image and a second input image from the mono-camera by applying an estimated transform pose; comparing, by the processing unit, an estimated three-dimensional (3-D) point cloud to radar data by applying another estimated transform pose to a 3-D point cloud wherein the 3-D point cloud is estimated from a depth image by supervised training of the image estimation model to radar distance and radar doppler measurement; correcting a depth estimation of the estimated depth image by losses derived from differences: of the synthetic image and original images; of an estimated depth image and a measured radar distance; and of an estimated doppler information and measured radar d
    Type: Application
    Filed: November 27, 2018
    Publication date: May 28, 2020
    Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventors: Wei Tong, Shuqing Zeng, Mohannad Murad, Alaa M. Khamis
  • Publication number: 20200137351
    Abstract: A method and system for gathering vehicle video data, processing the vehicle video data, and providing the processed data to a cloud layer that reconstructs the scene encountered by the vehicle. By reconstructing the encountered scene at the cloud layer, a variety of commands can be generated for that vehicle or other vehicles in the vicinity, where the commands address the conditions being experienced by the vehicles. This may be particularly useful for autonomous or semi-autonomous vehicles. If the reconstructed scene is not sufficiently accurate or detailed, one or more data extraction parameter(s) can be adjusted so that additional data is provided to the cloud layer; if the reconstructed scene is sufficiently accurate, then the data extraction parameter(s) can be adjusted so that less data is provided to the cloud layer, thus, reducing unnecessary cellular data charges.
    Type: Application
    Filed: October 30, 2018
    Publication date: April 30, 2020
    Inventors: Fan Bai, Mohannad Murad, Douglas C. Martin
  • Publication number: 20200133293
    Abstract: A system and method are provided for aiding an operator in operating a vehicle. In one embodiment, a system includes a sensor system configured to generate sensor data sensed from an environment of the vehicle. The system further includes a control module configured to, by a processor, to determine a scene of the environment based on the sensor data, determine a terrain feature in the environment based on the sensor data, alter a graphic of a vehicle component based on the terrain feature, and generate display data to display the altered graphic and the terrain feature in the scene for viewing by the operator of the vehicle.
    Type: Application
    Filed: October 26, 2018
    Publication date: April 30, 2020
    Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventors: FARIA CHOWDHURY, MOHANNAD MURAD, MICHAEL T. CHANEY, JR.
  • Publication number: 20200108775
    Abstract: A method and system for generating a combined rearview image of an area behind a vehicle that is towing a trailer, the method including: capturing a first image from a vehicle camera that is installed on the vehicle, the first image being comprised of an area behind the vehicle; capturing a second image from a trailer camera that is installed on the trailer, the second image being comprised of an area behind the trailer; determining an obstructed viewing region within the first image, the obstructed viewing region being a region of the first image in which the trailer resides; overlaying the second image on the first image and at least partially within the obstructed viewing region; and inserting graphics in the first image, in the second image, and/or in a patch region within the obstructed viewing region and between the second image and the first image.
    Type: Application
    Filed: December 5, 2019
    Publication date: April 9, 2020
    Inventors: Mohannad Murad, Fred W. Huntzicker, Caroline Chung
  • Patent number: 10607092
    Abstract: A system includes an object identification module, a tailgate position module, and a user interface device (UID) control module. The object identification module is configured to identify at least one of a bumper of a vehicle and a tailgate of the vehicle in an image captured by a camera mounted to the tailgate. The tailgate position module is configured to determine that the tailgate is closed when the bumper is identified in the image, and determine that the tailgate is open when at least one of: the tailgate is identified in the image; and the bumper is not identified in the image. The UID control module is configured to adjust operation of a user interface device based on whether the tailgate is open or closed.
    Type: Grant
    Filed: January 25, 2018
    Date of Patent: March 31, 2020
    Assignee: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventors: Mohannad Murad, Bryan W. Fowler, Princess Len Carlos
  • Patent number: 10594958
    Abstract: Methods and systems are provided for controlling camera images for a camera of a vehicle are provided. In certain examples, a vehicle includes a camera, an input unit, and a processor. The input unit is configured to obtain data pertaining to a light pattern in proximity to the vehicle. The processor is configured to at least facilitate: (i) determining the light pattern in proximity to the vehicle using the data; and (ii) providing instructions for selectively binning the camera images based on the light pattern, the selectively binning including binning first pixels together for a particular image or portion thereof, but leaving second pixels for the particular image un-binned, based on the light pattern.
    Type: Grant
    Filed: October 20, 2017
    Date of Patent: March 17, 2020
    Assignee: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventors: Mohannad Murad, Joseph G. Machak, Donald R. Gignac
  • Patent number: 10592784
    Abstract: A system and method to perform detection based on sensor fusion includes obtaining data from two or more sensors of different types. The method also includes extracting features from the data from the two or more sensors and processing the features to obtain a vector associated with each of the two or more sensors. The method further includes concatenating the two or more vectors obtained from the two or more sensors to obtain a fused vector, and performing the detection based on the fused vector.
    Type: Grant
    Filed: February 20, 2018
    Date of Patent: March 17, 2020
    Assignee: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventors: Shuqing Zeng, Wei Tong, Yasen Hu, Mohannad Murad, David R. Petrucci, Gregg R. Kittinger
  • Publication number: 20200070837
    Abstract: An automotive vehicle includes an actuator configured to control vehicle steering, acceleration, or shifting, a sensor configured to capture images of a region exterior to the vehicle, and a controller in communication with the actuator and the sensor. The controller is configured to selectively control the actuator according to a primary mode and a secondary mode. The controller is additionally configured to detect liquid on a driving surface proximate the vehicle, to estimate a depth of the liquid based on images captured by the sensor, and to control the actuator in the secondary mode in response to the depth exceeding a predefined threshold.
    Type: Application
    Filed: September 4, 2018
    Publication date: March 5, 2020
    Inventor: MOHANNAD MURAD
  • Patent number: 10567724
    Abstract: A method and system to perform dynamic demosaicing for a camera in a vehicle involve an array of image sensors of the camera to obtain light intensity values. Each image sensor of the array of image sensors represents a pixel. An array of filters of the camera overlays the array of image sensors and restricts a wavelength range for which the one image sensor of the array of image sensors obtains the light intensity value. The array of filters includes at least two different types of filters corresponding with two different wavelength ranges. A processor estimates a current state associated with the vehicle and selects a demosaicing algorithm based on the current state such that, for each pixel, the demosaicing algorithm facilitates an estimate of the light intensity value at a different wavelength range than the wavelength range for which the corresponding image sensor obtained the light intensity value.
    Type: Grant
    Filed: April 10, 2018
    Date of Patent: February 18, 2020
    Assignee: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventors: Shiv G. Patel, Mohannad Murad, Joseph G. Machak, Fred W. Huntzicker
  • Patent number: 10549694
    Abstract: A method and system for generating a combined rearview image of an area behind a vehicle that is towing a trailer, the method including: capturing a first image from a vehicle camera that is installed on the vehicle, the first image being comprised of an area behind the vehicle; capturing a second image from a trailer camera that is installed on the trailer, the second image being comprised of an area behind the trailer; determining an obstructed viewing region within the first image, the obstructed viewing region being a region of the first image in which the trailer resides; overlaying the second image on the first image and at least partially within the obstructed viewing region; and inserting graphics in the first image, in the second image, and/or in a patch region within the obstructed viewing region and between the second image and the first image.
    Type: Grant
    Filed: February 6, 2018
    Date of Patent: February 4, 2020
    Assignee: GM GLOBAL TECHNOLOGY OPERATIONS LLC
    Inventors: Mohannad Murad, Fred W. Huntzicker, Caroline Chung
  • Publication number: 20190389486
    Abstract: An automotive vehicle includes a cabin, an optical sensor arranged to capture images of the cabin, a light control system operable to modify an intensity or direction of incident light in the cabin, and a controller. The controller is configured to automatically, in response to an object detection request, control the optical sensor to capture a first image of the cabin with a first incident light configuration, control the light control system to modify an intensity or direction of incident light in the cabin to a second incident light configuration, control the optical sensor to capture a second image of the cabin with the second incident light configuration, detect a change in a shadow between the first image and the second image, infer the presence of an object in the cabin based on the change in shadow, and perform a corrective action based on the presence of the object.
    Type: Application
    Filed: June 22, 2018
    Publication date: December 26, 2019
    Inventors: Mohannad Murad, Eric Hatfield