Patents by Inventor Sharath Subramanya Naidu

Sharath Subramanya Naidu has filed for patents to protect the following inventions. This listing includes patent applications that are pending as well as patents that have already been granted by the United States Patent and Trademark Office (USPTO).

  • Patent number: 11483547
    Abstract: A camera system and method are disclosed. The camera includes a memory, a camera, and a processor. The memory stores an adaptively subsampled look-up table. The adaptively subsampled look-up includes varying levels of subsampling across the adaptively subsampled look-up table. The camera captures an image, and the captured image is distorted based on varying distortions within an optical system of the camera. The processor receives the captured image from the camera, corrects the distorted captured image based on the adaptively subsampled look-up table to create a correct image, provides the corrected image, and executes a safety feature based on the corrected image.
    Type: Grant
    Filed: December 4, 2019
    Date of Patent: October 25, 2022
    Assignee: NXP USA, Inc.
    Inventors: Sharath Subramanya Naidu, Michael Andreas Staudenmaier, Ajit Singh, Leonardo Surico
  • Patent number: 11475545
    Abstract: An image processing circuit for correcting a distorted image includes an internal memory and a correction circuit. The internal memory of the image processing circuit is configured to store a radial look-up table (LUT), a set of tangential LUTs, and co-ordinates of a correction center of the distorted image. The radial LUT and the set of tangential LUTs include first and second sets of parameters to correct radial and tangential distortion of the distorted image, respectively. The correction circuit is configured to reconstruct portions of the correction LUT on-the-fly based on the radial LUT, the set of tangential LUTs, and the co-ordinates of the correction center, and correct portions of the distorted image based on the reconstructed portions of correction LUT to generate the portions of the corrected image.
    Type: Grant
    Filed: May 28, 2020
    Date of Patent: October 18, 2022
    Assignee: NXP USA, Inc.
    Inventors: Ankur Bindal, Sharath Subramanya Naidu, Juhee Mala
  • Patent number: 11443411
    Abstract: A system and method for correcting image distortion is provided. The system and method remaps pixel position of distorted images using a combination of radial distortion correction and tangential distortion correction lookup tables consuming less physical memory. The solution conserves both memory and memory access bandwidth. The radial distortion correction lookup table is formed by taking advantage of radial distortion being generally symmetric about a determined optical center of the camera lens. This symmetry allows for use of a quarter LUT for correction in all quadrants of a distorted image. In addition, tangential distortion can be corrected in a symmetric manner that saves memory space as well.
    Type: Grant
    Filed: July 8, 2020
    Date of Patent: September 13, 2022
    Assignee: NXP USA, Inc.
    Inventors: Ankur Bindal, Michael Andreas Staudenmaier, Sharath Subramanya Naidu
  • Patent number: 11295151
    Abstract: Embodiments provide line-based feature generation for vision-based driver assistance systems and methods. For one embodiment, a feature generator includes a circular buffer and a processor coupled to an image sensor. The circular buffer receives image data from the image sensor and stores N lines at a time of an image frame captured by the image sensor. The N lines of the image frame are less than all of the lines for the image frame. The processor receives the N lines from the circular buffer and stores one or more features generated from the N lines in a memory. Iterative blocks of N lines of image data are processed to complete processing of the full image frame, and multiple frames can be processed. The generated features are analyzed by a vision processor to identify, classify, and track objects for vision-based driver assistance and related vision-based assistance actions.
    Type: Grant
    Filed: July 31, 2019
    Date of Patent: April 5, 2022
    Assignee: NXP USA, Inc.
    Inventors: Sharath Subramanya Naidu, Ajit Singh, Michael Andreas Staudenmaier, Leonardo Surico, Stephan Matthias Herrmann
  • Patent number: 11270416
    Abstract: A geometric correction system and method for performing geometric correction of a distorted image in an input frame to provide a corrected image in an output frame including a local memory, geometric correction circuitry, a tile reader, and a descriptor memory storing multiple tile descriptors. The tile reader retrieves distorted tile data from the input frame into the local memory for one corrected tile group at a time according to a corresponding tile descriptor. Each tile descriptor identifies distorted tile data to retrieve and distorted tile data to skip from the local memory for the corresponding corrected tile group. The tile descriptor includes a descriptor for each row of local memory area identifying data to be read and data to be skipped for each row. Only the data needed for one or more target tiles is read to reduce memory transfer bandwidth overhead.
    Type: Grant
    Filed: December 27, 2019
    Date of Patent: March 8, 2022
    Assignee: NXP USA, Inc.
    Inventors: Sharath Subramanya Naidu, Michael Andreas Staudenmaier, Ajit Singh
  • Publication number: 20220012854
    Abstract: A system and method for correcting image distortion is provided. The system and method remaps pixel position of distorted images using a combination of radial distortion correction and tangential distortion correction lookup tables consuming less physical memory. The solution conserves both memory and memory access bandwidth. The radial distortion correction lookup table is formed by taking advantage of radial distortion being generally symmetric about a determined optical center of the camera lens. This symmetry allows for use of a quarter LUT for correction in all quadrants of a distorted image. In addition, tangential distortion can be corrected in a symmetric manner that saves memory space as well.
    Type: Application
    Filed: July 8, 2020
    Publication date: January 13, 2022
    Applicant: NXP USA, Inc.
    Inventors: Ankur Bindal, Michael Andreas Staudenmaier, Sharath Subramanya Naidu
  • Publication number: 20210374919
    Abstract: An image processing circuit for correcting a distorted image includes an internal memory and a correction circuit. The internal memory of the image processing circuit is configured to store a radial look-up table (LUT), a set of tangential LUTs, and co-ordinates of a correction center of the distorted image. The radial LUT and the set of tangential LUTs include first and second sets of parameters to correct radial and tangential distortion of the distorted image, respectively. The correction circuit is configured to reconstruct portions of the correction LUT on-the-fly based on the radial LUT, the set of tangential LUTs, and the co-ordinates of the correction center, and correct portions of the distorted image based on the reconstructed portions of correction LUT to generate the portions of the corrected image.
    Type: Application
    Filed: May 28, 2020
    Publication date: December 2, 2021
    Inventors: Ankur Bindal, Sharath Subramanya Naidu, Juhee Mala
  • Publication number: 20210201454
    Abstract: A geometric correction system and method for performing geometric correction of a distorted image in an input frame to provide a corrected image in an output frame including a local memory, geometric correction circuitry, a tile reader, and a descriptor memory storing multiple tile descriptors. The tile reader retrieves distorted tile data from the input frame into the local memory for one corrected tile group at a time according to a corresponding tile descriptor. Each tile descriptor identifies distorted tile data to retrieve and distorted tile data to skip from the local memory for the corresponding corrected tile group. The tile descriptor includes a descriptor for each row of local memory area identifying data to be read and data to be skipped for each row. Only the data needed for one or more target tiles is read to reduce memory transfer bandwidth overhead.
    Type: Application
    Filed: December 27, 2019
    Publication date: July 1, 2021
    Inventors: Sharath Subramanya Naidu, Michael Andreas Staudenmaier, Ajit Singh
  • Publication number: 20210176455
    Abstract: A camera system and method are disclosed. The camera includes a memory, a camera, and a processor. The memory stores an adaptively subsampled look-up table. The adaptively subsampled look-up includes varying levels of subsampling across the adaptively subsampled look-up table. The camera captures an image, and the captured image is distorted based on varying distortions within an optical system of the camera. The processor receives the captured image from the camera, corrects the distorted captured image based on the adaptively subsampled look-up table to create a correct image, provides the corrected image, and executes a safety feature based on the corrected image.
    Type: Application
    Filed: December 4, 2019
    Publication date: June 10, 2021
    Inventors: Sharath Subramanya Naidu, Michael Andreas Staudenmaier, Ajit Singh, Leonardo Surico
  • Publication number: 20210042890
    Abstract: A system, method, and apparatus are provided for correcting image distortions in an image processing hardware unit by specifying an input block having a dynamic or adaptive size that is capable of storing up to a plurality of distorted input sub-images from an array of distorted input sub-images stored in external memory that is connected to the image processing hardware unit, and then fetching one or more first distorted input sub-images from the external memory for storage in internal memory of the image processing hardware using the input block to perform a single read operation so that the image processing hardware can then process the one or more first distorted input sub-images as a group for distortion correction to generate a one or more first corrected output tiles.
    Type: Application
    Filed: August 5, 2019
    Publication date: February 11, 2021
    Applicant: NXP USA, Inc.
    Inventors: Sharath Subramanya Naidu, Ajit Singh, Michael Andreas Staudenmaier
  • Publication number: 20210035271
    Abstract: Embodiments are disclosed that apply adaptive sub-tiles to captured images for distortion correction in vision-based assistance systems and methods. A captured image is processed to generate corrected tiles, and selected numbers of sub-tiles are used to generate each of the corrected tiles depending upon the pixel densities for regions of the captured image. The corrected sub-tiles are combined to form corrected tiles, and corrected tiles are combined for form a corrected image. The corrected image can be used to output control signals to cause actions to be issued to a user of the system such as a driver of a vehicle. For one embodiment, the corrected tiles are generated one at a time, and corrected sub-tiles for each corrected tile are also generated one at a time based upon individual source data blocks determined by a pre-determined sub-tile configuration. Efficient memory use and data transfers are provided.
    Type: Application
    Filed: July 31, 2019
    Publication date: February 4, 2021
    Inventors: Sharath Subramanya Naidu, Michael Andreas Staudenmaier, Chanpreet Singh, Rahul Jain
  • Publication number: 20210034899
    Abstract: Embodiments provide line-based feature generation for vision-based driver assistance systems and methods. For one embodiment, a feature generator includes a circular buffer and a processor coupled to an image sensor. The circular buffer receives image data from the image sensor and stores N lines at a time of an image frame captured by the image sensor. The N lines of the image frame are less than all of the lines for the image frame. The processor receives the N lines from the circular buffer and stores one or more features generated from the N lines in a memory. Iterative blocks of N lines of image data are processed to complete processing of the full image frame, and multiple frames can be processed. The generated features are analyzed by a vision processor to identify, classify, and track objects for vision-based driver assistance and related vision-based assistance actions.
    Type: Application
    Filed: July 31, 2019
    Publication date: February 4, 2021
    Inventors: Sharath Subramanya Naidu, Ajit Singh, Michael Andreas Staudenmaier, Leonardo Surico, Stephan Matthias Herrmann
  • Patent number: 10909668
    Abstract: Embodiments are disclosed that apply adaptive sub-tiles to captured images for distortion correction in vision-based assistance systems and methods. A captured image is processed to generate corrected tiles, and selected numbers of sub-tiles are used to generate each of the corrected tiles depending upon the pixel densities for regions of the captured image. The corrected sub-tiles are combined to form corrected tiles, and corrected tiles are combined for form a corrected image. The corrected image can be used to output control signals to cause actions to be issued to a user of the system such as a driver of a vehicle. For one embodiment, the corrected tiles are generated one at a time, and corrected sub-tiles for each corrected tile are also generated one at a time based upon individual source data blocks determined by a pre-determined sub-tile configuration. Efficient memory use and data transfers are provided.
    Type: Grant
    Filed: July 31, 2019
    Date of Patent: February 2, 2021
    Assignee: NXP USA, Inc.
    Inventors: Sharath Subramanya Naidu, Michael Andreas Staudenmaier, Chanpreet Singh, Rahul Jain